Caution regarding the use of pilot studies to guide power calculations for study proposals.
Clinical researchers often propose (or review committees demand) pilot studies to determine whether a study is worth performing and to guide power calculations. The most likely outcomes are that (1) studies worth performing are aborted and (2) studies that are not aborted are underpowered. There are many excellent reasons for performing pilot studies. The argument herein is not meant to discourage clinical researchers from performing pilot studies (or review committees from requiring them) but simply to caution against their use for the objective of guiding power calculations.
Kraemer
Helena Chmura
HC
Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, Calif 94305, USA. hck@stanford.edu
Mintz
Jim
J
Noda
Art
A
Tinklenberg
Jared
J
Yesavage
Jerome A
JA
D035843:Biomedical Research / Q000592:standards* / Q000706:statistics & numerical data*; D003627:Data Interpretation, Statistical; D005240:Feasibility Studies; D006801:Humans; D015233:Models, Statistical; D017712:Peer Review, Research / Q000592:standards*; D010865:Pilot Projects; D016032:Randomized Controlled Trials as Topic / Q000592:standards / Q000706:statistics & numerical data; D012107:Research Design / Q000592:standards*; D012109:Research Support as Topic / Q000592:standards; D018401:Sample Size