Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials.
BACKGROUND
Medical evidence may be biased over time if completion and publication of randomized efficacy trials are delayed when results are not statistically significant.


OBJECTIVE
To evaluate whether the time to completion and the time to publication of randomized phase 2 and phase 3 trials are affected by the statistical significance of results and to describe the natural history of such trials.


METHODS
Prospective cohort of randomized efficacy trials conducted by 2 trialist groups from 1986 to 1996.


METHODS
Multicenter trial groups in human immunodeficiency virus infection sponsored by the National Institutes of Health.


METHODS
A total of 109 efficacy trials (total enrollment, 43708 patients).


METHODS
Time from start of enrollment to completion of follow-up and time from completion of follow-up to peer-reviewed publication assessed with survival analysis.


RESULTS
The median time from start of enrollment to publication was 5.5 years and was substantially longer for negative trials than for results favoring an experimental arm (6.5 vs 4.3 years, respectively; P<.001; hazard ratio for time to publication for positive vs negative trials, 3.7; 95% confidence interval [CI], 1.8-7.7). This difference was mostly attributable to differences in the time from completion to publication (median, 3.0 vs 1.7 years for negative vs positive trials; P<.001). On average, trials with significant results favoring any arm completed follow-up slightly earlier than trials with nonsignificant results (median, 2.3 vs 2.5 years; P=.045), but long-protracted trials often had low event rates and failed to reach statistical significance, while trials that were terminated early had significant results. Positive trials were submitted for publication significantly more rapidly after completion than were negative trials (median, 1.0 vs 1.6 years; P=.001) and were published more rapidly after submission (median, 0.8 vs 1.1 years; P=.04).


CONCLUSIONS
Among randomized efficacy trials, there is a time lag in the publication of negative findings that occurs mostly after the completion of the trial follow-up.
Ioannidis
J P
JP
HIV Research Branch, Division of AIDS, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, Md 20892, USA. ji24m@nih.gov
D015982:Bias; D017321:Clinical Trials, Phase I as Topic; D017322:Clinical Trials, Phase II as Topic; D003627:Data Interpretation, Statistical; D015658:HIV Infections / Q000188:drug therapy; D006801:Humans; D016016:Proportional Hazards Models; D011643:Publishing; D016032:Randomized Controlled Trials as Topic; D016019:Survival Analysis; D013997:Time Factors