Strengths and limitations of meta-analysis: larger studies may be more reliable.
Meta-analysis of randomized controlled trials combines information from independent studies that address a similar question to provide more reliable estimates of treatment effects. At the present time, the methodology and usefulness of meta-analysis is under scrutiny. In the first part of this paper, we summarize the limitations of meta-analysis and make suggestions for improvements. In the second part, we illustrate strengths and limitations using examples of meta-analyses and subsequent large trials that address the same question. We develop the hypothesis that the size of the meta-analysis may be a useful measure of reliability. Small meta-analyses (i.e., those with less than 200 outcome events) may only be useful for summarizing the available information and generating hypotheses for future research. The results of small meta-analyses should be regarded with caution, even if the p value shows extreme statistical significance. Larger meta-analyses (i.e., those with several hundred events) are likely to be more reliable and may be clinically useful. Well-conducted meta-analyses of large trials using individual patient data may provide the best estimates of treatment effects in the cohort overall and in clinically important subgroups.
Flather
M D
MD
Preventive Cardiology and Therapeutics Programme, Hamilton Civic Hospitals' Research Centre, Ontario, Canada.
Farkouh
M E
ME
Pogue
J M
JM
Yusuf
S
S
D015982:Bias; D006801:Humans; D008274:Magnesium / Q000627:therapeutic use; D015201:Meta-Analysis as Topic; D008722:Methods; D009203:Myocardial Infarction / Q000188:drug therapy; D011786:Quality Control; D016032:Randomized Controlled Trials as Topic; D015912:Thrombolytic Therapy
D008274:Magnesium