Bench-to-bedside review: avoiding pitfalls in critical care meta-analysis--funnel plots, risk estimates, types of heterogeneity, baseline risk and the ecologic fallacy.
Meta-analysis can be a powerful tool for demonstrating the applicability of a concept beyond the context of individual clinical trials and observational studies, including exploration of effects across different subgroups. Meta-analysis avoids Simpson's paradox, in which a consistent effect in constituent trials is reversed when results are simply pooled. Meta-analysis in critical care medicine is made more complicated, however, by the heterogeneous nature of critically ill patients and the contexts within which they are treated. Failure to properly adjust for this heterogeneity risks missing important subgroup effects in, for example, the interaction of treatment with varying levels of baseline risk. When subgroups are defined by characteristics that vary within constituent trials (such as age) rather than features constant within each trial (such as drug dose), there is the additional risk of incorrect conclusions due to the ecological fallacy. The present review explains these problems and the strategies by which they are overcome.
Reade
Michael C
MC
CRISMA Laboratory, Department of Critical Care Medicine, University of Pittsburgh, 3550 Terrace Street, Pittsburgh, PA 15261, USA. mreade@doctors.net.uk
Delaney
Anthony
A
Bailey
Michael J
MJ
Angus
Derek C
DC
D003422:Critical Care / Q000379:methods / Q000592:standards*; D006801:Humans; D015201:Meta-Analysis as Topic; D019095:Point-of-Care Systems / Q000592:standards*; D012107:Research Design / Q000592:standards*; D012307:Risk Factors