Simpson's paradox and calculation of number needed to treat from meta-analysis.
BACKGROUND
Calculation of numbers needed to treat (NNT) is more complex from meta-analysis than from single trials. Treating the data as if it all came from one trial may lead to misleading results when the trial arms are imbalanced.


CONCLUSIONS
An example is shown from a published Cochrane review in which the benefit of nursing intervention for smoking cessation is shown by formal meta-analysis of the individual trial results. However if these patients were added together as if they all came from one trial the direction of the effect appears to be reversed (due to Simpson's paradox). Whilst NNT from meta-analysis can be calculated from pooled Risk Differences, this is unlikely to be a stable method unless the event rates in the control groups are very similar. Since in practice event rates vary considerably, the use a relative measure, such as Odds Ratio or Relative Risk is advocated. These can be applied to different levels of baseline risk to generate a risk specific NNT for the treatment.


CONCLUSIONS
The method used to calculate NNT from meta-analysis should be clearly stated, and adding the patients from separate trials as if they all came from one trial should be avoided.
Cates
Christopher J
CJ
Manor View Surgery, Bushey Health Centre, London Road, Bushey, Watford, UK. chriscates@email.msn.com
D015982:Bias; D002986:Clinical Trials as Topic / Q000451:nursing / Q000706:statistics & numerical data; D003627:Data Interpretation, Statistical; D006801:Humans; D015201:Meta-Analysis as Topic; D016017:Odds Ratio; D015203:Reproducibility of Results; D018401:Sample Size; D016540:Smoking Cessation / Q000706:statistics & numerical data; D013223:Statistics as Topic / Q000379:methods* / Q000592:standards*