title: Undue reliance on I(2) in assessing heterogeneity may mislead.
abstract: BACKGROUND
  The heterogeneity statistic I(2), interpreted as the percentage of variability due to heterogeneity between studies rather than sampling error, depends on precision, that is, the size of the studies included.
  
  
  METHODS
  Based on a real meta-analysis, we simulate artificially 'inflating' the sample size under the random effects model. For a given inflation factor M = 1, 2, 3,... and for each trial i, we create a M-inflated trial by drawing a treatment effect estimate from the random effects model, using s(i)(2)/M as within-trial sampling variance.
  
  
  RESULTS
  As precision increases, while estimates of the heterogeneity variance tau(2) remain unchanged on average, estimates of I(2) increase rapidly to nearly 100%. A similar phenomenon is apparent in a sample of 157 meta-analyses.
  
  
  CONCLUSIONS
  When deciding whether or not to pool treatment estimates in a meta-analysis, the yard-stick should be the clinical relevance of any heterogeneity present. tau(2), rather than I(2), is the appropriate measure for this purpose.
authors.affiliation: Institute of Medical Biometry and Medical Informatics, University Medical Center Freiburg, Germany. ruecker@imbi.uni-freiburg.de
authors.forename: Gerta
authors.initials: G
authors.lastname: Rücker
authors.forename: Guido
authors.initials: G
authors.lastname: Schwarzer
authors.forename: James R
authors.initials: JR
authors.lastname: Carpenter
authors.forename: Martin
authors.initials: M
authors.lastname: Schumacher
mesh_terms: D003627:Data Interpretation, Statistical; D006801:Humans; D015233:Models, Statistical; D016032:Randomized Controlled Trials as Topic / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D012107:Research Design / Q000706:statistics & numerical data*; D018401:Sample Size; D012680:Sensitivity and Specificity