title: An exploration of synthesis methods in public health evaluations of interventions concludes that the use of modern statistical methods would be beneficial.
abstract: OBJECTIVE
  To review the methods currently used to synthesize evidence in public health evaluations and demonstrate the availability of more sophisticated approaches.
  
  
  METHODS
  A systematic review of National Institute for Health and Care Excellence (NICE) public health appraisals published between 2006 and 2012 was performed to assess the methods used for the synthesis of effectiveness evidence. The ability of new developments in evidence synthesis methodology to address the challenges and opportunities present in a public health context is demonstrated.
  
  
  RESULTS
  Nine (23%) of the 39 NICE appraisals included in the review performed pairwise meta-analyses as part of the effectiveness review with one of these also including a network meta-analysis. Of the remainder, 29 (74.4%) presented narrative summaries of the evidence only, and 1 (2.6%) appraisal did not present any review of effectiveness and/or cost-effectiveness evidence. Heterogeneity of outcomes, methods, and interventions were the main reasons given for not pooling the data. Exploration of quantitative synthesis methods shows that pairwise meta-analyses can be extended to incorporate individual participant data (when it is available), extend the number of interventions being compared using a network meta-analysis, and adjust for both subject- and summary-level covariates. All these can contribute to ensuring the analysis answers directly the policy-relevant questions.
  
  
  CONCLUSIONS
  More sophisticated methods in evidence synthesis should be considered to make evaluations in public health more useful for decision makers.
authors.affiliation: Department of Health Sciences, University of Leicester, University Road, Leicester LE1 7RH, UK.
authors.forename: Felix
authors.initials: F
authors.lastname: Achana
authors.affiliation: Department of Health Sciences, University of Leicester, University Road, Leicester LE1 7RH, UK.
authors.forename: Stephanie
authors.initials: S
authors.lastname: Hubbard
authors.affiliation: Department of Health Sciences, University of Leicester, University Road, Leicester LE1 7RH, UK.
authors.forename: Alex
authors.initials: A
authors.lastname: Sutton
authors.affiliation: Division of Primary Care, Community Health Sciences, Faculty of Medicine & Health Sciences, University of Nottingham, Nottingham, NG7 2RD, UK.
authors.forename: Denise
authors.initials: D
authors.lastname: Kendrick
authors.affiliation: Department of Health Sciences, University of Leicester, University Road, Leicester LE1 7RH, UK. Electronic address: njc21@le.ac.uk.
authors.forename: Nicola
authors.initials: N
authors.lastname: Cooper
mesh_terms: D003627:Data Interpretation, Statistical; D003657:Decision Making; D005069:Evaluation Studies as Topic; D019317:Evidence-Based Medicine / Q000379:methods / Q000592:standards; D006801:Humans; D015201:Meta-Analysis as Topic; D011634:Public Health / Q000379:methods* / Q000592:standards; D015980:Public Health Practice
keywords: Decision making; Meta-analysis; Network meta-analysis; Public health evaluation; Systematic review