title: What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary.
abstract: Overviews of reviews (overviews) compile data from multiple systematic reviews to provide a single synthesis of relevant evidence for decision-making. Despite their increasing popularity, there is limited methodological guidance available for researchers wishing to conduct overviews. The objective of this scoping review is to identify and collate all published and unpublished documents containing guidance for conducting overviews examining the efficacy, effectiveness, and/or safety of healthcare interventions. Our aims were to provide a map of existing guidance documents; identify similarities, differences, and gaps in the guidance contained within these documents; and identify common challenges involved in conducting overviews.
  
  
  
  We conducted an iterative and extensive search to ensure breadth and comprehensiveness of coverage. The search involved reference tracking, database and web searches (MEDLINE, EMBASE, DARE, Scopus, Cochrane Methods Studies Database, Google Scholar), handsearching of websites and conference proceedings, and contacting overview producers. Relevant guidance statements and challenges encountered were extracted, edited, grouped, abstracted, and presented using a qualitative metasummary approach.
  
  
  
  We identified 52 guidance documents produced by 19 research groups. Relatively consistent guidance was available for the first stages of the overview process (deciding when and why to conduct an overview, specifying the scope, and searching for and including systematic reviews). In contrast, there was limited or conflicting guidance for the latter stages of the overview process (quality assessment of systematic reviews and their primary studies, collecting and analyzing data, and assessing quality of evidence), and many of the challenges identified were also related to these stages. An additional, overarching challenge identified was that overviews are limited by the methods, reporting, and coverage of their included systematic reviews.
  
  
  
  This compilation of methodological guidance for conducting overviews of healthcare interventions will facilitate the production of future overviews and can help authors address key challenges they are likely to encounter. The results of this project have been used to identify areas where future methodological research is required to generate empirical evidence for overview methods. Additionally, these results have been used to update the chapter on overviews in the next edition of the Cochrane Handbook for Systematic Reviews of Interventions.
authors.affiliation: Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, Edmonton, AB, Canada.
authors.forename: Michelle
authors.initials: M
authors.lastname: Pollock
authors.affiliation: Clinical Pharmacology Unit, Instituto de Medicina Molecular, University of Lisbon, Lisbon, Portugal.|Department of Pediatrics, Santa Maria Hospital, Lisbon, Portugal.
authors.forename: Ricardo M
authors.initials: RM
authors.lastname: Fernandes
authors.affiliation: Department of Family Medicine, SUNY Upstate Medical University, Syracuse, NY, USA.
authors.forename: Lorne A
authors.initials: LA
authors.lastname: Becker
authors.affiliation: Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, Edmonton, AB, Canada.
authors.forename: Robin
authors.initials: R
authors.lastname: Featherstone
authors.affiliation: Alberta Research Centre for Health Evidence, Department of Pediatrics, University of Alberta, Edmonton, AB, Canada. hartling@ualberta.ca.
authors.forename: Lisa
authors.initials: L
authors.lastname: Hartling
mesh_terms: D019317:Evidence-Based Medicine; D006801:Humans; D011642:Publications; D012107:Research Design; D012108:Research Personnel; D012196:Review Literature as Topic
keywords: Evidence synthesis; Evidence-based medicine; Evidence-based practice; Knowledge synthesis; Metasummary; Overview of reviews; Review methods; Scoping review; Systematic reviews; Umbrella review