title: A large-scale analysis of the reasons given for excluding articles that are retrieved by literature search during systematic review.
abstract: OBJECTIVE
  A literature search to identify relevant studies is one of the first steps in performing a systematic review (SR) in support of evidence-based medicine. To maximize efficiency, the search must find practically all relevant studies and retrieve few that are irrelevant; however, this level of precision is seldom attained. Therefore, many articles must be manually examined for relevance. To better understand the limitations of current search tools as applied to SR, we characterized the most common reasons that papers retrieved by SR searches were excluded from the review.
  
  
  METHODS
  The textual reasons given for retrieved but excluded articles were extracted from 6,743 SRs performed by 54 Cochrane Collaboration review groups. The frequencies of different exclusion reasons were analyzed, and we developed a taxonomy summarizing these reasons.
  
  
  RESULTS
  Almost 65% of articles were excluded because the means of comparison were inappropriate. Of these, about 72% were due to the randomized controlled trial (RCT) design being required but not employed by the excluded study. Mismatching interventions and outcomes and incorrect population characteristics were also common reasons for exclusion.
  
  
  CONCLUSIONS
  Currently available search methods do not adequately address the most common exclusion reasons for systematic review, even those based primarily on study design.
authors.affiliation: Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, OR, USA.
authors.forename: Tracy
authors.initials: T
authors.lastname: Edinger
authors.affiliation: Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, OR, USA.
authors.forename: Aaron M
authors.initials: AM
authors.lastname: Cohen
mesh_terms: D016206:Databases, Bibliographic; D016247:Information Storage and Retrieval; D012107:Research Design; D000078202:Systematic Reviews as Topic