title: Prospective comparison of search strategies for systematic reviews: an objective approach yielded higher sensitivity than a conceptual one.
abstract: In the development of search strategies for systematic reviews, "conceptual approaches" are generally recommended to identify appropriate search terms for those parts of the strategies for which no validated search filters exist. However, "objective approaches" based on search terms identified by text analysis are increasingly being applied.
  
  
  
  To prospectively compare an objective with a conceptual approach for the development of search strategies.
  
  
  
  Two different MEDLINE search strategies were developed in parallel for five systematic reviews covering a range of topics and study designs. The Institute for Quality and Efficiency in Health Care (IQWiG) applied an objective approach, and external experts applied a conceptual approach for the same research questions. For each systematic review, the citations retrieved were combined and the overall pool of citations screened to determine sensitivity and precision.
  
  
  
  The objective approach yielded a weighted mean sensitivity and precision of 97% and 5%. The corresponding values for the conceptual approach were 75% and 4%.
  
  
  
  Our findings indicate that the objective approach applied by IQWiG for search strategy development yields higher sensitivity than and similar precision to a conceptual approach. The main advantage of the objective approach is that it produces consistent results across searches.
authors.affiliation: Information Management Unit, Institute for Quality and Efficiency in Health Care (IQWiG), Im Mediapark 8, 50670 Cologne, Germany. Electronic address: elke.hausner@iqwig.de.
authors.forename: Elke
authors.initials: E
authors.lastname: Hausner
authors.affiliation: Department of Medical Biometry (IQWiG), Institute for Quality and Efficiency in Health Care, Im Mediapark 8, 50670 Cologne, Germany.
authors.forename: Charlotte
authors.initials: C
authors.lastname: Guddat
authors.affiliation: Information Management Unit, Institute for Quality and Efficiency in Health Care (IQWiG), Im Mediapark 8, 50670 Cologne, Germany.
authors.forename: Tatjana
authors.initials: T
authors.lastname: Hermanns
authors.affiliation: Information Management Unit, Institute for Quality and Efficiency in Health Care (IQWiG), Im Mediapark 8, 50670 Cologne, Germany.
authors.forename: Ulrike
authors.initials: U
authors.lastname: Lampert
authors.affiliation: Information Management Unit, Institute for Quality and Efficiency in Health Care (IQWiG), Im Mediapark 8, 50670 Cologne, Germany.
authors.forename: Siw
authors.initials: S
authors.lastname: Waffenschmidt
mesh_terms: D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods* / Q000706:statistics & numerical data; D016239:MEDLINE / Q000706:statistics & numerical data*; D011446:Prospective Studies; D015203:Reproducibility of Results; D012107:Research Design; D012196:Review Literature as Topic; D012680:Sensitivity and Specificity
keywords: Data mining; Information storage and retrieval; Medline; Prospective studies; Reproducibility of results; Sensitivity and specificity