title: A comparison of two search methods for determining the scope of systematic reviews and health technology assessments.
abstract: OBJECTIVE
  This study aims to compare two different search methods for determining the scope of a requested systematic review or health technology assessment. The first method (called the Direct Search Method) included performing direct searches in the Cochrane Database of Systematic Reviews (CDSR), Database of Abstracts of Reviews of Effects (DARE) and the Health Technology Assessments (HTA). Using the comparison method (called the NHS Search Engine) we performed searches by means of the search engine of the British National Health Service, NHS Evidence.
  
  
  METHODS
  We used an adapted cross-over design with a random allocation of fifty-five requests for systematic reviews. The main analyses were based on repeated measurements adjusted for the order in which the searches were conducted.
  
  
  RESULTS
  The Direct Search Method generated on average fewer hits (48 percent [95 percent confidence interval {CI} 6 percent to 72 percent], had a higher precision (0.22 [95 percent CI, 0.13 to 0.30]) and more unique hits than when searching by means of the NHS Search Engine (50 percent [95 percent CI, 7 percent to 110 percent]). On the other hand, the Direct Search Method took longer (14.58 minutes [95 percent CI, 7.20 to 21.97]) and was perceived as somewhat less user-friendly than the NHS Search Engine (-0.60 [95 percent CI, -1.11 to -0.09]).
  
  
  CONCLUSIONS
  Although the Direct Search Method had some drawbacks such as being more time-consuming and less user-friendly, it generated more unique hits than the NHS Search Engine, retrieved on average fewer references and fewer irrelevant results.
authors.affiliation: Norwegian Knowledge Centre for the Health Services. louise.forsetlund@kunnskapssenteret.no
authors.forename: Louise
authors.initials: L
authors.lastname: Forsetlund
authors.forename: Ingvild
authors.initials: I
authors.lastname: Kirkehei
authors.forename: Ingrid
authors.initials: I
authors.lastname: Harboe
authors.forename: Jan
authors.initials: J
authors.lastname: Odgaard-Jensen
mesh_terms: D000465:Algorithms; D016001:Confidence Intervals; D018592:Cross-Over Studies; D016206:Databases, Bibliographic; D003657:Decision Making; D004493:Education; D006801:Humans; D033181:Information Dissemination / Q000379:methods*; D016012:Poisson Distribution; D011897:Random Allocation; D057386:Search Engine; D057566:Self Report; D013222:State Medicine