title: Two methods provide similar signals for the need to update systematic reviews.
abstract: OBJECTIVE
  Apply and compare two methods that identify signals for the need to update systematic reviews, using three Evidence-based Practice Center reports on omega-3 fatty acids as test cases.
  
  
  METHODS
  We applied the RAND method, which uses domain (subject matter) expert guidance, and a modified Ottawa method, which uses quantitative and qualitative signals. For both methods, we conducted focused electronic literature searches of recent studies using the key terms from the original reports. We assessed the agreement between the methods and qualitatively assessed the merits of each system.
  
  
  RESULTS
  Agreement between the two methods was "substantial" or better (kappa>0.62) in three of the four systematic reviews. Overall agreement between the methods was "substantial" (kappa=0.64, 95% confidence interval [CI] 0.45-0.83).
  
  
  CONCLUSIONS
  The RAND and modified Ottawa methods appear to provide similar signals for the possible need to update systematic reviews in this pilot study. Future evaluation with a broader range of clinical topics and eventual comparisons between signals to update reports and the results of full evidence review updates will be needed. We propose a hybrid approach combining the best features of both methods, which should allow efficient review and assessment of the need to update.
authors.affiliation: Tufts Evidence-based Practice Center, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA 02111, USA. mchung1@tuftsmedicalcenter.org
authors.forename: Mei
authors.initials: M
authors.lastname: Chung
authors.forename: Sydne J
authors.initials: SJ
authors.lastname: Newberry
authors.forename: Mohammed T
authors.initials: MT
authors.lastname: Ansari
authors.forename: Winifred W
authors.initials: WW
authors.lastname: Yu
authors.forename: Helen
authors.initials: H
authors.lastname: Wu
authors.forename: Jounghee
authors.initials: J
authors.lastname: Lee
authors.forename: Marika
authors.initials: M
authors.lastname: Suttorp
authors.forename: James M
authors.initials: JM
authors.lastname: Gaylor
authors.forename: Aneesa
authors.initials: A
authors.lastname: Motala
authors.forename: David
authors.initials: D
authors.lastname: Moher
authors.forename: Ethan M
authors.initials: EM
authors.lastname: Balk
authors.forename: Paul G
authors.initials: PG
authors.lastname: Shekelle
mesh_terms: D016001:Confidence Intervals; D019317:Evidence-Based Medicine; D015525:Fatty Acids, Omega-3; D006801:Humans; D016247:Information Storage and Retrieval / Q000592:standards*; D010506:Periodicals as Topic / Q000592:standards*; D010865:Pilot Projects; D012196:Review Literature as Topic
chemical_list: D015525:Fatty Acids, Omega-3