title: Reporting methodological search filter performance comparisons: a literature review.
abstract: BACKGROUND
  Methodological search filters are tools for retrieving database records reporting studies which use a specific research method. Choosing a filter is likely to be based on filter performance data. This review examines which measures are reported, and the way that filter performance is presented, in filter comparisons.
  
  
  METHODS
  Studies were identified from the current content and pending update (2010) of a filter website. Eligible studies compared two or more methodological search filters designed to identify randomised controlled trials, diagnostic test accuracy studies, systematic reviews or economic evaluations.
  
  
  RESULTS
  Eighteen studies met the inclusion criteria. The number of filters compared in a single study ranged from 2 to 38. The most commonly reported measures were sensitivity/recall and precision. All studies displayed results in tables and gave results as percentages or proportions. Two studies supplemented results tables with graphical displays of data: a bar graph of the proportion of retrieved and missed gold standard references per filter; a forest plot of the overall sensitivity and specificity of each filter.
  
  
  CONCLUSIONS
  Sensitivity/recall and precision are the most frequently reported performance measures. This review highlights the potential for presenting results in novel and innovative ways to aid filter selection.
authors.affiliation: Healthcare Improvement Scotland, Glasgow, UK.
authors.forename: Jennifer
authors.initials: J
authors.lastname: Harbour
authors.forename: Cynthia
authors.initials: C
authors.lastname: Fraser
authors.forename: Carol
authors.initials: C
authors.lastname: Lefebvre
authors.forename: Julie
authors.initials: J
authors.lastname: Glanville
authors.forename: Sophie
authors.initials: S
authors.lastname: Beale
authors.forename: Charles
authors.initials: C
authors.lastname: Boachie
authors.forename: Steven
authors.initials: S
authors.lastname: Duffy
authors.forename: Rachael
authors.initials: R
authors.lastname: McCool
authors.forename: Lynne
authors.initials: L
authors.lastname: Smith
mesh_terms: D000068598:Data Accuracy; D003628:Database Management Systems / Q000592:standards*; D005069:Evaluation Studies as Topic; D006801:Humans; D057386:Search Engine / Q000379:methods / Q000592:standards*
keywords: bibliographic databases; information storage and retrieval; methodological filters; precision; recall; review, literature