Evidence-based retrieval in evidence-based medicine.
OBJECTIVE
Clinical decisions based on a meta-analysis that is based on an ineffective retrieval strategy may have serious negative consequences for patients. The study objective was to investigate the extent to which meta-analyses report proof of their retrieval strategies' effectiveness.


METHODS
The authors examined a random sample (n = 100) of articles in the 1996 to 2002 full-text subset of Ovid MEDLINE indexed as "meta-analysis." We classified the articles in three ways: the article (A) reported both a retrieval strategy in sufficient detail (such that it could be repeated) and with evidence of the strategy's effectiveness, (B) reported a retrieval strategy in sufficient detail but not with evidence of the strategy's effectiveness, or (C) neither reported a strategy in detail nor evidence of the strategy's effectiveness. Articles classified as (A) were further classified according to the level of evidence reported.


RESULTS
Of the eighty-nine articles in our final analysis, six (6.7%) were classified as category (A), fifty-seven (64%) as (B), and twenty-six (29%) as (C). Articles in category (A) reported a previously validated search, a published strategy, or strategy based on expert opinion.


CONCLUSIONS
Peer-review standards must be developed that require authors of meta-analyses to report evidence for the effectiveness of their retrieval strategies.
Patrick
Timothy B
TB
Department of Health Management and Informatics, School of Medicine University of Missouri, Columbia, Missouri, USA. PatrickT@health.missouri.edu
Demiris
George
G
Folk
Lillian C
LC
Moxley
David E
DE
Mitchell
Joyce A
JA
Tao
Donghua
D
D019317:Evidence-Based Medicine / Q000592:standards*; D006801:Humans; D016247:Information Storage and Retrieval / Q000592:standards*; D016245:Librarians; D007999:Library Services / Q000592:standards*; D015201:Meta-Analysis as Topic; D010380:Peer Review / Q000592:standards*; D017594:Publication Bias; D014481:United States