Few systematic reviews exist documenting the extent of bias: a systematic review.
OBJECTIVE
To summarize the evidence concerning bias and confounding in conducting systematic reviews (SRs).


METHODS
Literature was identified through searching the Cochrane Library, MEDLINE, PsycINFO until November 2006, and the authors' files. Studies were included if they were SRs of bias that can occur while conducting a SR. Risk of bias in the SRs was appraised using the Oxman and Guyatt index.


RESULTS
Ten SRs were included. All examined biases related to searching for evidence (e.g., publication bias). One also reported bias associated with obtaining data from included studies (e.g., outcome reporting bias). To minimize bias, data suggest including unpublished material, hand searching for additional material, searching multiple databases, assessing for publication bias, and periodically updating SRs. No SRs were found examining biases related to choosing studies for inclusion or combining studies.


CONCLUSIONS
There is little evidence from SRs to support commonly practiced methods for conducting SRs. No SRs summarized studies with prospective designs and most had moderate or minimal risk of bias. Future research should examine bias that can occur during the selection of studies for inclusion and the synthesis of studies, as well as systematically review the existing empirical evidence.
Tricco
Andrea C
AC
Chalmers Research Group, Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Road, Ottawa, Ontario K1N 6N5, Canada.
Tetzlaff
Jennifer
J
Sampson
Margaret
M
Fergusson
Dean
D
Cogo
Elise
E
Horsley
Tanya
T
Moher
David
D
D015982:Bias; D015986:Confounding Factors, Epidemiologic; D019317:Evidence-Based Medicine; D006801:Humans; D017594:Publication Bias; D012107:Research Design; D012196:Review Literature as Topic; D009626:Terminology as Topic