Need for quality improvement in renal systematic reviews.
OBJECTIVE
Systematic reviews of clinical studies aim to compile best available evidence for various diagnosis and treatment options. This study assessed the methodologic quality of all systematic reviews relevant to the practice of nephrology published in 2005.


METHODS
We searched electronic databases (Medline, Embase, American College of Physicians Journal Club, Cochrane) and hand searched Cochrane renal group records. Clinical practice guidelines, case reports, narrative reviews, and pooled individual patient data meta-analyses were excluded. Methodologic quality was measured using a validated questionnaire (Overview Quality Assessment Questionnaire). For reviews of randomized trials, we also evaluated adherence to recommended reporting guidelines (Quality of Reporting of Meta-Analyses).


RESULTS
Ninety renal systematic reviews were published in year 2005, 60 of which focused on therapy. Many systematic reviews (54%) had major methodologic flaws. The most common review flaws were failure to assess the methodologic quality of included primary studies and failure to minimize bias in study inclusion. Only 2% of reviews of randomized trials fully adhered to reporting guidelines. A minority of journals (four of 48) endorsed adherence to consensus guidelines for review reporting, and these journals published systematic reviews of higher methodologic quality (P < 0.001).


CONCLUSIONS
The majority of systematic reviews had major methodologic flaws. The majority of journals do not endorse consensus guidelines for review reporting in their instructions to authors; however, journals that recommended such adherence published systemic reviews of higher methodologic quality.
Mrkobrada
Marko
M
Division of Nephrology, University of Western Ontario, London, Ontario, Canada.
Thiessen-Philbrook
Heather
H
Haynes
R Brian
RB
Iansavichus
Arthur V
AV
Rehman
Faisal
F
Garg
Amit X
AX
D019985:Benchmarking; D002986:Clinical Trials as Topic; D035081:Editorial Policies; D019317:Evidence-Based Medicine; D019983:Guideline Adherence; D017408:Guidelines as Topic; D006801:Humans; D009398:Nephrology / Q000592:standards*; D010506:Periodicals as Topic / Q000592:standards*; D011786:Quality Control; D012196:Review Literature as Topic