High prevalence but low impact of data extraction and reporting errors were found in Cochrane systematic reviews.
OBJECTIVE
Extracting data from primary articles is an essential component in conducting systematic reviews. Incorrect data extraction can lead to false conclusions. The objective of this study was to retrospectively repeat the data extraction in all systematic reviews conducted by the Cochrane Cystic Fibrosis and Genetic Disorders Group.


METHODS
For each review, data extraction was conducted, by an experienced statistician, for the same publications used by the reviewers. Results were compared with those obtained by the reviewers.


RESULTS
Errors were found in 20 of 34 reviews, including incorrect calculations made when converting data in primary articles into data required for the review (2 reviews) and misinterpretation of data that were reported in the primary article (7 reviews). All data-handling errors led to changes in the summary results, but none of these affected the review conclusions.


CONCLUSIONS
Important errors were identified in a high proportion of reviews. A variety of problems relating to the reporting of results within a review were identified, but these did not lead to substantial changes in any conclusion.
Jones
Ashley P
AP
Alder Hey Children's Hospital, The University of Liverpool, Institute of Child Health, Eaton Road, Liverpool, L12 2AP, England.
Remmington
Tracey
T
Williamson
Paula R
PR
Ashby
Deborah
D
Smyth
Rosalind L
RL
D003550:Cystic Fibrosis / Q000453:epidemiology; D003625:Data Collection / Q000379:methods*; D019317:Evidence-Based Medicine / Q000592:standards; D030342:Genetic Diseases, Inborn / Q000453:epidemiology; D006801:Humans; D015201:Meta-Analysis as Topic; D010380:Peer Review; D012189:Retrospective Studies; D012196:Review Literature as Topic