Reproducibility of systematic literature reviews on food, nutrition, physical activity and endometrial cancer.
OBJECTIVE
Despite the increasing dependence on systematic reviews to summarise the literature and to issue public health recommendations, the formal assessment of the reliability of conclusions emerging from systematic reviews has received little attention. The main goal of the present study was to evaluate whether two independent centres, in two continents, draw similar conclusions regarding the association of food, nutrition and physical activity and endometrial cancer, when provided with the same general instructions and with similar resources.


METHODS
The assessment of reproducibility concentrated on four main areas: (1) paper search and selection; (2) assignment of study design; (3) inclusion of papers; and (4) individual studies selected for meta-analysis and the summary risk estimate obtained.


RESULTS
In total 310 relevant papers were identified, 166 (54 %) were included by both centres. Of the remaining 144 papers, 72 (50 %) were retrieved in the searches of one centre and not the other (54 in centre A, 18 in centre B) and 72 were retrieved in both searches but regarded as relevant by only one of the centres (52 in centre A, 20 in centre B). Of papers included by both centres, 80 % were allocated the same study design. Agreement for inclusion of cohort-type and case-control studies was about 63% compared with 50% or less for ecological and case series studies. The agreement for inclusion of 138 'key' papers was 87 %. Summary risk estimates from meta-analyses were similar.


CONCLUSIONS
Transparency of process and explicit detailed procedures are necessary parts of a systematic review and crucial for the reader to interpret its findings.
Institute of Human Nutrition, University of Southampton, Southampton, UK. r.thompson@nutrition.org.uk
Rl
R
Thompson
Ev
E
Bandera
Vj
V
Burley
Je
J
Cade
D
D
Forman
Jl
J
Freudenheim
D
D
Greenwood
Dr
D
Jacobs
Rv
R
Kalliecharan
Lh
L
Kushi
Ml
M
McCullough
Lm
L
Miles
Df
D
Moore
Ja
J
Moreton
T
T
Rastogi
Mj
M
Wiseman
D016889:Endometrial Neoplasms / Q000453:epidemiology*; D015444:Exercise / Q000502:physiology*; D005260:Female; D006801:Humans; D015201:Meta-Analysis as Topic; D009747:Nutritional Physiological Phenomena / Q000502:physiology*; D015203:Reproducibility of Results; D012107:Research Design; D012196:Review Literature as Topic; D012680:Sensitivity and Specificity