title: Panning for the gold in health research: incorporating studies' methodological quality in meta-analysis.
abstract: BACKGROUND
  Systematic reviews now routinely assess methodological quality to gauge the validity of the included studies and of the synthesis as a whole. Although trends from higher quality studies should be clearer, it is uncertain how often meta-analyses incorporate methodological quality in models of study results either as predictors, or, more interestingly, in interactions with theoretical moderators.
  
  
  OBJECTIVE
  We survey 200 meta-analyses in three health promotion domains to examine when and how meta-analyses incorporate methodological quality.
  
  
  RESULTS
  Although methodological quality assessments commonly appear in contemporary meta-analyses (usually as scales), they are rarely incorporated in analyses, and still more rarely analysed in interaction with theoretical determinants of the success of health promotions. The few meta-analyses (2.5%) that did include such an interaction analysis showed that moderator results remained significant in higher quality studies or were present only among higher quality studies. We describe how to model quality interactively with theoretically derived moderators and discuss strengths and weaknesses of this approach and in relation to current meta-analytic practice.
  
  
  CONCLUSIONS
  In large literatures exhibiting heterogeneous effects, meta-analyses can incorporate methodological quality and generate conclusions that enable greater confidence not only about the substantive phenomenon but also about the role that methodological quality itself plays.
authors.affiliation: a Department of Psychology, Center for Health, Intervention, & Prevention , University of Connecticut , Storrs , CT , USA.
authors.forename: Blair T
authors.initials: BT
authors.lastname: Johnson
authors.forename: Robert E
authors.initials: RE
authors.lastname: Low
authors.forename: Hayley V
authors.initials: HV
authors.lastname: MacDonald
mesh_terms: D035843:Biomedical Research / Q000379:methods*; D006293:Health Promotion; D006801:Humans; D015201:Meta-Analysis as Topic; D008962:Models, Theoretical; D012107:Research Design
keywords: Cochrane Collaboration; data quality; health promotion; meta-analysis; meta-regression; methodological studies; scoring methods