title: The relationship between return on investment and quality of study methodology in workplace health promotion programs.
abstract: OBJECTIVE
  To determine the relationship between return on investment (ROI) and quality of study methodology in workplace health promotion programs.
  
  
  METHODS
  Data were obtained through a systematic literature search of National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE), Health Technology Database (HTA), Cost Effectiveness Analysis (CEA) Registry, EconLit, PubMed, Embase, Wiley, and Scopus.
  
  
  METHODS
  Included were articles written in English or German reporting cost(s) and benefit(s) and single or multicomponent health promotion programs on working adults. Return-to-work and workplace injury prevention studies were excluded.
  
  
  METHODS
  Methodological quality was graded using British Medical Journal Economic Evaluation Working Party checklist. Economic outcomes were presented as ROI.
  
  
  RESULTS
  ROI was calculated as ROI = (benefits - costs of program)/costs of program. Results were weighted by study size and combined using meta-analysis techniques. Sensitivity analysis was performed using two additional methodological quality checklists. The influences of quality score and important study characteristics on ROI were explored.
  
  
  RESULTS
  Fifty-one studies (61 intervention arms) published between 1984 and 2012 included 261,901 participants and 122,242 controls from nine industry types across 12 countries. Methodological quality scores were highly correlated between checklists (r = .84-.93). Methodological quality improved over time. Overall weighted ROI [mean ± standard deviation (confidence interval)] was 1.38 ± 1.97 (1.38-1.39), which indicated a 138% return on investment. When accounting for methodological quality, an inverse relationship to ROI was found. High-quality studies (n = 18) had a smaller mean ROI, 0.26 ± 1.74 (.23-.30), compared to moderate (n = 16) 0.90 ± 1.25 (.90-.91) and low-quality (n = 27) 2.32 ± 2.14 (2.30-2.33) studies. Randomized control trials (RCTs) (n = 12) exhibited negative ROI, -0.22 ± 2.41(-.27 to -.16). Financial returns become increasingly positive across quasi-experimental, nonexperimental, and modeled studies: 1.12 ± 2.16 (1.11-1.14), 1.61 ± 0.91 (1.56-1.65), and 2.05 ± 0.88 (2.04-2.06), respectively.
  
  
  CONCLUSIONS
  Overall, mean weighted ROI in workplace health promotion demonstrated a positive ROI. Higher methodological quality studies provided evidence of smaller financial returns. Methodological quality and study design are important determinants.
authors: Siyan
authors: S
authors: Baxter
authors: Kristy
authors: K
authors: Sanderson
authors: Alison J
authors: AJ
authors: Venn
authors: C Leigh
authors: CL
authors: Blizzard
authors: Andrew J
authors: AJ
authors: Palmer
mesh_terms: D003362:Cost-Benefit Analysis; D006293:Health Promotion; D006801:Humans; D016272:Occupational Health; D012107:Research Design; D017132:Workplace
keywords: Cost Benefit Analysis; Economic Evaluation; Health Promotion; Meta-analysis-Review; Occupational Health; Quality Appraisal; Return on Investment. Format: literature review; Research purpose: financial analysis/relationship testing; Study design: meta-analysis; Outcome measure: financial/economic; Workplace; alcohol; all locations; all races/ethnicities; dental; Strategy: health promotion programs; Target population age: adults; disease screening; employed; Target population circumstances: all education/income levels; health risk assessment (HRA); international; Health focus: smoking; mental health; nutrition; physical activity; return on investment (ROI); Setting: workplace; “flu” vaccination