title: Vocational rehabilitation program evaluation: comparison group challenges and the role of unmeasured return-to-work expectations.
abstract: OBJECTIVE
  Despite the importance and cost of workers' compensation (WC)-based vocational rehabilitation (VR) programs, outcome evaluations are rare, in part due to the scarcity of suitable comparison groups. The aims of this study were to assess (1) the adequacy of a commonly recommended internal comparison group, i.e., workers who were eligible for but did not receive services, and (2) return-to-work (RTW) expectations as a potential source of bias.
  
  
  METHODS
  In this prospective cohort study, we used WC claims data and worker-reported RTW expectations to compare workers who received vocational retraining services to eligible workers who did not receive such services. Workers were surveyed after retraining eligibility determination, prior to the initiation of retraining activities. VR progress and RTW wage outcomes were followed for 3 years. The magnitude of confounding contributed by RTW expectations and other covariates was quantified.
  
  
  RESULTS
  Workers who were somewhat or very certain they would RTW had significantly better outcomes. RTW expectations played a strong confounding role, reducing the retraining plan effect estimate by about 23 %, while education and physical capacity each changed the effect estimate by <5 %.
  
  
  CONCLUSIONS
  RTW expectations predicted long-term RTW outcomes and can play a strong confounding role if unmeasured. We found that the internal comparison group approach, commonly recommended for VR program evaluation, is inappropriate for WC-based VR evaluations. Ultimately, there is no simple solution to the challenge of identifying a comparison group; however, measurement of RTW expectations, an easily-measured multi-dimensional construct, may be a useful addition to the VR evaluation toolbox.
authors.affiliation: Department of Health Services, School of Public Health, University of Washington, Box 354809, Seattle, WA, 98195, USA, jeannes@uw.edu.
authors.forename: Jeanne M
authors.initials: JM
authors.lastname: Sears
authors.forename: Lisann R
authors.initials: LR
authors.lastname: Rolle
authors.forename: Beryl A
authors.initials: BA
authors.lastname: Schulman
authors.forename: Thomas M
authors.initials: TM
authors.lastname: Wickizer
mesh_terms: D000328:Adult; D000368:Aged; D015986:Confounding Factors, Epidemiologic; D004522:Educational Status; D004651:Employment / Q000191:economics; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D017063:Outcome Assessment, Health Care; D015397:Program Evaluation / Q000379:methods*; D011446:Prospective Studies; D012050:Rehabilitation, Vocational / Q000523:psychology*; D062707:Return to Work / Q000523:psychology*; D012456:Salaries and Fringe Benefits; D057566:Self Report; D014938:Work Capacity Evaluation; D014942:Workers' Compensation; D055815:Young Adult