title: Use of risk-adjusted change in health status to assess the performance of integrated service networks in the Veterans Health Administration.
abstract: OBJECTIVE
  Health outcome assessments have become an expectation of regulatory and accreditation agencies. We examined whether a clinically credible risk adjustment methodology for the outcome of change in health status can be developed for performance assessment of integrated service networks.
  
  
  METHODS
  Longitudinal study.
  
  
  METHODS
  Outpatient.
  
  
  METHODS
  Thirty-one thousand eight hundred and twenty-three patients from 22 Veterans Health Administration (VHA) integrated service networks were followed for 18 months.
  
  
  METHODS
  The physical (PCS) and mental (MCS) component scales from the Veterans Rand 36-items Health Survey (VR-36) and mortality. The outcomes were decline in PCS (decline in PCS scores greater than -6.5 points or death) and MCS (decline in MCS scores greater than -7.9 points).
  
  
  RESULTS
  Four thousand three hundred and twenty-eight (13.6%) patients showed a decline in PCS scores greater than -6.5 points, 4322 (13.5%) had a decline in MCS scores by more than -7.9 points, and 1737 died (5.5%). Multivariate logistic regression models were used to adjust for case-mix. The models performed reasonably well in cross-validated tests of discrimination (c-statistics = 0.72 and 0.68 for decline in PCS and MCS, respectively) and calibration. The resulting risk-adjusted rates of decline in PCS and MCS and ranks of the networks differed considerably from unadjusted ratings.
  
  
  CONCLUSIONS
  It is feasible to develop clinically credible risk adjustment models for the outcomes of decline in PCS and MCS. Without adequate controls for case-mix, we could not determine whether poor patient outcomes reflect poor performance, sicker patients, or other factors. This methodology can help to measure and report the performance of health care systems.
authors.affiliation: Center for Health Quality, Outcomes, and Economic Research, A Health Services Research and Development Field Program, VA Medical Center, Bedford, MA 01730, USA. selim.alfredo_j@boston.med.va.gov
authors.forename: Alfredo J
authors.initials: AJ
authors.lastname: Selim
authors.forename: Dan
authors.initials: D
authors.lastname: Berlowitz
authors.forename: Graeme
authors.initials: G
authors.lastname: Fincke
authors.forename: William
authors.initials: W
authors.lastname: Rogers
authors.forename: Shirley
authors.initials: S
authors.lastname: Qian
authors.forename: Austin
authors.initials: A
authors.lastname: Lee
authors.forename: Zhongxiao
authors.initials: Z
authors.lastname: Cong
authors.forename: Bernardo J
authors.initials: BJ
authors.lastname: Selim
authors.forename: Xinhua S
authors.initials: XS
authors.lastname: Ren
authors.forename: Amy K
authors.initials: AK
authors.lastname: Rosen
authors.forename: Lewis E
authors.initials: LE
authors.lastname: Kazis
mesh_terms: D000368:Aged; D019033:Delivery of Health Care, Integrated / Q000592:standards*; D003953:Diagnosis-Related Groups / Q000145:classification / Q000706:statistics & numerical data; D005260:Female; D006304:Health Status; D006306:Health Surveys; D006801:Humans; D008137:Longitudinal Studies; D008297:Male; D008875:Middle Aged; D009026:Mortality; D015999:Multivariate Analysis; D017063:Outcome Assessment, Health Care / Q000706:statistics & numerical data*; D015397:Program Evaluation; D011787:Quality of Health Care; D020379:Risk Adjustment; D014481:United States; D014493:United States Department of Veterans Affairs / Q000458:organization & administration*; D014728:Veterans / Q000706:statistics & numerical data*