title: Comparison of APACHE III, APACHE IV, SAPS 3, and MPM0III and influence of resuscitation status on model performance.
abstract: BACKGROUND
  There are few comparisons among the most recent versions of the major adult ICU prognostic systems (APACHE [Acute Physiology and Chronic Health Evaluation] IV, Simplified Acute Physiology Score [SAPS] 3, Mortality Probability Model [MPM]0III). Only MPM0III includes resuscitation status as a predictor.
  
  
  METHODS
  We assessed the discrimination, calibration, and overall performance of the models in 2,596 patients in three ICUs at our tertiary referral center in 2006. For APACHE and SAPS, the analyses were repeated with and without inclusion of resuscitation status as a predictor variable.
  
  
  RESULTS
  Of the 2,596 patients studied, 283 (10.9%) died before hospital discharge. The areas under the curve (95% CI) of the models for prediction of hospital mortality were 0.868 (0.854-0.880), 0.861 (0.847-0.874), 0.801 (0.785-0.816), and 0.721 (0.704-0.738) for APACHE III, APACHE IV, SAPS 3, and MPM0III, respectively. The Hosmer-Lemeshow statistics for the models were 33.7, 31.0, 36.6, and 21.8 for APACHE III, APACHE IV, SAPS 3, and MPM0III, respectively. Each of the Hosmer-Lemeshow statistics generated P values < .05, indicating poor calibration. Brier scores for the models were 0.0771, 0.0749, 0.0890, and 0.0932, respectively. There were no significant differences between the discriminative ability or the calibration of APACHE or SAPS with and without “do not resuscitate” status.
  
  
  CONCLUSIONS
  APACHE III and IV had similar discriminatory capability and both were better than SAPS 3, which was better than MPM0III. The calibrations of the models studied were poor. Overall, models with more predictor variables performed better than those with fewer. The addition of resuscitation status did not improve APACHE III or IV or SAPS 3 prediction.
authors.affiliation: Division of Critical Care, Department of Anesthesiology, Mayo Clinic, Rochester, MN; Multidisciplinary Epidemiology and Translational Research in Intensive Care (METRIC) group, Mayo Clinic, Rochester, MN. Electronic address: keegan.mark@mayo.edu.
authors.forename: Mark T
authors.initials: MT
authors.lastname: Keegan
authors.affiliation: Division of Pulmonary and Critical Care, Department of Medicine, Mayo Clinic, Rochester, MN; Multidisciplinary Epidemiology and Translational Research in Intensive Care (METRIC) group, Mayo Clinic, Rochester, MN.
authors.forename: Ognjen
authors.initials: O
authors.lastname: Gajic
authors.affiliation: Division of Pulmonary and Critical Care, Department of Medicine, Mayo Clinic, Rochester, MN; Multidisciplinary Epidemiology and Translational Research in Intensive Care (METRIC) group, Mayo Clinic, Rochester, MN.
authors.forename: Bekele
authors.initials: B
authors.lastname: Afessa
mesh_terms: D018806:APACHE; D016638:Critical Illness / Q000401:mortality / Q000628:therapy*; D017052:Hospital Mortality / Q000639:trends; D006801:Humans; D007362:Intensive Care Units / Q000706:statistics & numerical data*; D008910:Minnesota / Q000453:epidemiology; D008962:Models, Theoretical; D011379:Prognosis; D011446:Prospective Studies; D012151:Resuscitation / Q000706:statistics & numerical data*; D012720:Severity of Illness Index