title: Assessment of performance and utility of mortality prediction models in a single Indian mixed tertiary intensive care unit.
abstract: OBJECTIVE
  To assess the performance and utility of two mortality prediction models viz. Acute Physiology and Chronic Health Evaluation II (APACHE II) and Simplified Acute Physiology Score II (SAPS II) in a single Indian mixed tertiary intensive care unit (ICU). Secondary objectives were bench-marking and setting a base line for research.
  
  
  METHODS
  In this observational cohort, data needed for calculation of both scores were prospectively collected for all consecutive admissions to 28-bedded ICU in the year 2011. After excluding readmissions, discharges within 24 h and age <18 years, the records of 1543 patients were analyzed using appropriate statistical methods.
  
  
  RESULTS
  Both models overpredicted mortality in this cohort [standardized mortality ratio (SMR) 0.88 ± 0.05 and 0.95 ± 0.06 using APACHE II and SAPS II respectively]. Patterns of predicted mortality had strong association with true mortality (R (2) = 0.98 for APACHE II and R (2) = 0.99 for SAPS II). Both models performed poorly in formal Hosmer-Lemeshow goodness-of-fit testing (Chi-square = 12.8 (P = 0.03) for APACHE II, Chi-square = 26.6 (P = 0.001) for SAPS II) but showed good discrimination (area under receiver operating characteristic curve 0.86 ± 0.013 SE (P < 0.001) and 0.83 ± 0.013 SE (P < 0.001) for APACHE II and SAPS II, respectively). There were wide variations in SMRs calculated for subgroups based on International Classification of Disease, 10(th) edition (standard deviation ± 0.27 for APACHE II and 0.30 for SAPS II).
  
  
  CONCLUSIONS
  Lack of fit of data to the models and wide variation in SMRs in subgroups put a limitation on utility of these models as tools for assessing quality of care and comparing performances of different units without customization. Considering comparable performance and simplicity of use, efforts should be made to adapt SAPS II.
authors.affiliation: Department of Critical Care Medicine, Grant Medical Foundation, Ruby Hall Clinic, Pune, Maharashtra, India.
authors.forename: Prachee M
authors.initials: PM
authors.lastname: Sathe
authors.affiliation: Department of Critical Care Medicine, Grant Medical Foundation, Ruby Hall Clinic, Pune, Maharashtra, India.
authors.forename: Sharda N
authors.initials: SN
authors.lastname: Bapat
keywords: Acute Physiology and Chronic Health Evaluation II; India; Simplified Acute Physiology Score II; mortality prediction; quality of care assessment; standardized mortality ratio
references.citation: Intensive Care Med. 1999 Sep;25(9):977-82
references.pmid: 10501755
references.citation: Intensive Care Med. 2004 Feb;30(2):248-253
references.pmid: 14727015
references.citation: Respirology. 2006 Mar;11(2):196-204
references.pmid: 16548906
references.citation: Indian J Med Sci. 2007 Apr;61(4):179-85
references.pmid: 17401254
references.citation: World J Emerg Surg. 2007 Dec 09;2:33
references.pmid: 18067678
references.citation: Crit Care Med. 1985 Oct;13(10):818-29
references.pmid: 3928249
references.citation: Crit Care Med. 1995 Aug;23(8):1327-35
references.pmid: 7634802
references.citation: Crit Care Med. 2000 Feb;28(2):426-32
references.pmid: 10708178
references.citation: JAMA. 1993 Dec 22-29;270(24):2957-63
references.pmid: 8254858
references.citation: Intensive Care Med. 2003 Feb;29(2):249-56
references.pmid: 12536271
references.citation: Intensive Care Med. 1997 Feb;23(2):177-86
references.pmid: 9069003
references.citation: Indian J Med Res. 2004 Jun;119(6):273-82
references.pmid: 15243165
references.citation: Minerva Anestesiol. 2012 Feb;78(2):194-200
references.pmid: 22095102
references.citation: J Med Assoc Thai. 2007 Apr;90(4):643-52
references.pmid: 17487117
references.citation: Am J Surg. 2007 Oct;194(4):549-52
references.pmid: 17826077
references.citation: Crit Care. 2002 Apr;6(2):166-74
references.pmid: 11983044
references.citation: Minerva Anestesiol. 2012 Feb;78(2):149-80
references.pmid: 22293921
references.citation: J Forensic Leg Med. 2009 Jul;16(5):239-47
references.pmid: 19481704