title: Using administrative data for mortality risk adjustment in pediatric congenital cardiac surgery.
abstract: OBJECTIVE
  To evaluate the performance of risk-adjustment models from the University HealthSystem Consortium and the Agency for Healthcare Research Quality on an administrative dataset for children undergoing congenital cardiac surgery.
  
  
  METHODS
  Retrospective cross-sectional cohort analysis.
  
  
  METHODS
  Multi-institutional database of administrative data provided by the University HealthSystem Consortium.
  
  
  METHODS
  Children whose discharge diagnosis had an associated cardiac surgical procedure.
  
  
  METHODS
  None.
  
  
  RESULTS
  The performance of two risk-adjustment modeling schemata was measured in terms of discrimination and calibration, and receiver operating characteristic curves were compared. Model calibration was assessed using the Hosmer-Lemeshow goodness-of-fit test. A total of 19,436 patients were included in the analysis with 816 deaths and an unadjusted overall mortality rate of 4.2%. The University HealthSystem Consortium models applied to the entire population resulted in an area under the curve = 0.73, and by comparison, the Agency for Healthcare Research Quality risk-adjustment model revealed area under the curve = 0.86. The risk-adjustment model of the University HealthSystem Consortium subgroup of Circulatory System Major Diagnostic Category 5 showed better performance with area under the curve = 0.81. Calibration using the Hosmer-Lemeshow test failed to show good agreement between the predicted and actual outcomes across the University HealthSystem Consortium mortality risk groups with an overall standardized mortality ratio of 1.2 (95% CI, 1.1-1.3; p < 0.0001) and poor predictive ability for the highest risk group, with a nearly 1.5-fold overprediction of death. The Agency for Healthcare Research Quality model shared similar calibration results with an overall standardized mortality ratio of 1.6 (95% CI, 1.5-1.7; p < 0.0001) and a nearly two-fold underprediction of death in the highest risk group.
  
  
  CONCLUSIONS
  Administrative data can be used to create risk-adjustment models in the congenital cardiac surgery population. Risk-adjustment models generated from administrative data may represent an attractive addition to clinically derived models in pediatric congenital cardiac surgery patients and should be considered for use either alone or in combination with clinical data in future analyses where mortality is a measure of performance and quality.
authors.affiliation: Department of Pediatrics, Rush University Medical Center, Chicago, IL, USA. Jason_Kane@rush.edu
authors.forename: Jason M
authors.initials: JM
authors.lastname: Kane
authors.forename: John
authors.initials: J
authors.lastname: Scalcucci
authors.forename: Samuel F
authors.initials: SF
authors.lastname: Hohmann
authors.forename: Tricia
authors.initials: T
authors.lastname: Johnson
authors.forename: Raj
authors.initials: R
authors.lastname: Behal
mesh_terms: D006348:Cardiac Surgical Procedures / Q000401:mortality*; D002648:Child; D002675:Child, Preschool; D015331:Cohort Studies; D003625:Data Collection / Q000379:methods*; D005260:Female; D006330:Heart Defects, Congenital / Q000401:mortality / Q000601:surgery*; D006801:Humans; D007223:Infant; D008297:Male; D015233:Models, Statistical; D011237:Predictive Value of Tests; D012372:ROC Curve; D012189:Retrospective Studies; D020379:Risk Adjustment / Q000379:methods*