title: Does the choice of risk-adjustment model influence the outcome of surgeon-specific mortality analysis? A retrospective analysis of 14,637 patients under 31 surgeons.
abstract: OBJECTIVE
  To compare implications of using the logistic EuroSCORE and a locally derived model when analysing individual surgeon mortality outcomes.
  
  
  METHODS
  Retrospective analysis of prospectively collected data.
  
  
  METHODS
  All NHS hospitals undertaking adult cardiac surgery in northwest England.
  
  
  METHODS
  14,637 consecutive patients, April 2002 to March 2005.
  
  
  METHODS
  We have compared the predictive ability of the logistic EuroSCORE (uncalibrated), the logistic EuroSCORE calibrated for contemporary performance and a locally derived logistic regression model. We have used each to create risk-adjusted individual surgeon mortality funnel plots to demonstrate high mortality outcomes.
  
  
  RESULTS
  There were 458 (3.1%) deaths. The expected mortality and receiver operating characteristic (ROC) curve values were: uncalibrated EuroSCORE -5.8% and 0.80, calibrated EuroSCORE -3.1% and 0.80, locally derived model -3.1% and 0.82. The uncalibrated EuroSCORE plot showed one surgeon to have mortality above the northwest average, and no surgeon above the 95% control limit (CL). The calibrated EuroSCORE plot and the local model showed little change in surgeon ranking, but significant differences in identifying high mortality outcomes. Two of three surgeons above the 95% CL using the calibrated EuroSCORE revert to acceptable outcomes when the local model is applied but the finding is critically dependent on the calibration coefficient.
  
  
  CONCLUSIONS
  The uncalibrated EuroSCORE significantly overpredicted mortality and is not recommended. Instead, the EuroSCORE should be calibrated for contemporary performance. The differences demonstrated in defining high mortality outcomes when using a model built for purpose suggests that the choice of risk model is important when analysing surgeon mortality outcomes.
authors.affiliation: University Hospital of South Manchester NHS Foundation Trust, Southmoor Road, Manchester M23 9LT, UK.
authors.forename: S W
authors.initials: SW
authors.lastname: Grant
authors.forename: A D
authors.initials: AD
authors.lastname: Grayson
authors.forename: M
authors.initials: M
authors.lastname: Jackson
authors.forename: J
authors.initials: J
authors.lastname: Au
authors.forename: B M
authors.initials: BM
authors.lastname: Fabri
authors.forename: G
authors.initials: G
authors.lastname: Grotte
authors.forename: M
authors.initials: M
authors.lastname: Jones
authors.forename: B
authors.initials: B
authors.lastname: Bridgewater
mesh_terms: D006348:Cardiac Surgical Procedures / Q000401:mortality*; D001026:Coronary Artery Bypass / Q000401:mortality; D004739:England / Q000453:epidemiology; D004812:Epidemiologic Methods; D005260:Female; D013502:General Surgery / Q000706:statistics & numerical data*; D019918:Heart Valve Prosthesis Implantation / Q000401:mortality; D006801:Humans; D008297:Male; D020379:Risk Adjustment / Q000379:methods*; D016896:Treatment Outcome