Subjective versus statistical model assessment of mortality risk in open heart surgical procedures.
BACKGROUND
The aim of this study was to compare the predictive accuracy for open heart surgical mortality between a statistical model based on collection of clinical data and surgeons' subjective risk assessment.


METHODS
Predictive discrimination of both risk assessments (surgeons' and model) was compared through the area under the receiver operating characteristic curve. Logistic regression analysis was used to assess the relation between surgeons' and model predictions to actual outcomes. Calibration of the subjective estimates was evaluated with a chi2 test.


RESULTS
Overall, the area under the receiver operating characteristic curve was 0.76 for the statistical model and 0.70 for the subjective assessment. Logistic regression analysis showed that the statistical model remained significant after accounting for the subjective assessment. Calibration of subjective mortality predictions was poor.


CONCLUSIONS
Surgeons' risk assessment tends to cluster in the middle ranges of risk. Subjective assessment seems accurate in identifying the two extremes of risk but is inaccurate for intermediate risk levels. A multivariate statistical model improves the accuracy of subjective predictions.
Pons
J M
JM
Catalan Agency for Health Technology Assessment and Catalan Institute of Oncology, Catalan Health Service, Department of Health, Generalitat de Catalunya, Barcelona, Spain.
Borras
J M
JM
Espinas
J A
JA
Moreno
V
V
Cardona
M
M
Granados
A
A
D000368:Aged; D000369:Aged, 80 and over; D006348:Cardiac Surgical Procedures / Q000401:mortality*; D005260:Female; D006801:Humans; D016015:Logistic Models; D008297:Male; D008875:Middle Aged; D018570:Risk Assessment; D012307:Risk Factors; D015996:Survival Rate