title: How accurate is the eyeball test?: a comparison of physician's subjective assessment versus statistical methods in estimating mortality risk after cardiac surgery.
abstract: BACKGROUND
  In the era of increasing percutaneous treatment options for heart disease, the estimation of surgical risk has become a key factor in selecting optimal treatment strategies. Surgical risk has historically been estimated by physician's subjective assessment and more recently by statistical risk estimates.
  
  
  RESULTS
  We studied 5099 consecutive patients who underwent cardiac surgery at Minneapolis Veterans Affairs Medical Center between 1993 and 2010. Operative mortality risk was estimated statistically by the Veterans Affairs mortality risk estimate and subjectively by cardiac surgeons before surgery. Observed mortality rate was 3.3% (168 deaths) at 1 month, 7.1% (360 deaths) at 1 year, and 18.5% (942 deaths) at 5 years after surgery. Physician's risk estimate (mean [SD], 5.6% [4.4]) and statistical risk estimate (4.3% [5.1]) had modest correlation (c-index, 0.56; P<0.001). Both methods modestly overestimated operative mortality risk. Statistical risk estimate was significantly better than physician's risk estimate in separating patients who died from those who survived at 30 days (c-index, 0.78 versus 0.73; P=0.003), at 1 year (c-index, 0.72 versus 0.61; P<0.001), and at 5 years (c-index, 0.72 versus 0.64; P<0.001) after surgery. Physician's risk estimate was higher than statistical risk estimate in all subgroups except high-risk patients.
  
  
  CONCLUSIONS
  In patients undergoing cardiac surgery, statistical risk estimate is a better method to predict operative and long-term mortality compared with physician's subjective risk estimate. However, both methods modestly overestimate actual operative mortality risk.
authors.affiliation: Lillehei Heart Institute and Cardiovascular Division, University of Minnesota Medical School, Minneapolis, MN.
authors.forename: Renuka
authors.initials: R
authors.lastname: Jain
authors.forename: Sue
authors.initials: S
authors.lastname: Duval
authors.forename: Selcuk
authors.initials: S
authors.lastname: Adabag
mesh_terms: D000368:Aged; D000369:Aged, 80 and over; D006348:Cardiac Surgical Procedures / Q000379:methods / Q000401:mortality*; D003627:Data Interpretation, Statistical; D005104:Expert Testimony; D005260:Female; D006331:Heart Diseases / Q000601:surgery*; D006801:Humans; D008297:Male; D008875:Middle Aged; D008910:Minnesota; D062645:Percutaneous Coronary Intervention / Q000379:methods / Q000401:mortality; D010819:Physician's Role / Q000523:psychology*; D012189:Retrospective Studies; D018570:Risk Assessment / Q000379:methods; D013223:Statistics as Topic / Q000379:methods*; D015996:Survival Rate
keywords: cardiovascular diseases; constriction, pathologic; statistics