A Sensitivity Analysis and Opportunity Cost Evaluation of the Surgical Council on Resident Education Curriculum.
OBJECTIVE
The study purpose is to evaluate the Surgical Council on Resident Education (SCORE) Curriculum regarding American Board of Surgery Qualifying Examination (ABS QE) outcomes. The goal is to perform effect size analyses, sensitivity analyses, and sample size analyses with opportunity cost estimates required to favor the SCORE Curriculum subscription regarding ABS QE outcomes.


METHODS
Published data were used to construct 2 × 2 matrices regarding ABS QE outcome (pass/fail) and SCORE subscription status (subscriber/nonsubscriber). Post hoc analyses of effect sizes and sample sizes, with opportunity cost estimates, were performed to evaluate ABS QE outcomes favoring SCORE subscription (2-tailed and 1-tailed tests) using an α = 0.05.


RESULTS
The absolute risk increase of SCORE subscription on ABS QE outcome was 1.6% (number needed to treat = 63). Sensitivity analyses showed that a pass rate difference of 4.9% to 7.5% was required to favor SCORE subscription (all p < 0.05). Sample size analyses required an 8- to 18-fold increase to favor SCORE subscription to achieve statistical significance with an opportunity cost of $6.0 to $13.5 million ($30,000-$67,000/program), not adjusting for inflation.


CONCLUSIONS
The number needed to treat and pass rate differences required to favor SCORE subscription are large. The opportunity costs of SCORE subscription are substantial. Residency programs with more limited resources should determine if the subscription costs are financially sound.
Owensboro Health, One Health Surgical Specialists, Owensboro, Kentucky; Department of Surgery, University of Louisville, Louisville, Kentucky. Electronic address: John.FalconeMD@owensborohealth.org.
John L
JL
Falcone
Frank H. Netter, M.D. School of Medicine, Quinnipiac University, North Haven, Connecticut.
Richard S
RS
Feinn
D002983:Clinical Competence / Q000191:economics*; D003365:Costs and Cost Analysis; D003479:Curriculum; D007396:Internship and Residency / Q000191:economics*; D012680:Sensitivity and Specificity; D013043:Specialties, Surgical / Q000193:education*; D013044:Specialty Boards; D014481:United States
American Board of Surgery; Medical Knowledge; Professionalism; SCORE; Surgical Council on Resident Education; Systems-Based Practice; general surgery; qualifying examination