Ranking and rankability of hospital postoperative mortality rates in colorectal cancer surgery.
OBJECTIVE
To examine to what extent random variation and variation in case-mix influence hospital rankings on the basis of mortality rates and to determine the suitability of mortality for ranking hospitals in colorectal surgery.


BACKGROUND
Comparing and ranking postoperative mortality rates between hospitals becomes increasingly popular. Differences in hospital case-mix, and chance variation related to caseload, may influence rankings. The suitability of mortality for rankings remains unclear.


METHODS
Data were derived from the Dutch Surgical Colorectal Audit. Hospital rankings based on fixed- and random-effects logistic regression models, unadjusted and adjusted for case-mix were compared with the percentile based on expected ranks (the chance that a hospital performs better than a random hospital). Rankability, measuring which part of variation between hospitals is not due to chance, was calculated.


RESULTS
Some 25,591 patients undergoing colorectal resections in 92 hospitals were evaluated. Postoperative mortality rates ranged between 0% and 8.8%. Adjustment for case-mix with a fixed-effects model caused large changes in rankings. A smaller additional effect on changes in rankings occurred after adjusting with a random-effects model, with lower volume hospitals moving toward the mean. Percentile based on expected ranks ranged between 10% and 85%. Rankability was 38%, meaning that 62% of hospital variation in mortality was due to chance.


CONCLUSIONS
Hospital ranks changed after case-mix adjustment and random-effects models, compared with unadjusted analysis. A large proportion of hospital variation in mortality was due to chance. Caution should be warranted when interpreting hospital rankings on the basis of postoperative mortality. Percentiles of expected ranks may help identify hospitals with exceptional performance.
*Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands †Faculty of Economics and Business, Department of Econometrics, University of Amsterdam, Amsterdam, The Netherlands ‡Department of Surgery, Netherlands Cancer Institute (NKI)-Antoni van Leeuwenhoek Hospital, Amsterdam, The Netherlands; and §Department of Medical Statistics and Bioinformatics, Leiden University Medical Center, Leiden, The Netherlands.
Daniel
D
Henneman
Annelotte C M
AC
van Bommel
Alexander
A
Snijders
Heleen S
HS
Snijders
Rob A E M
RA
Tollenaar
Michel W J M
MW
Wouters
Marta
M
Fiocco
D000368:Aged; D015179:Colorectal Neoplasms / Q000401:mortality* / Q000601:surgery; D013505:Digestive System Surgical Procedures; D005260:Female; D017052:Hospital Mortality / Q000639:trends; D006761:Hospitals / Q000592:standards*; D006801:Humans; D016015:Logistic Models; D008297:Male; D009426:Netherlands / Q000453:epidemiology; D011184:Postoperative Period; D019984:Quality Indicators, Health Care; D012189:Retrospective Studies; D020379:Risk Adjustment / Q000379:methods*; D015996:Survival Rate / Q000639:trends