The missing dead: the problem of case ascertainment in the assessment of trauma center performance.
BACKGROUND
If there are systematic differences in the types of patients captured in registries, then differences in outcomes in centers might be related not to differences in the practice of care, but differences in registry inclusion criteria. We set out to evaluate the effect of variable case ascertainment of dead on arrivals on external benchmarking of risk-adjusted mortality using a form of sensitivity analysis.


METHODS
We used data from the National Trauma Data Bank to look for indirect evidence of systematic differences in case ascertainment. We evaluated whether there was any relationship between fewer than expected early (< or = 24 hours) deaths and overall risk-adjusted mortality. Fewer than expected early deaths were estimated through the W statistic and through an adjusted ratio of early to late (E/L) deaths. E/L ratios were assessed due to the potential correlation between performance and absolute number of early deaths as assessed by the W statistic.


RESULTS
We estimate that as many as 47% of all deaths might be missing due to problems with case ascertainment. Centers with unexpectedly few early deaths (W statistic) were consistently high performing centers with a lower than expected overall mortality. More importantly, there was no relationship between the E/L death ratio and overall risk-adjusted mortality.


CONCLUSIONS
Variable case ascertainment of dead on arrivals does not affect the ability to assess performance. Given that our approach has several assumptions, it is critically important that external validation of trauma registries be performed. If centers are to be judged through the quality of their data, then it is incumbent to first assure that data quality meets expectations.
Division of Trauma and the Department of Surgery, St. Michael's Hospital, University of Toronto, Toronto, Canada. GomezJaramilloD@smh.toronto.on.ca
David
D
Gomez
Wei
W
Xiong
Barbara
B
Haas
Sandra
S
Goble
Najma
N
Ahmed
Avery B
AB
Nathens
D000293:Adolescent; D000328:Adult; D000368:Aged; D019985:Benchmarking; D005260:Female; D015600:Glasgow Coma Scale; D017052:Hospital Mortality; D006801:Humans; D015601:Injury Severity Score; D016015:Logistic Models; D008297:Male; D008875:Middle Aged; D017063:Outcome Assessment, Health Care; D011787:Quality of Health Care / Q000592:standards*; D012042:Registries / Q000592:standards*; D020379:Risk Adjustment; D014193:Trauma Centers / Q000592:standards*; D055815:Young Adult