Comparison of 30-day mortality models for profiling hospital performance in acute ischemic stroke with vs without adjustment for stroke severity.
BACKGROUND
There is increasing interest in reporting risk-standardized outcomes for Medicare beneficiaries hospitalized with acute ischemic stroke, but whether it is necessary to include adjustment for initial stroke severity has not been well studied.


OBJECTIVE
To evaluate the degree to which hospital outcome ratings and potential eligibility for financial incentives are altered after including initial stroke severity in a claims-based risk model for hospital 30-day mortality for acute ischemic stroke.


METHODS
Data were analyzed from 782 Get With The Guidelines-Stroke participating hospitals on 127,950 fee-for-service Medicare beneficiaries with ischemic stroke who had a score documented for the National Institutes of Health Stroke Scale (NIHSS, a 15-item neurological examination scale with scores from 0 to 42, with higher scores indicating more severe stroke) between April 2003 and December 2009. Performance of claims-based hospital mortality risk models with and without inclusion of NIHSS scores for 30-day mortality was evaluated and hospital rankings from both models were compared.


METHODS
Model discrimination, hospital 30-day mortality outcome rankings, and value-based purchasing financial incentive categories.


RESULTS
Across the study population, the mean (SD) NIHSS score was 8.23 (8.11) (median, 5; interquartile range, 2-12). There were 18,186 deaths (14.5%) within the first 30 days, including 7430 deaths (5.8%) during the index hospitalization. The hospital mortality model with NIHSS scores had significantly better discrimination than the model without (C statistic, 0.864; 95% CI, 0.861-0.867, vs 0.772; 95% CI, 0.769-0.776; P < .001). Among hospitals ranked in the top 20% or bottom 20% of performers by the claims model without NIHSS scores, 26.3% were ranked differently by the model with NIHSS scores. Of hospitals initially classified as having "worse than expected" mortality, 57.7% were reclassified to "as expected" by the model with NIHSS scores. The net reclassification improvement (93.1%; 95% CI, 91.6%-94.6%; P < .001) and integrated discrimination improvement (15.0%; 95% CI, 14.6%-15.3%; P < .001) indexes both demonstrated significant enhancement of model performance after the addition of NIHSS. Explained variance and model calibration was also improved with the addition of NIHSS scores.


CONCLUSIONS
Adding stroke severity as measured by the NIHSS to a hospital 30-day risk model based on claims data for Medicare beneficiaries with acute ischemic stroke was associated with considerably improved model discrimination and change in mortality performance rankings for a substantial portion of hospitals.
Division of Cardiology, University of California, Los Angeles, USA. gfonarow@mednet.ucla.edu
Gregg C
GC
Fonarow
Wenqin
W
Pan
Jeffrey L
JL
Saver
Eric E
EE
Smith
Mathew J
MJ
Reeves
Joseph P
JP
Broderick
Dawn O
DO
Kleindorfer
Ralph L
RL
Sacco
DaiWai M
DM
Olson
Adrian F
AF
Hernandez
Eric D
ED
Peterson
Lee H
LH
Schwamm
D000208:Acute Disease; D000368:Aged; D000369:Aged, 80 and over; D002545:Brain Ischemia / Q000145:classification / Q000401:mortality*; D005260:Female; D005544:Forecasting; D017052:Hospital Mortality / Q000639:trends*; D006761:Hospitals / Q000145:classification / Q000592:standards* / Q000706:statistics & numerical data; D006801:Humans; D007345:Insurance Claim Review; D008297:Male; D006278:Medicare / Q000706:statistics & numerical data; D008962:Models, Theoretical; D017063:Outcome Assessment, Health Care / Q000379:methods*; D019984:Quality Indicators, Health Care / Q000706:statistics & numerical data*; D012052:Reimbursement, Incentive; D012306:Risk; D012720:Severity of Illness Index; D020521:Stroke / Q000145:classification / Q000401:mortality*; D014481:United States / Q000453:epidemiology