National release of the nursing home quality report cards: implications of statistical methodology for risk adjustment.
OBJECTIVE
To determine how alternative statistical risk-adjustment methods may affect the quality measures (QMs) in nursing home (NH) report cards.


METHODS
Secondary data from the national Minimum Data Set files of 2004 and 2005 that include 605,433 long-term residents in 9,336 facilities.


METHODS
We estimated risk-adjusted QMs of decline in activities of daily living (ADL) functioning using classical, fixed-effects, and random-effects logistic models. Risk-adjusted QMs were compared with each other, and with the published QM (unadjusted) in identifying high- and low-quality facilities by either the rankings or 95 percent confidence intervals of QMs.


RESULTS
Risk-adjusted QMs showed better overall agreement (or convergent validity) with each other than did the unadjusted versus each adjusted QM; the disagreement rate between unadjusted and adjusted QM can be as high as 48 percent. The risk-adjusted QM derived from the random-effects shrinkage estimator deviated nonrandomly from other risk-adjusted estimates in identifying the best 10 percent facilities using rankings.


CONCLUSIONS
The extensively risk-adjusted QMs of ADL decline, even when estimated by alternative statistical methods, show higher convergent validity and provide more robust NH comparisons than the unadjusted QM. Outcome rankings based on ADL decline tend to show lower convergent validity when estimated by the shrinkage estimator rather than other statistical methods.
Li
Yue
Y
Department of Medicine, University of California, Irvine, CA 92697, USA. ylill@uci.edu
Cai
Xueya
X
Glance
Laurent G
LG
Spector
William D
WD
Mukamel
Dana B
DB
D000203:Activities of Daily Living; D016208:Databases, Factual; D006801:Humans; D016015:Logistic Models; D015233:Models, Statistical; D009735:Nursing Homes / Q000592:standards*; D019984:Quality Indicators, Health Care; D011787:Quality of Health Care; D020379:Risk Adjustment; D014481:United States