Does risk adjustment of the CMS quality measures for nursing homes matter?
BACKGROUND
The Centers for Medicare and Medicaid Services (CMS) publish a report card for nursing homes with 19 clinical quality measures (QMs). These measures include minimal risk adjustment.


OBJECTIVE
To develop QMs with more extensive risk adjustment and to investigate the impact on quality rankings.


METHODS
Retrospective analysis of individual level data reported in the Minimum Data Set (MDS). Random effect logistic models were used to estimate risk adjustment models for 5 outcomes: pressure ulcers for high and low risk patients, physical restraints, and pain for long- and short-stay patients. These models were used to create 5 QMs with extended risk adjustment, enhanced QMs (EQMs). The EQMs were compared with the corresponding QMs.


METHODS
All (17,469) nursing homes that reported MDS data in the period 2001-2005, and their 9.6 million residents.


METHODS
QMs were compared with EQMs for all nursing homes in terms of agreement on outlier identification: Kappa, false positive and false negative error rates.


RESULTS
Kappa values ranged from 0.63 to 0.90. False positive and negative error rates ranged from 8% to 37%. Agreement between QMs and EQMs was better on high quality rather than on low quality.


CONCLUSIONS
More extensive risk adjustment changes quality ranking of nursing homes and should be considered as potential improvement to the current QMs. Other methodological issues related to construction of the QMs should also be investigated to determine if they are important in the context of nursing home care.
Mukamel
Dana B
DB
University of California Irvine, Center for Health Policy Research, Irvine, California 92697-5800, USA. dmukamel@uci.edu
Glance
Laurent G
LG
Li
Yue
Y
Weimer
David L
DL
Spector
William D
WD
Zinn
Jacqueline S
JS
Mosqueda
Laura
L
D017677:Age Distribution; D000368:Aged; D000369:Aged, 80 and over; D000465:Algorithms; D014487:Centers for Medicare and Medicaid Services, U.S.; D006801:Humans; D007902:Length of Stay; D016015:Logistic Models; D008875:Middle Aged; D009735:Nursing Homes / Q000592:standards*; D010146:Pain; D003668:Pressure Ulcer; D019984:Quality Indicators, Health Care; D012149:Restraint, Physical; D012189:Retrospective Studies; D020379:Risk Adjustment; D012307:Risk Factors; D014481:United States