Reliability estimates of clinical measures between Minimum Data Set and Online Survey Certification and Reporting data of US nursing homes.
BACKGROUND
Evidence-based quality improvement in nursing homes relies heavily on administrative data. Minimum Data Set (MDS) and Online Survey Certification and Reporting (OSCAR) are the 2 largest sources of national nursing home administrative data. Although clinical measures in each of the data systems have frequently and independently been used to measure nursing home performance, no study has systematically examined their relative reliability.


OBJECTIVE
This study estimates the reliability of clinical measures between MDS and OSCAR data and discusses the utility of these databases in research.


METHODS
We analyzed 4 waves of national MDS and OSCAR data (1999-2002). A comparable group of 24 clinical indicators from both datasets was selected for the reliability test. Spearman rank-order correlation analyses were used to measure the test-retest reliability relationships.


RESULTS
Across the 4 years, the majority of coefficients of clinical measures exhibit good reliability. There are 17 clinical measures (71% of the total measures) with correlation coefficients greater than 0.4, the minimally acceptable reliability threshold according to Morris. The highest correlation coefficients were associated with tube feeding at 0.883.


CONCLUSIONS
Our findings indicate that the target clinical measures in OSCAR and MDS are generally consistent and reliable. However, researchers should use OSCAR self-reported clinical measures to measure nursing home outcomes in place of corresponding MDS clinical measures with caution because some indicators in the administrative data are more reliable than others.
Zhang
Ning Jackie
NJ
Department of Health Professions and Doctoral Program in Public Affairs, College of Health and Public Affairs, University of Central Florida, Orlando, Florida, USA. nizhang@mail.ucf.edu
Paek
Seung Chun
SC
Wan
Thomas T H
TT