Validly interpreting patients' reports: using bifactor and multidimensional models to determine whether surveys and scales measure one or more constructs.
BACKGROUND
Validly interpreting scores based on patients' reports of their experiences using scales depends on a valid scoring system. The possibility exists that, although the creators of a scale intended to create a scale measuring a single construct, the questions may seem to measure more than one construct. However, the possibility also exists that the questions do generally measure one construct, but several "nuisance" constructs influence the measurement of the construct indirectly. Unidimensional, multidimensional, and bifactor analytical models offer a method for establishing scale dimensionality and subsequently developing valid scoring systems. In this paper, we take an applied perspective, discuss these models and their implications, and use real data to provide an example.


METHODS
We used unidimensional, multidimensional, and bifactor analyses to examine the measurement structure of the Consumer Assessments of Healthcare Providers and Systems Cultural Competence (CAHPS-CC) Survey. Participants came from a 2008 sample of 2 Medicaid managed care plans, in New York and California.


RESULTS
Both unidimensional and bifactor models failed to fit the data well. A multidimensional model, with 7 factors corresponding to 7 cultural competence domains fit the data well (root mean square error of approximation=0.064; Tucker-Lewis Index=0.98; comparative fit index=0.97).


CONCLUSIONS
Results indicate that the CAHPS-CC does not seem to measure a single construct. Rather, the CAHPS-CC seems to measure 7 separable domains, suggesting the need for 7 separate scale scores. Our findings highlight the importance of conducting dimensionality analyses.
Department of Pediatrics, University of Cincinnati School of Medicine, Cincinnati, OH, USA. adam.carle.cchmc@gmail.com
Adam C
AC
Carle
Robert
R
Weech-Maldonado
D002140:California; D003142:Communication; D054521:Cultural Competency; D019538:Health Care Surveys; D006801:Humans; D015233:Models, Statistical; D009518:New York; D010358:Patient Participation; D017060:Patient Satisfaction; D010817:Physician-Patient Relations; D011594:Psychometrics; D015203:Reproducibility of Results; D057566:Self Report; D011795:Surveys and Questionnaires; D035502:Trust