Can additional patient experience items improve the reliability of and add new domains to the CAHPS hospital survey?
BACKGROUND
The Centers for Medicare and Medicaid Services will introduce the reporting of patient surveys in 2008. The Consumer Assessment of Health Care Providers and Systems (CAHPS) Hospital Survey contains 18 questions about hospital care. Internal consistency reliability of the discharge information scale is relatively low and some important domains of care are not represented.


OBJECTIVE
To determine whether adding questions increases the reliability and validity of the survey.


METHODS
Surveys of patients at 181 hospitals participating in the California Hospitals Assessment and Reporting Taskforce (CHART), an initiative for voluntary public reporting of hospital performance in California.


METHODS
CHART added nine questions to the CAHPS Hospital Survey; two to improve reliability of the discharge information domain, five to create a coordination of care domain, and two relating to interpreter services.


METHODS
Surveys were sent to randomly selected patients from each CHART hospital.


RESULTS
A total of 40,172 surveys were included. Adding the new discharge information questions improved the internal consistency reliability from 0.45 to 0.72 and the hospital-level reliability from 0.75 to 0.81. New coordination of care composites had good internal consistency reliabilities ranging from 0.58 to 0.70 and hospital-level reliabilities ranging from 0.84 to 0.87. The new coordination of care composites were more closely correlated with overall hospital ratings and willingness to recommend than six of the seven original domains.


CONCLUSIONS
The additional discharge information questions and the new coordination of care questions significantly improved the psychometric properties of the CAHPS Hospital Survey.
Rothman
Arlyss Anderson
AA
Phillip R. Lee Institute for Health Policy Studies, 401 Miner Road, Orinda, CA 94563, USA. arlyssar@aol.com
Park
Hayoung
H
Hays
Ron D
RD
Edwards
Carol
C
Dudley
R Adams
RA
D000293:Adolescent; D000328:Adult; D000368:Aged; D002140:California; D014487:Centers for Medicare and Medicaid Services, U.S.; D005260:Female; D019538:Health Care Surveys / Q000592:standards*; D006761:Hospitals; D006801:Humans; D008297:Male; D008875:Middle Aged; D017060:Patient Satisfaction / Q000706:statistics & numerical data; D011594:Psychometrics; D015203:Reproducibility of Results; D014481:United States; D055815:Young Adult