Development and evaluation of CAHPS questions to assess the impact of health information technology on patient experiences with ambulatory care.
BACKGROUND
Little is known about whether health information technology (HIT) affects patient experiences with health care.


OBJECTIVE
To develop HIT questions that assess patients care experiences not evaluated by existing ambulatory Consumer Assessment of Health Plans and Systems (CAHPS) measures.


METHODS
We reviewed published articles and conducted focus groups and cognitive testing to develop survey questions. We collected data, using mail and the internet, from patients of 69 physicians receiving care at an academic medical center and 2 regional integrated delivery systems in late 2009 and 2010. We evaluated questions and scales about HIT using factor analysis, item-scale correlations, and reliability (internal consistency and physician-level) estimates.


RESULTS
We found support for 3 HIT composites: doctor use of computer (2 items), e-mail (2 items), and helpfulness of provider's website (4 items). Corrected item-scale correlations were 0.37 for the 2 doctor use of computer items and 0.71 for the 2 e-mail items, and ranged from 0.50 to 0.60 for the provider's website items. Cronbach α was high for e-mail (0.83) and provider's website (0.75), but only 0.54 for doctor use of computer. As few as 50 responses per physician would yield reliability of 0.70 for e-mail and provider's website. Two HIT composites, doctor use of computer (P<0.001) and provider's website (P=0.02), were independent predictors of overall ratings of doctors.


CONCLUSIONS
New CAHPS HIT items were identified that measure aspects of patient experiences not assessed by the CAHPS C&G 1.0 survey.
VA QUERI Program and Center for Health Quality, Outcomes, and Economic Research, ENRM VA Medical Center, Bedford, MA 01730, USA. keith.mcinnes@va.gov
D Keith
DK
McInnes
Julie A
JA
Brown
Ron D
RD
Hays
Patricia
P
Gallagher
James D
JD
Ralston
Mildred
M
Hugh
Michael
M
Kanter
Carl A
CA
Serrato
Carol
C
Cosenza
John
J
Halamka
Lin
L
Ding
Paul D
PD
Cleary
D000293:Adolescent; D000328:Adult; D000368:Aged; D000553:Ambulatory Care / Q000592:standards* / Q000706:statistics & numerical data; D002140:California; D005163:Factor Analysis, Statistical; D005260:Female; D019538:Health Care Surveys; D006801:Humans; D020407:Internet; D008297:Male; D008490:Medical Informatics / Q000592:standards / Q000706:statistics & numerical data; D008875:Middle Aged; D017060:Patient Satisfaction / Q000706:statistics & numerical data; D010820:Physicians / Q000592:standards / Q000706:statistics & numerical data; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires / Q000592:standards; D055815:Young Adult