What is the concordance between the medical record and patient self-report as data sources for ambulatory care?
BACKGROUND
The validity of quality of care assessments relies upon data quality, yet little is known about the relative completeness and validity of data sources for evaluating the quality of care.


OBJECTIVE
We evaluated concordance between ambulatory medical record and patient survey data. Levels of concordance, variations by type of item, sources of disagreement between data sources, and implications for quality of care assessment efforts are discussed.


METHODS
This was an observational study that included 1270 patients sampled from 39 West Coast medical organizations with at least 1 of the following: diabetes, ischemic heart disease, asthma or chronic obstructive pulmonary disease, or low back pain.


METHODS
Items from both data sources were grouped into 4 conceptual domains: diagnosis, clinical services delivered, counseling and referral, and medication use. We present total agreement, kappa, sensitivity, and specificity at the item and domain-levels and for all items combined.


RESULTS
We found good concordance between survey and medical records overall, but there was substantial variation within and across domains. The worst concordance was in the counseling and referrals domain, the best in the medication use domain. Patients were able to report with good sensitivity on memorable items.


CONCLUSIONS
Quality ratings are likely to vary in differing directions, depending on the data source used. The most appropriate data source for analyses of components of and overall quality of care must be considered in light of study objectives and resources. We recommend data collection from multiple sources to most accurately portray the patient and provider experience of medical care.
Tisnado
Diana M
DM
University of California at Los Angeles, CA 90095-1736, USA. dtisnado@mednet.ucla.edu
Adams
John L
JL
Liu
Honghu
H
Damberg
Cheryl L
CL
Chen
Wen-Pin
WP
Hu
Fang Ashlee
FA
Carlisle
David M
DM
Mangione
Carol M
CM
Kahn
Katherine L
KL
D000293:Adolescent; D000328:Adult; D000368:Aged; D000553:Ambulatory Care / Q000706:statistics & numerical data*; D003625:Data Collection / Q000379:methods*; D003933:Diagnosis; D004363:Drug Utilization; D005260:Female; D006296:Health Services / Q000706:statistics & numerical data; D006801:Humans; D008297:Male; D008499:Medical Records / Q000706:statistics & numerical data*; D008875:Middle Aged; D011787:Quality of Health Care / Q000458:organization & administration*; D012017:Referral and Consultation / Q000706:statistics & numerical data; D012650:Self Disclosure; D012959:Socioeconomic Factors