Agreement between self-reports and medical records was only fair in a cross-sectional study of performance of annual eye examinations among adults with diabetes in managed care.
BACKGROUND
Despite consensus about the importance of measuring quality of diabetes care and the widespread use of self-reports and medical records to assess quality, little is known about the degree of agreement between these data sources.


OBJECTIVE
To evaluate agreement between self-reported and medical record data on annual eye examinations and to identify factors associated with agreement.


METHODS
Data from interviews and medical records were available for 8409 adults with diabetes who participated in the baseline round of the Translating Research Into Action for Diabetes (TRIAD) Study.


METHODS
Agreement between self-reports and medical records was evaluated as concordance and Cohen's kappa coefficient.


RESULTS
Self-reports indicated a higher performance of annual dilated eye examinations than did medical records (75.9% vs. 38.8%). Concordance between the data sources was 57.9%. Agreement was only fair (kappa coefficient = 0.25; 95% confidence interval, 0.23-0.26). Nearly two-thirds (64.6%) of discordance was due to lack of evidence in the medical record to support self-reported performance of the procedure. After adjustment, agreement was most strongly related to health plan (chi = 977.9, df = 9; P < 0.0001), and remained significantly better for 3 of the 10 health plans (P < 0.00001) and for persons younger than 45 years of age (P = 0.00002).


CONCLUSIONS
The low level of agreement between self-report and medical records suggests that many providers of diabetes care do not have easily available accurate information on the eye examination status of their patients.
Beckles
Gloria L A
GL
Division of Diabetes Translation, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention, Atlanta, Georgia 30341, USA.
Williamson
David F
DF
Brown
Arleen F
AF
Gregg
Edward W
EW
Karter
Andrew J
AJ
Kim
Catherine
C
Dudley
R Adams
RA
Safford
Monika M
MM
Stevens
Mark R
MR
Thompson
Theodore J
TJ
D000328:Adult; D000368:Aged; D003430:Cross-Sectional Studies; D003924:Diabetes Mellitus, Type 2 / Q000453:epidemiology* / Q000503:physiopathology; D003930:Diabetic Retinopathy / Q000175:diagnosis / Q000453:epidemiology*; D003955:Diagnostic Tests, Routine; D005260:Female; D006801:Humans; D016014:Linear Models; D008297:Male; D008329:Managed Care Programs / Q000592:standards / Q000706:statistics & numerical data*; D008499:Medical Records / Q000706:statistics & numerical data*; D008875:Middle Aged; D017063:Outcome Assessment, Health Care; D019984:Quality Indicators, Health Care; D015203:Reproducibility of Results; D018570:Risk Assessment; D012650:Self Disclosure; D011795:Surveys and Questionnaires; D014481:United States / Q000453:epidemiology