The validity of self-reported diabetes quality of care measures.
OBJECTIVE
First, to test the validity of self-reported quality of care and treatment measures compared with medical records and administrative data for: eye examinations, hemoglobin A1C tests, and use of insulin and oral agents for adult patients with diabetes; and secondly to assess the consistency between medical record information and administrative data for the same measures plus microalbumin testing.


METHODS
Cross-sectional study using data from telephone survey, primary care medical and eye records, and administrative claims.


METHODS
Statewide health maintenance organization in Minnesota, USA, 1995.


METHODS
Four hundred and forty adults with diabetes, aged 31-64 years.


METHODS
Validity++ of self-reported diabetes quality of care measures compared with a criterion standard combining information from primary care and eye records with information from administrative data; and reliability of medical record information compared with administrative data.


RESULTS
Although the sensitivity of self-reported eye examination was high (89%), the specificity was low (65%). Self-report of hemoglobin A1C also had high sensitivity (99%) and a lower specificity than that of eye examination (28%). The two information sources (medical records and claims) used in the criterion standard each contained complementary and non-overlapping information. Reliability was highest for microalbumin testing (kappa, 0.75) and lowest for eye examination (kappa, 0.37).


CONCLUSIONS
Quality of care measures for diabetes are often drawn from a variety of sources. To the extent that data sources are biased, the measures can be misleading. Self-report is likely to lead to an overestimate of eye screening and the measurement of hemoglobin A1C. Reported rates of quality of care should be inspected carefully. The 'same' rate taken from different sources may vary.
Fowles
J B
JB
Health Research Center, Institute for Research and Education, HealthSystem Minnesota, Minneapolis 55416, USA. fowlej@hsmnet.com
Rosheim
K
K
Fowler
E J
EJ
Craft
C
C
Arrichiello
L
L
D000328:Adult; D000418:Albumins / Q000032:analysis; D003430:Cross-Sectional Studies; D003625:Data Collection / Q000379:methods / Q000592:standards; D003920:Diabetes Mellitus / Q000628:therapy*; D003930:Diabetic Retinopathy / Q000175:diagnosis; D005260:Female; D019538:Health Care Surveys / Q000379:methods* / Q000592:standards; D006279:Health Maintenance Organizations / Q000592:standards / Q000706:statistics & numerical data*; D006441:Hemoglobin A / Q000032:analysis; D006801:Humans; D008297:Male; D008499:Medical Records / Q000592:standards; D008875:Middle Aged; D008910:Minnesota; D011237:Predictive Value of Tests; D011787:Quality of Health Care; D012650:Self Disclosure; D012680:Sensitivity and Specificity; D011795:Surveys and Questionnaires
D000418:Albumins; D006441:Hemoglobin A