Adequacy of medical chart review to characterize emergency care for asthma: findings from the Illinois Emergency Department Asthma Collaborative.
OBJECTIVE
To assess the intermethod reliability of medical chart review compared with directly observed care in patients presenting to emergency departments (EDs) for asthma care.


METHODS
ED care practices for persons with asthma were evaluated by comparing chart review with trained observers. Fifty-one patients from five EDs participating in the Illinois Emergency Department Asthma Collaborative were studied. Practices in assessment, treatment, education, and referral were measured. Eighteen elements of care were assessed. Concordance between chart and observation was measured by using the kappa statistic.


RESULTS
Of 51 subjects studied, nine were children. Kappa values varied depending on content. Kappa values ranged from 0.22 to 0.91 for items reflecting asthma assessment. Good concordances (kappa = 0.50 to 0.82) were found for items reflecting treatment practices. The lowest concordances were for items assessing educational activities (kappa = 0.04 to 0.34). Referral practices had fair to moderate concordances (kappa = 0.21 to 0.45).


CONCLUSIONS
Intermethod reliability of medical chart review and directly observed care varied depending on the element of care being measured. The use of chart review to measure quality of ED-based asthma care may only be appropriate for a limited number of care processes that are reliably and validly captured from chart review.
McDermott
Michael F
MF
Department of Emergency Medicine, John H. Stroger, Jr. Hospital of Cook County, Chicago IL 60612, USA. mmcdermott3086@sbcglobal.net
Lenhardt
Richard O
RO
Catrambone
Catherine D
CD
Walter
James
J
Weiss
Kevin B
KB
D000293:Adolescent; D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D001249:Asthma / Q000628:therapy*; D002648:Child; D002675:Child, Preschool; D004632:Emergency Medical Services / Q000706:statistics & numerical data*; D006801:Humans; D007087:Illinois; D008485:Medical Audit; D008875:Middle Aged; D011785:Quality Assurance, Health Care / Q000379:methods; D015203:Reproducibility of Results