title: Automated review of electronic health records to assess quality of care for outpatients with heart failure.
abstract: BACKGROUND
  Electronic health records (EHRs) may be used to assess quality of care.
  
  
  OBJECTIVE
  To evaluate the accuracy of automated review of EHR data to measure quality of care for outpatients with heart failure.
  
  
  METHODS
  Observational study of quality of care for heart failure comparing automated review of EHR data with automated review followed by manual review of electronic notes for patients with apparent quality deficits (hybrid review).
  
  
  METHODS
  An academic general internal medicine clinic with several years' experience using a commercial EHR.
  
  
  METHODS
  517 adults with a qualifying International Classification of Diseases, Ninth Revision, diagnosis of heart failure in their EHR data and 2 or more clinic visits over the past 18 months.
  
  
  METHODS
  Left ventricular ejection fraction (LVEF), prescription of a beta-blocker and an angiotensin-converting enzyme (ACE) inhibitor or angiotensin-receptor blocker (ARB) for patients with left ventricular systolic dysfunction (LVEF <0.40) and prescription of warfarin for patients with comorbid atrial fibrillation.
  
  
  RESULTS
  Performance based on automated review of EHR data was similar to that based on hybrid review for assessing LVEF measurement (94.6% vs. 97.3%), prescription of beta-blockers (90.9% vs. 92.8%), and prescription of ACE inhibitors or ARBs (93.9% vs. 98.7%). However, performance based on automated review was lower than that based on hybrid review for prescription of warfarin for atrial fibrillation (70.4% vs. 93.6%), primarily because automated review did not detect documentation of accepted reasons for not prescribing warfarin.
  
  
  CONCLUSIONS
  The findings may not be applicable to other practices and other EHRs. The authors used EHR data to identify eligible patients, so the study may have excluded some patients with heart failure. Patient charts were manually reviewed only if a provider appeared to fail a quality measure on automated review and did not determine the sensitivity and specificity of automated review according to standard definitions.
  
  
  CONCLUSIONS
  Automated review of EHR data to measure the quality of care of outpatients with heart failure missed many exclusion criteria for medications documented only in providers' notes. As a result, it sometimes underestimated performance on medication-based quality measures.
authors.affiliation: Northwestern University, Chicago, Illinois, USA. dwbaker@northwestern.edu
authors.forename: David W
authors.initials: DW
authors.lastname: Baker
authors.forename: Stephen D
authors.initials: SD
authors.lastname: Persell
authors.forename: Jason A
authors.initials: JA
authors.lastname: Thompson
authors.forename: Neilesh S
authors.initials: NS
authors.lastname: Soman
authors.forename: Karen M
authors.initials: KM
authors.lastname: Burgner
authors.forename: David
authors.initials: D
authors.lastname: Liss
authors.forename: Karen S
authors.initials: KS
authors.lastname: Kmetik
mesh_terms: D000319:Adrenergic beta-Antagonists / Q000627:therapeutic use; D000368:Aged; D000369:Aged, 80 and over; D000553:Ambulatory Care; D057911:Angiotensin Receptor Antagonists; D000806:Angiotensin-Converting Enzyme Inhibitors / Q000627:therapeutic use; D001145:Arrhythmias, Cardiac / Q000188:drug therapy; D011307:Drug Prescriptions; D006333:Heart Failure / Q000175:diagnosis / Q000188:drug therapy* / Q000503:physiopathology; D006801:Humans; D016347:Medical Records Systems, Computerized; D008875:Middle Aged; D019370:Observation; D017063:Outcome Assessment, Health Care / Q000379:methods*; D016277:Ventricular Function, Left
chemical_list: D000319:Adrenergic beta-Antagonists; D057911:Angiotensin Receptor Antagonists; D000806:Angiotensin-Converting Enzyme Inhibitors