title: Using electronic health records to measure physician performance for acute conditions in primary care: empirical evaluation of the community-acquired pneumonia clinical quality measure set.
abstract: BACKGROUND
  Electronic health records (EHRs) have the potential to facilitate performance measurement for acute conditions.
  
  
  OBJECTIVE
  To evaluate the reliability and feasibility-of-use of a performance measure set for community-acquired pneumonia in an ambulatory EHR.
  
  
  METHODS
  Retrospective, cross-sectional electronic chart review.
  
  
  METHODS
  Primary Care Clinics.
  
  
  METHODS
  Adults with an administrative claims diagnosis of pneumonia during a 14-month period.
  
  
  METHODS
  Two reviewers independently examined data in the EHR to determine if (1) the encounter was a visit for acute pneumonia; (2) there was documentation for each of 12 performance measures; and (3) such information was in coded form.
  
  
  RESULTS
  Of 688 encounters with a claim diagnosis of pneumonia, 210 (31%) were identified by either reviewer as a primary care acute pneumonia visit. The 2 reviewers agreed that 198 encounters to 71 different clinicians were visits for acute pneumonia [kappa, 0.96; 95% confidence interval (CI), 0.93-0.98]. Measure performance ranged from 10% for providing location of care rationale to 91% for documenting blood pressure, averaging 52% across all 12 measures. Inter-rater reliability ranged from 0.66 (95% CI, 0.47-0.84) for providing a location of care rationale to 0.97 (95% CI, 0.91-1.0) for vital sign assessment. The proportion of data that was in coded form ranged from 0% for mental status, hydration status, chest x-ray performance, and location of care to 100% for medications and immunizations.
  
  
  CONCLUSIONS
  Although EHRs offer potential advantages for performance measurement for acute conditions, accurate identification of pneumonia visits was challenging, performance generally appeared poor, and much of the data were not in coded form.
authors.affiliation: Division of General Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA. jlinder@partners.org
authors.forename: Jeffrey A
authors.initials: JA
authors.lastname: Linder
authors.forename: Erin O
authors.initials: EO
authors.lastname: Kaleba
authors.forename: Karen S
authors.initials: KS
authors.lastname: Kmetik
mesh_terms: D000208:Acute Disease; D000328:Adult; D000368:Aged; D001900:Boston; D017714:Community-Acquired Infections / Q000175:diagnosis / Q000453:epidemiology / Q000628:therapy*; D003430:Cross-Sectional Studies; D003695:Delivery of Health Care / Q000592:standards*; D019317:Evidence-Based Medicine; D005260:Female; D019983:Guideline Adherence / Q000592:standards; D006801:Humans; D008297:Male; D016347:Medical Records Systems, Computerized / Q000706:statistics & numerical data*; D008875:Middle Aged; D018410:Pneumonia, Bacterial / Q000175:diagnosis / Q000453:epidemiology / Q000628:therapy*; D011320:Primary Health Care / Q000592:standards*; D011785:Quality Assurance, Health Care / Q000592:standards*