Measuring performance directly using the veterans health administration electronic medical record: a comparison with external peer review.
BACKGROUND
Electronic medical records systems (EMR) contain many directly analyzable data fields that may reduce the need for extensive chart review, thus allowing for performance measures to be assessed on a larger proportion of patients in care.


OBJECTIVE
This study sought to determine the extent to which selected chart review-based clinical performance measures could be accurately replicated using readily available and directly analyzable EMR data.


METHODS
A cross-sectional study using full chart review results from the Veterans Health Administration's External Peer Review Program (EPRP) was merged to EMR data.


RESULTS
Over 80% of the data on these selected measures found in chart review was available in a directly analyzable form in the EMR. The extent of missing EMR data varied by site of care (P<0.01). Among patients on whom both sources of data were available, we found a high degree of correlation between the 2 sources in the measures assessed (correlations of 0.89-0.98) and in the concordance between the measures using performance cut points (kappa: 0.86-0.99). Furthermore, there was little evidence of bias; the differences in values were not clinically meaningful (difference of 0.9 mg/dL for low-density lipoprotein cholesterol, 1.2 mm Hg for systolic blood pressure, 0.3 mm Hg for diastolic, and no difference for HgbA1c).


CONCLUSIONS
Directly analyzable data fields in the EMR can accurately reproduce selected EPRP measures on most patients. We found no evidence of systematic differences in performance values among these with and without directly analyzable data in the EMR.
Goulet
Joseph L
JL
Yale University School of Medicine, New Haven, and VA Connecticut Healthcare System, West Haven, Connecticut 06516, USA. joseph.goulet@va.gov
Erdos
Joseph
J
Kancir
Sue
S
Levin
Forrest L
FL
Wright
Steven M
SM
Daniels
Stanlie M
SM
Nilan
Lynnette
L
Justice
Amy C
AC
D000368:Aged; D001794:Blood Pressure; D008078:Cholesterol, LDL / Q000097:blood; D003430:Cross-Sectional Studies; D003695:Delivery of Health Care; D005260:Female; D006442:Glycated Hemoglobin; D006801:Humans; D008297:Male; D016347:Medical Records Systems, Computerized; D010380:Peer Review; D011787:Quality of Health Care; D013647:Task Performance and Analysis; D014481:United States; D014493:United States Department of Veterans Affairs / Q000706:statistics & numerical data*
D008078:Cholesterol, LDL; D006442:Glycated Hemoglobin