Calculations of Financial Incentives for Providers in a Pay-for-Performance Program: Manual Review Versus Data From Structured Fields in Electronic Health Records.
BACKGROUND
Hospital report cards and financial incentives linked to performance require clinical data that are reliable, appropriate, timely, and cost-effective to process. Pay-for-performance plans are transitioning to automated electronic health record (EHR) data as an efficient method to generate data needed for these programs.


OBJECTIVE
To determine how well data from automated processing of structured fields in the electronic health record (AP-EHR) reflect data from manual chart review and the impact of these data on performance rewards.


METHODS
Cross-sectional analysis of performance measures used in a cluster randomized trial assessing the impact of financial incentives on guideline-recommended care for hypertension.


METHODS
A total of 2840 patients with hypertension assigned to participating physicians at 12 Veterans Affairs hospital-based outpatient clinics. Fifty-two physicians and 33 primary care personnel received incentive payments.


METHODS
Overall, positive and negative agreement indices and Cohen's kappa were calculated for assessments of guideline-recommended antihypertensive medication use, blood pressure (BP) control, and appropriate response to uncontrolled BP. Pearson's correlation coefficient was used to assess how similar participants' calculated earnings were between the data sources.


RESULTS
By manual chart review data, 72.3% of patients were considered to have received guideline-recommended antihypertensive medications compared with 65.0% by AP-EHR review (κ=0.51). Manual review indicated 69.5% of patients had controlled BP compared with 66.8% by AP-EHR review (κ=0.87). Compared with 52.2% of patients per the manual review, 39.8% received an appropriate response by AP-EHR review (κ=0.28). Participants' incentive payments calculated using the 2 methods were highly correlated (r≥0.98). Using the AP-EHR data to calculate earnings, participants' payment changes ranged from a decrease of $91.00 (-30.3%) to an increase of $18.20 (+7.4%) for medication use (interquartile range, -14.4% to 0%) and a decrease of $100.10 (-31.4%) to an increase of $36.40 (+15.4%) for BP control or appropriate response to uncontrolled BP (interquartile range, -11.9% to -6.1%).


CONCLUSIONS
Pay-for-performance plans that use only EHR data should carefully consider the measures and the structure of the EHR before data collection and financial incentive disbursement. For this study, we feel that a 10% difference in the total amount of incentive earnings disbursed based on AP-EHR data compared with manual review is acceptable given the time and resources required to abstract data from medical records.
*Health Policy, Quality and Informatics Program, Michael E. DeBakey VA HSR&D Center for Innovations in Quality, Effectiveness & Safety (IQuESt), and Section for Health Services Research, Department of Medicine, Baylor College of Medicine, Houston, TX †Department of Medicine, Philip R. Lee Institute for Health Policy Studies ‡Health Services Informatics, University of California, San Francisco, CA.
Tracy H
TH
Urech
LeChauncy D
LD
Woodard
Salim S
SS
Virani
R Adams
RA
Dudley
Meghan Z
MZ
Lutschg
Laura A
LA
Petersen
D000959:Antihypertensive Agents / Q000627:therapeutic use; D003430:Cross-Sectional Studies; D003625:Data Collection / Q000379:methods*; D057286:Electronic Health Records / Q000706:statistics & numerical data*; D019983:Guideline Adherence; D006787:Hospitals, Veterans / Q000706:statistics & numerical data; D006801:Humans; D006973:Hypertension / Q000188:drug therapy; D009042:Motivation; D017410:Practice Guidelines as Topic; D012052:Reimbursement, Incentive / Q000706:statistics & numerical data*
D000959:Antihypertensive Agents