Consistency in performance evaluation reports and medical records.
BACKGROUND
In the health care market managed care has become the latest innovation for the delivery of services. For efficient implementation, the managed care organization relies on accurate information. So clinicians are often asked to report on patients before referrals are approved, treatments authorized, or insurance claims processed. What are clinicians  responses to solicitation for information by managed care organizations? The existing health literature has already pointed out the importance of provider  gaming,   sincere reporting,   nudging,  and  dodging the rules.


OBJECTIVE
We assess the consistency of clinicians  reports on clients across administrative data and clinical records.


METHODS
For about 1,000 alcohol abuse treatment episodes, we compare clinicians  reports across two data sets. The first one, the Maine Addiction Treatment System (MATS), was an administrative data set; the state government used it for program performance monitoring and evaluation. The second was a set of medical record abstracts, taken directly from the clinical records of treatment episodes. A clinician s reporting practice exhibits an inconsistency if the information reported in MATS differs from the information reported in the medical record in a statistically significant way. We look for evidence of inconsistencies in five categories: admission alcohol use frequency, discharge alcohol use frequency, termination status, admission employment status, and discharge employment status. Chi-square tests, Kappa statistics, and sensitivity and specificity tests are used for hypothesis testing. Multiple imputation methods are employed to address the problem of missing values in the record abstract data set.


RESULTS
For admission and discharge alcohol use frequency measures, we find, respectively, strong and supporting evidence for inconsistencies. We find equally strong evidence for consistency in reports of admission and discharge employment status, and mixed evidence on report consistency on termination status. Patterns of inconsistency may be due to both altruistic and self-interest motives.


CONCLUSIONS
Payment contracts based on performance may be subject to provider mis-reporting, which could seriously undermine its purpose. However, further analysis is needed to determine how much of the inconsistencies observed are results of clinician gaming in reporting.


CONCLUSIONS
Increasing system accountability is becoming more and more important for health care policy makers. Results of this study will lead to a better understanding of physician reporting behavior.


CONCLUSIONS
Our work in this paper on the data sets confirms the statistical significance of strategic reporting in alcohol addiction treatment. It will be of interest to confirm our finding in other data sets. Our on-going research will model the motives behind strategic reporting. We will hypothesize that both altruistic and financial incentives are present. Our empirical identification strategy will use Maine s Performance-Based Contracting system and client insurance sources to test how these incentives affect the direction of clinician s strategic reporting.
Department of Economics, University of Calgary, 2500 University Drive, NW, Calgary, AB, Canada, T2N 1N4. lu@ucalgary.ca
Mingshan
M
Lu
Ching-to Albert
CT
Ma
D000328:Adult; D000437:Alcoholism / Q000453:epidemiology / Q000534:rehabilitation / Q000628:therapy*; D004282:Documentation / Q000592:standards; D005260:Female; D006760:Hospitalization; D006801:Humans; D015994:Incidence; D007345:Insurance Claim Review / Q000592:standards; D008281:Maine; D008297:Male; D008329:Managed Care Programs / Q000191:economics / Q000592:standards*; D008499:Medical Records / Q000592:standards*; D017063:Outcome Assessment, Health Care; D010343:Patient Admission; D012017:Referral and Consultation; D012941:Social Responsibility; D013221:State Health Plans; D014481:United States