Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough?
OBJECTIVE
To assess the relative abilities of clinical and administrative data to predict mortality and to assess hospital quality of care for CABG surgery patients.


METHODS
1991-1992 data from New York's Cardiac Surgery Reporting System (clinical data) and HCFA's MEDPAR (administrative data). STUDY DESIGN/SETTING/SAMPLE: This is an observational study that identifies significant risk factors for in-hospital mortality and that risk-adjusts hospital mortality rates using these variables. Setting was all 31 hospitals in New York State in which CABG surgery was performed in 1991-1992. A total of 13,577 patients undergoing isolated CABG surgery who could be matched in the two databases made up the sample.


METHODS
Hospital risk-adjusted mortality rates, identification of "outlier" hospitals, and discrimination and calibration of statistical models were the main outcome measures.


RESULTS
Part of the discriminatory power of administrative statistical models resulted from the miscoding of postoperative complications as comorbidities. Removal of these complications led to deterioration in the model's C index (from C = .78 to C = .71 and C = .73). Also, provider performance assessments changed considerably when complications of care were distinguished from comorbidities. The addition of a couple of clinical data elements considerably improved the fit of administrative models. Further, a clinical model based on Medicare CABG patients yielded only three outliers, whereas eight were identified using a clinical model for all CABG patients.


CONCLUSIONS
If administrative databases are used in outcomes research, (1) efforts to distinguish complications of care from comorbidities should be undertaken, (2) much more accurate assessments may be obtained by appending a limited number of clinical data elements to administrative data before assessing outcomes, and (3) Medicare data may be misleading because they do not reflect outcomes for all patients.
Hannan
E L
EL
Department of Health Policy and Management, School of Public Health, State University of New York at Albany 1244-3456, USA.
Racz
M J
MJ
Jollis
J G
JG
Peterson
E D
ED
D015982:Bias; D016507:Cardiology Service, Hospital / Q000592:standards*; D014487:Centers for Medicare and Medicaid Services, U.S.; D001026:Coronary Artery Bypass / Q000009:adverse effects / Q000401:mortality* / Q000592:standards; D016208:Databases, Factual; D016002:Discriminant Analysis; D005260:Female; D017052:Hospital Mortality; D006801:Humans; D007344:Insurance Claim Reporting; D016015:Logistic Models; D008297:Male; D016344:Medicare Part A / Q000592:standards / Q000706:statistics & numerical data*; D009518:New York / Q000453:epidemiology; D017063:Outcome Assessment, Health Care / Q000706:statistics & numerical data*; D011237:Predictive Value of Tests; D015203:Reproducibility of Results; D012307:Risk Factors; D014481:United States