Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data.
OBJECTIVE
Canadian administrative hospital discharge data contain a diagnosis-type indicator for each coded diagnosis that allows researchers to distinguish complications from pre-existing diagnoses. Given that the validity of diagnosis-type indicators is unknown, we conducted a detailed chart review to evaluate the accuracy of diagnosis-type indicators for flagging complications.


METHODS
We obtained administrative hospital discharge data for 1,200 randomly selected adult inpatient separations in Calgary, Alberta, occurring between April 1, 1996 and March 31, 1997. Each discharge record contains up to 16 diagnoses and 16 corresponding diagnosis-type indicators (value of "2"=complication). The corresponding medical charts were reviewed for evidence of diagnoses and complications. A complication was defined as a new diagnosis arising after the start of hospitalization. We determined the extent to which the diagnosis-type indicator in the administrative data agreed with the chart reviewer's assessment (criterion standard) of whether a diagnosis was a complication or not.


RESULTS
The agreement for complications between the two databases varied greatly across 12 conditions studied (kappa range: 0-0.72) and was often low (kappa <0.20 for six conditions). Sensitivity ranged from 0 to 57.1% (higher than 50% for only two conditions), indicating a tendency for complications to often be miscoded as baseline comorbidities. In contrast, specificity was generally high (range: 99.0-100%), suggesting that pre-existing conditions were usually appropriately coded as such in the administrative data.


CONCLUSIONS
The validity of diagnosis-type indicators in Canadian administrative discharge data appears to be poor for some types of complications. This is likely to be of greatest concern in studies that rely solely on diagnosis-type indicators to define complications as outcomes.
Quan
Hude
H
Quality Improvement and Health Information, Calgary Health Region, 1403 29th Street NW, Calgary, Alberta, Canada T2N 2T9. hquan@ucalgary.ca
Parsons
Gerry A
GA
Ghali
William A
WA
D000328:Adult; D000416:Alberta; D003953:Diagnosis-Related Groups; D005568:Forms and Records Control / Q000592:standards; D006801:Humans; D008499:Medical Records / Q000592:standards*; D017063:Outcome Assessment, Health Care / Q000379:methods / Q000592:standards*; D010351:Patient Discharge / Q000592:standards*; D011183:Postoperative Complications / Q000175:diagnosis