Limitations of electronic databases: a caution.
OBJECTIVE
The purpose of this study was to assess the completeness and accuracy of information from two electronic datasets, one of which is voluntarily submitted, the other submitted by mandate.


METHODS
Emergency department (ED) data have been voluntarily submitted by several hospitals to the Kentucky Emergency Medical Services Information System (KEMSIS). Similar information on all patients admitted to the hospital has been submitted by mandate to the state under the Uniform Billing Act (UB92). UB92 data for patients with at least one diagnosis code > or = 800 were available. The KEMSIS and UB 92 data for one hospital were compared to those manually abstracted from the ED log and medical records for completeness and accuracy.


RESULTS
There were 316 patients listed on the ED log that were subsequently admitted to the hospital. The KEMSIS database contained 266 (84%) of these records, but only 91 (34%) were classified as having been admitted. Of those correctly classified as admitted, only 25 (27%, or 9% of the total 266) were correctly classified as to the hospital of admission (directly to hospital or transferred to another facility). Discharge diagnoses in the KEMSIS database and hospital records were concordant in 240 (90%) of the patients, even for those misclassified as to disposition. There were 37 patients listed in the ED log admitted during the study period with at least one discharge diagnosis field > or = 800. Eight patients were transferred to another institution, making the total population available for study period 29. Only eight (28%) of these patients were included in the UB92 database. The diagnosis codes were concordant between the UB 92 data and ED log in all cases.


CONCLUSIONS
There is significant misclassification and/or omission in electronic databases. This is true regardless of whether data is reported voluntarily or by mandate. Electronic data must be independently validated before they are used for policy or research purposes.
Svenson
James E
JE
Section of Emergency Medicine, University of Wisconsin, C7/379 CSC, 600 Highland Avenue, Madison, WI 53792, USA.
Pollack
Susan H
SH
Fallat
Mary E
ME
Drapeau
Jeanne L
JL
D016208:Databases, Factual / Q000592:standards*; D004632:Emergency Medical Services / Q000592:standards*; D004636:Emergency Service, Hospital / Q000592:standards*; D006751:Hospital Information Systems / Q000592:standards*; D006753:Hospital Records / Q000706:statistics & numerical data; D006760:Hospitalization / Q000706:statistics & numerical data; D006801:Humans; D007629:Kentucky; D015203:Reproducibility of Results