Accuracy of data collected by surgical residents.
OBJECTIVE
Clinician records are the primary information source for assessing the quality of facial injury care, billing, risk management, planning of health services, and health-system management and reporting. Inaccuracies obscure outcomes assessment and affect the planning of health services. We sought to determine the accuracy of the clinician collected data by comparing them to similar information elicited by professional interviewers.


METHODS
We abstracted admissions data from the medical records of 185 patients treated for orofacial injury between January 2005 and January 2007. Clinician data on sociodemographics and substance use were compared with similar information elicited by trained research staff as part of a prospective study.


RESULTS
The accuracy of the clinician data sets varied considerably depending on the variable. Concordance with the interviewer data sets was highest for age (paired t test P = .09), gender (kappa = 1), and ethnicity (kappa = .84) but dropped off considerably for marital status (kappa = .22) and alcohol (kappa = .18) and drug use (kappa = .16). The missing data per variable ranged from 4.5% (gender) to 46.9% (employment and education).


CONCLUSIONS
Although more research is needed to evaluate the cause of inaccuracies and the relative contributions of patient, provider, and system level effects, it seems that significant inaccuracies in administrative data are common. In particular, patient information collected by surgical residents under-reports substance use behaviors. Interventions aimed at identifying the sources and correcting these errors are necessary.
Shetty
Vivek
V
Section of Oral and Maxillofacial Surgery, University of California at Los Angeles, Los Angeles, CA 90095-1668, USA. vshetty@ucla.edu
Murphy
Debra A
DA
Zigler
Cory
C
Resell
Judith
J
Yamashita
Dennis Duke
DD
D000328:Adult; D003625:Data Collection; D003710:Demography; D005006:Ethnicity; D005260:Female; D054624:Health Status Disparities; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D007407:Interviews as Topic; D015141:Los Angeles; D008297:Male; D008446:Maxillofacial Injuries / Q000601:surgery; D008499:Medical Records / Q000592:standards*; D015588:Observer Variation; D015203:Reproducibility of Results; D012959:Socioeconomic Factors; D019966:Substance-Related Disorders; D013515:Surgery, Oral / Q000193:education