title: Computer-assisted categorizing of head computed tomography reports for clinical decision rule research.
abstract: OBJECTIVE
  To develop software that categorizes electronic head computed tomography (CT) reports into groups useful for clinical decision rule research.
  
  
  METHODS
  Data were obtained from the Second National Emergency X-Radiography Utilization Study, a cohort of head injury patients having received head CT. CT reports were reviewed manually for presence or absence of clinically important subdural or epidural hematoma, defined as greater than 1.0 cm in width or causing mass effect. Manual categorization was done by 2 independent researchers blinded to each other's results. A third researcher adjudicated discrepancies. A random sample of 300 reports with radiologic abnormalities was selected for software development. After excluding reports categorized manually or by software as indeterminate (neither positive nor negative), we calculated sensitivity and specificity by using manual categorization as the standard. System efficiency was defined as the percentage of reports categorized as positive or negative, regardless of accuracy. Software was refined until analysis of the training data yielded sensitivity and specificity approximating 95% and efficiency exceeding 75%. To test the system, we calculated sensitivity, specificity, and efficiency, using the remaining 1,911 reports.
  
  
  RESULTS
  Of the 1,911 reports, 160 had clinically important subdural or epidural hematoma. The software exhibited good agreement with manual categorization of all reports, including indeterminate ones (weighted kappa 0.62; 95% confidence interval [CI] 0.58 to 0.65). Sensitivity, specificity, and efficiency of the computerized system for identifying manual positives and negatives were 96% (95% CI 91% to 98%), 98% (95% CI 98% to 99%), and 79% (95% CI 77% to 80%), respectively.
  
  
  CONCLUSIONS
  Categorizing head CT reports by computer for clinical decision rule research is feasible.
authors.affiliation: Department of Emergency Medicine, Jacobi Medical Center, Albert Einstein College of Medicine, Bronx, NY 10461, USA. stephen.wall@nbhn.net
authors.forename: Stephen P
authors.initials: SP
authors.lastname: Wall
authors.forename: Oliver
authors.initials: O
authors.lastname: Mayorga
authors.forename: Christine E
authors.initials: CE
authors.lastname: Banfield
authors.forename: Mark E
authors.initials: ME
authors.lastname: Wall
authors.forename: Ilan
authors.initials: I
authors.lastname: Aisic
authors.forename: Carl
authors.initials: C
authors.lastname: Auerbach
authors.forename: Paul
authors.initials: P
authors.lastname: Gennis
mesh_terms: D006801:Humans; D016247:Information Storage and Retrieval; D020198:Intracranial Hemorrhage, Traumatic / Q000000981:diagnostic imaging*; D011873:Radiology Information Systems; D012680:Sensitivity and Specificity; D012984:Software; D014057:Tomography, X-Ray Computed