title: The Role of Report Comparison, Analysis, and Discrepancy Categorization in Resident Education.
abstract: OBJECTIVE
  The purpose of this study was to show the value of automated radiology report comparison and analysis in resident education by providing qualitative and quantitative feedback on the discrepancies between preliminary and finalized reports.
  
  
  METHODS
  Anonymous surveys on dictation practices and the process of reviewing reports were completed by consenting radiology residents and faculty. All 277 reports obtained across all modalities during the 4-week study were retrieved from the dictation server in both their preliminary and finalized states, for a total of 544 reports. Disparities between these reports were automatically compared side by side and were categorized according to clinical relevance, report quality, or report structure. The frequency of report corrections was compared between junior (postgraduate years [PGYs] 2 and 3) and senior (PGYs 4 and 5) residents. Residents were surveyed regarding the usefulness of the feedback.
  
  
  RESULTS
  Eighty-six reports (31%) were verified as unchanged, with no statistically significant difference noted between junior and senior residents (33.2% and 25.9%, respectively; p = 0.03). Of the 370 discrepancies noted in the 191 edited reports, 81 (21.9%) were discrepancies in clinically relevant findings; 106 (28.6%) were discrepancies in report quality; and 183 (49.5%) were discrepancies in report structure, syntax, or both. Although senior residents had a lower rate of discrepancies in the clinical relevance category than did junior residents (12.8% and 26.5%; p = 0.004), they had a higher rate of discrepancies in the report quality category (58.4% and 44.9%; p = 0.02). Surveys of both residents and faculty showed strong support for the project.
  
  
  CONCLUSIONS
  Categorization of corrections was deemed useful by residents and can be helpful in assessing elements of reporting accuracy for individual feedback. Quantitative report comparison and analysis show promise in tailoring resident education at the programmatic level as cumulative data are gathered and trends are analyzed.
authors.affiliation: 1 All authors: Department of Diagnostic Radiology and Biomedical Imaging, Yale University School of Medicine, 333 Cedar St, New Haven, CT 06520-8042.
authors.forename: Abraham A
authors.initials: AA
authors.lastname: Harari
authors.affiliation: 1 All authors: Department of Diagnostic Radiology and Biomedical Imaging, Yale University School of Medicine, 333 Cedar St, New Haven, CT 06520-8042.
authors.forename: Marcus B
authors.initials: MB
authors.lastname: Conti
authors.affiliation: 1 All authors: Department of Diagnostic Radiology and Biomedical Imaging, Yale University School of Medicine, 333 Cedar St, New Haven, CT 06520-8042.
authors.forename: S A Jamal
authors.initials: SA
authors.lastname: Bokhari
authors.affiliation: 1 All authors: Department of Diagnostic Radiology and Biomedical Imaging, Yale University School of Medicine, 333 Cedar St, New Haven, CT 06520-8042.
authors.forename: Lawrence H
authors.initials: LH
authors.lastname: Staib
authors.affiliation: 1 All authors: Department of Diagnostic Radiology and Biomedical Imaging, Yale University School of Medicine, 333 Cedar St, New Haven, CT 06520-8042.
authors.forename: Caroline R
authors.initials: CR
authors.lastname: Taylor
mesh_terms: D003237:Connecticut; D000068598:Data Accuracy; D003951:Diagnostic Errors / Q000517:prevention & control / Q000706:statistics & numerical data*; D004282:Documentation / Q000145:classification / Q000706:statistics & numerical data*; D057286:Electronic Health Records / Q000145:classification / Q000706:statistics & numerical data*; D007396:Internship and Residency / Q000458:organization & administration*; D009323:Natural Language Processing; D011871:Radiology / Q000193:education*; D011873:Radiology Information Systems / Q000145:classification / Q000706:statistics & numerical data*; D013663:Teaching
keywords: radiology report feedback; report comparison and analysis; reporting feedback; resident education