title: Statistical semantic and clinician confidence analysis for correcting abbreviations and spelling errors in clinical progress notes.
abstract: BACKGROUND
  Progress notes are narrative summaries about the status of patients during the course of treatment or care. Time and efficiency pressures have ensured clinicians' continued preference for unstructured text over entering data in forms when composing progress notes. The ability to extract meaningful data from the unstructured text contained within the notes is invaluable for retrospective analysis and decision support. The automatic extraction of data from unstructured notes, however, has been largely prevented due to the complexity of handling abbreviations, misspelling, punctuation errors and other types of noise.
  
  
  OBJECTIVE
  We present a robust system for cleaning noisy progress notes in real-time, with a focus on abbreviations and misspellings.
  
  
  METHODS
  The system uses statistical semantic analysis based on Web data and the occasional participation of clinicians to automatically replace abbreviations with the actual senses and misspellings with the correct words.
  
  
  RESULTS
  An accuracy of as high as 88.73% was achieved based only on statistical semantic analysis using Web data. The response time of the system with the caching mechanism enabled is 1.5-2s per word which is about the same as the average typing speed of clinicians.
  
  
  CONCLUSIONS
  The overall accuracy and the response time of the system will improve with time, especially when the confidence mechanism is activated through clinicians' interactions with the system. This system will be implemented in a clinical information system to drive interactive decision support and analysis functions leading to improved patient care and outcomes.
authors.affiliation: Centre for Software Practice, University of Western Australia, Crawley, Australia. wilson.wong@rmit.edu.au
authors.forename: Wilson
authors.initials: W
authors.lastname: Wong
authors.forename: David
authors.initials: D
authors.lastname: Glance
mesh_terms: D000004:Abbreviations as Topic; D001185:Artificial Intelligence; D020000:Decision Support Systems, Clinical; D006801:Humans; D008490:Medical Informatics / Q000379:methods*; D016347:Medical Records Systems, Computerized; D015233:Models, Statistical; D033262:Narration; D010363:Pattern Recognition, Automated; D015203:Reproducibility of Results; D012660:Semantics; D013997:Time Factors