title: Integrating existing natural language processing tools for medication extraction from discharge summaries.
abstract: OBJECTIVE
  To develop an automated system to extract medications and related information from discharge summaries as part of the 2009 i2b2 natural language processing (NLP) challenge. This task required accurate recognition of medication name, dosage, mode, frequency, duration, and reason for drug administration.
  
  
  METHODS
  We developed an integrated system using several existing NLP components developed at Vanderbilt University Medical Center, which included MedEx (to extract medication information), SecTag (a section identification system for clinical notes), a sentence splitter, and a spell checker for drug names. Our goal was to achieve good performance with minimal to no specific training for this document corpus; thus, evaluating the portability of those NLP tools beyond their home institution. The integrated system was developed using 17 notes that were annotated by the organizers and evaluated using 251 notes that were annotated by participating teams.
  
  
  METHODS
  The i2b2 challenge used standard measures, including precision, recall, and F-measure, to evaluate the performance of participating systems. There were two ways to determine whether an extracted textual finding is correct or not: exact matching or inexact matching. The overall performance for all six types of medication-related findings across 251 annotated notes was considered as the primary metric in the challenge.
  
  
  RESULTS
  Our system achieved an overall F-measure of 0.821 for exact matching (0.839 precision; 0.803 recall) and 0.822 for inexact matching (0.866 precision; 0.782 recall). The system ranked second out of 20 participating teams on overall performance at extracting medications and related information.
  
  
  CONCLUSIONS
  The results show that the existing MedEx system, together with other NLP components, can extract medication information in clinical text from institutions other than the site of algorithm development with reasonable performance.
authors.affiliation: Department of Biomedical Informatics, Vanderbilt University, School of Medicine, Nashville, TN, USA.
authors.forename: Son
authors.initials: S
authors.lastname: Doan
authors.forename: Lisa
authors.initials: L
authors.lastname: Bastarache
authors.forename: Sergio
authors.initials: S
authors.lastname: Klimkowski
authors.forename: Joshua C
authors.initials: JC
authors.lastname: Denny
authors.forename: Hua
authors.initials: H
authors.lastname: Xu
mesh_terms: D057286:Electronic Health Records; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D010351:Patient Discharge; D004364:Pharmaceutical Preparations; D018511:Systems Integration
chemical_list: D004364:Pharmaceutical Preparations
references.citation: J Am Med Inform Assoc. 2009 Nov-Dec;16(6):806-15
references.pmid: 19717800
references.citation: J Biomed Inform. 2001 Oct;34(5):301-10
references.pmid: 12123149
references.citation: J Am Med Inform Assoc. 2010 Sep-Oct;17(5):519-23
references.pmid: 20819855
references.citation: AMIA Annu Symp Proc. 2008 Nov 06;:237-41
references.pmid: 18999147
references.citation: Pac Symp Biocomput. 2005;:308-18
references.pmid: 15759636
references.citation: Int J Med Inform. 2009 Apr;78(4):284-91
references.pmid: 18838293
references.citation: AMIA Annu Symp Proc. 2007 Oct 11;:908
references.pmid: 18694008
references.citation: J Am Med Inform Assoc. 2010 Sep-Oct;17(5):514-8
references.pmid: 20819854
references.citation: J Am Med Inform Assoc. 2010 Jan-Feb;17(1):19-24
references.pmid: 20064797
references.citation: AMIA Annu Symp Proc. 2007 Oct 11;:438-42
references.pmid: 18693874