Integrating existing natural language processing tools for medication extraction from discharge summaries.
OBJECTIVE
To develop an automated system to extract medications and related information from discharge summaries as part of the 2009 i2b2 natural language processing (NLP) challenge. This task required accurate recognition of medication name, dosage, mode, frequency, duration, and reason for drug administration.


METHODS
We developed an integrated system using several existing NLP components developed at Vanderbilt University Medical Center, which included MedEx (to extract medication information), SecTag (a section identification system for clinical notes), a sentence splitter, and a spell checker for drug names. Our goal was to achieve good performance with minimal to no specific training for this document corpus; thus, evaluating the portability of those NLP tools beyond their home institution. The integrated system was developed using 17 notes that were annotated by the organizers and evaluated using 251 notes that were annotated by participating teams.


METHODS
The i2b2 challenge used standard measures, including precision, recall, and F-measure, to evaluate the performance of participating systems. There were two ways to determine whether an extracted textual finding is correct or not: exact matching or inexact matching. The overall performance for all six types of medication-related findings across 251 annotated notes was considered as the primary metric in the challenge.


RESULTS
Our system achieved an overall F-measure of 0.821 for exact matching (0.839 precision; 0.803 recall) and 0.822 for inexact matching (0.866 precision; 0.782 recall). The system ranked second out of 20 participating teams on overall performance at extracting medications and related information.


CONCLUSIONS
The results show that the existing MedEx system, together with other NLP components, can extract medication information in clinical text from institutions other than the site of algorithm development with reasonable performance.
Doan
Son
S
Department of Biomedical Informatics, Vanderbilt University, School of Medicine, Nashville, TN, USA.
Bastarache
Lisa
L
Klimkowski
Sergio
S
Denny
Joshua C
JC
Xu
Hua
H
D057286:Electronic Health Records; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D010351:Patient Discharge; D004364:Pharmaceutical Preparations; D018511:Systems Integration
D004364:Pharmaceutical Preparations
J Am Med Inform Assoc. 2009 Nov-Dec;16(6):806-15
19717800
J Biomed Inform. 2001 Oct;34(5):301-10
12123149
J Am Med Inform Assoc. 2010 Sep-Oct;17(5):519-23
20819855
AMIA Annu Symp Proc. 2008 Nov 06;:237-41
18999147
Pac Symp Biocomput. 2005;:308-18
15759636
Int J Med Inform. 2009 Apr;78(4):284-91
18838293
AMIA Annu Symp Proc. 2007 Oct 11;:908
18694008
J Am Med Inform Assoc. 2010 Sep-Oct;17(5):514-8
20819854
J Am Med Inform Assoc. 2010 Jan-Feb;17(1):19-24
20064797
AMIA Annu Symp Proc. 2007 Oct 11;:438-42
18693874