Textractor: a hybrid system for medications and reason for their prescription extraction from clinical text documents.
OBJECTIVE To describe a new medication information extraction system-Textractor-developed for the 'i2b2 medication extraction challenge'. The development, functionalities, and official evaluation of the system are detailed.


METHODS
Textractor is based on the Apache Unstructured Information Management Architecture (UMIA) framework, and uses methods that are a hybrid between machine learning and pattern matching. Two modules in the system are based on machine learning algorithms, while other modules use regular expressions, rules, and dictionaries, and one module embeds MetaMap Transfer.


METHODS
The official evaluation was based on a reference standard of 251 discharge summaries annotated by all teams participating in the challenge. The metrics used were recall, precision, and the F(1)-measure. They were calculated with exact and inexact matches, and were averaged at the level of systems and documents.


RESULTS
The reference metric for this challenge, the system-level overall F(1)-measure, reached about 77% for exact matches, with a recall of 72% and a precision of 83%. Performance was the best with route information (F(1)-measure about 86%), and was good for dosage and frequency information, with F(1)-measures of about 82-85%. Results were not as good for durations, with F(1)-measures of 36-39%, and for reasons, with F(1)-measures of 24-27%.


CONCLUSIONS
The official evaluation of Textractor for the i2b2 medication extraction challenge demonstrated satisfactory performance. This system was among the 10 best performing systems in this challenge.
Meystre
Stéphane M
SM
Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA. stephane.meystre@hsc.utah.edu
Thibault
Julien
J
Shen
Shuying
S
Hurdle
John F
JF
South
Brett R
BR
D001185:Artificial Intelligence; D057286:Electronic Health Records; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated; D004364:Pharmaceutical Preparations
D004364:Pharmaceutical Preparations
AMIA Annu Symp Proc. 2007 Oct 11;:625-9
18693911
BMC Bioinformatics. 2009 Sep 17;10 Suppl 9:S12
19761566
BMJ. 2000 Mar 18;320(7237):759-63
10720361
J Biomed Inform. 2006 Dec;39(6):589-99
16359928
Yearb Med Inform. 2008;:128-44
18660887
Proc Annu Symp Comput Appl Med Care. 1994;:1065
7949900
J Am Med Inform Assoc. 2010 Sep-Oct;17(5):514-8
20819854
J Am Med Rec Assoc. 1990 May;61(5):40-2
10104531