Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications.
We aim to build and evaluate an open-source natural language processing system for information extraction from electronic medical record clinical free-text. We describe and evaluate our system, the clinical Text Analysis and Knowledge Extraction System (cTAKES), released open-source at http://www.ohnlp.org. The cTAKES builds on existing open-source technologies-the Unstructured Information Management Architecture framework and OpenNLP natural language processing toolkit. Its components, specifically trained for the clinical domain, create rich linguistic and semantic annotations. Performance of individual components: sentence boundary detector accuracy=0.949; tokenizer accuracy=0.949; part-of-speech tagger accuracy=0.936; shallow parser F-score=0.924; named entity recognizer and system-level evaluation F-score=0.715 for exact and 0.824 for overlapping spans, and accuracy for concept mapping, negation, and status attributes for exact and overlapping spans of 0.957, 0.943, 0.859, and 0.580, 0.939, and 0.839, respectively. Overall performance is discussed against five applications. The cTAKES annotations are the foundation for methods and modules for higher-level semantic processing of clinical free-text.
Savova
Guergana K
GK
Mayo Clinic College of Medicine, Rochester, Minnesota, USA. guergana.savova@childrens.harvard.edu
Masanz
James J
JJ
Ogren
Philip V
PV
Zheng
Jiaping
J
Sohn
Sunghwan
S
Kipper-Schuler
Karin C
KC
Chute
Christopher G
CG
D035843:Biomedical Research; D057286:Electronic Health Records; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing
J Comput Biol. 2005 Jun;12(5):554-65
15952878
Proc Annu Symp Comput Appl Med Care. 1995;:284-8
8563286
Yearb Med Inform. 2008;:128-44
18660887
J Am Med Inform Assoc. 2007 Sep-Oct;14(5):641-50
17600099
Methods Inf Med. 1998 Jan;37(1):1-7
9550840
J Am Med Inform Assoc. 2008 Jan-Feb;15(1):14-24
17947624
Proc AMIA Annu Fall Symp. 1997;:595-9
9357695
AMIA Annu Symp Proc. 2009 Nov 14;2009:619-23
20351929
J Biomed Inform. 2003 Dec;36(6):414-32
14759816
Proc AMIA Symp. 2000;:270-4
11079887
J Biomed Inform. 2005 Dec;38(6):422-30
16337567
Proc AMIA Symp. 2000;:17-21
11079836
AMIA Annu Symp Proc. 2005;:156-60
16779021
Bioinformatics. 2005 Jul 15;21(14):3191-2
15860559
Infect Control Hosp Epidemiol. 2003 Dec;24(12):950-4
14700412
J Biomed Inform. 2001 Oct;34(5):301-10
12123149
Stud Health Technol Inform. 2005;116:823-8
16160360
AMIA Annu Symp Proc. 2009 Nov 14;2009:568-72
20351919
J Am Med Inform Assoc. 2009 Jul-Aug;16(4):561-70
19390096
J Digit Imaging. 2010 Apr;23(2):119-32
19484309
J Biomed Inform. 2008 Dec;41(6):1088-100
18375190
Proc AMIA Symp. 1998;:860-4
9929341
J Am Med Inform Assoc. 2000 Nov-Dec;7(6):593-604
11062233
J Am Med Inform Assoc. 2010 May-Jun;17(3):253-64
20442142
J Am Med Inform Assoc. 2008 Jan-Feb;15(1):25-8
17947622
J Am Med Inform Assoc. 2005 May-Jun;12(3):296-8
15684123
J Biomed Inform. 2009 Oct;42(5):937-49
19135551
BMC Med Inform Decis Mak. 2006 Jul 26;6:30
16872495