title: Unsupervised biomedical named entity recognition: experiments with clinical and biological texts.
abstract: Named entity recognition is a crucial component of biomedical natural language processing, enabling information extraction and ultimately reasoning over and knowledge discovery from text. Much progress has been made in the design of rule-based and supervised tools, but they are often genre and task dependent. As such, adapting them to different genres of text or identifying new types of entities requires major effort in re-annotation or rule development. In this paper, we propose an unsupervised approach to extracting named entities from biomedical text. We describe a stepwise solution to tackle the challenges of entity boundary detection and entity type classification without relying on any handcrafted rules, heuristics, or annotated data. A noun phrase chunker followed by a filter based on inverse document frequency extracts candidate entities from free text. Classification of candidate entities into categories of interest is carried out by leveraging principles from distributional semantics. Experiments show that our system, especially the entity classification step, yields competitive results on two popular biomedical datasets of clinical notes and biological literature, and outperforms a baseline dictionary match approach. Detailed error analysis provides a road map for future work.
authors: Department of Biomedical Informatics, Columbia University, 622 W. 168th Street, VC-5, New York, NY 10032, USA. Electronic address: shaodian@dbmi.columbia.edu.
authors: Shaodian
authors: S
authors: Zhang
authors: Noémie
authors: N
authors: Elhadad
mesh_terms: D035843:Biomedical Research; D009323:Natural Language Processing; D018875:Vocabulary, Controlled
keywords: Chunking; Distributional semantics; Named entity recognition; Natural language processing; UMLS
references: Bioinformatics. 2001;17 Suppl 1:S74-82
references: 11472995
references: Nucleic Acids Res. 2004 Jan 1;32(Database issue):D267-70
references: 14681409
references: Nat Genet. 2000 May;25(1):25-9
references: 10802651
references: BMC Bioinformatics. 2005;6 Suppl 1:S8
references: 15960842
references: J Biomed Inform. 2011 Apr;44(2):354-60
references: 21056118
references: Genome Biol. 2008;9 Suppl 2:S3
references: 18834494
references: Bioinformatics. 2002 Aug;18(8):1124-32
references: 12176836
references: Genome Inform Ser Workshop Genome Inform. 1998;9:72-80
references: 11072323
references: Stud Health Technol Inform. 2001;84(Pt 1):216-20
references: 11604736
references: Proc AMIA Symp. 2001;:17-21
references: 11825149
references: J Biomed Inform. 2012 Jun;45(3):471-81
references: 22289420
references: Pac Symp Biocomput. 1998;:707-18
references: 9697224
references: J Biomed Inform. 2001 Oct;34(5):301-10
references: 12123149
references: J Am Med Inform Assoc. 2011 Sep-Oct;18(5):552-6
references: 21685143
references: Genome Biol. 2005;6(2):R21
references: 15693950
references: BMC Bioinformatics. 2005;6 Suppl 1:S6
references: 15960840
references: J Am Med Inform Assoc. 2011 Sep-Oct;18(5):557-62
references: 21565856
references: Pac Symp Biocomput. 2000;:517-28
references: 10902199
references: J Biomed Inform. 2009 Apr;42(2):390-405
references: 19232399
references: J Am Med Inform Assoc. 2010 Sep-Oct;17(5):507-13
references: 20819853
references: J Biomed Semantics. 2011 Oct 06;2 Suppl 5:S4
references: 22166723
references: J Biomed Inform. 2012 Jun;45(3):423-8
references: 22239956
references: J Am Med Inform Assoc. 2000 Nov-Dec;7(6):593-604
references: 11062233
references: BMC Bioinformatics. 2005;6 Suppl 1:S1
references: 15960821
references: J Am Med Inform Assoc. 2005 Jul-Aug;12(4):448-57
references: 15802475
references: Bioinformatics. 2003;19 Suppl 1:i180-2
references: 12855455
references: J Am Med Inform Assoc. 1994 Mar-Apr;1(2):161-74
references: 7719797
references: BMC Bioinformatics. 2005;6 Suppl 1:S2
references: 15960832
references: Ann Intern Med. 1995 May 1;122(9):681-8
references: 7702231
references: AMIA Annu Symp Proc. 2005;:525-9
references: 16779095