title: A Quantitative and Qualitative Evaluation of Sentence Boundary Detection for the Clinical Domain.
abstract: Sentence boundary detection (SBD) is a critical preprocessing task for many natural language processing (NLP) applications. However, there has been little work on evaluating how well existing methods for SBD perform in the clinical domain. We evaluate five popular off-the-shelf NLP toolkits on the task of SBD in various kinds of text using a diverse set of corpora, including the GENIA corpus of biomedical abstracts, a corpus of clinical notes used in the 2010 i2b2 shared task, and two general-domain corpora (the British National Corpus and Switchboard). We find that, with the exception of the cTAKES system, the toolkits we evaluate perform noticeably worse on clinical text than on general-domain text. We identify and discuss major classes of errors, and suggest directions for future work to improve SBD methods in the clinical domain. We also make the code used for SBD evaluation in this paper available for download at http://github.com/drgriffis/SBD-Evaluation.
authors: Department of Computer Science and Engineering,; National Institutes of Health, Rehabilitation Medicine Department, Mark O. Hatfield Clinical Research Center, Bethesda, MD.
authors: Denis
authors: D
authors: Griffis
authors: Department of Computer Science and Engineering.
authors: Chaitanya
authors: C
authors: Shivade
authors: Department of Computer Science and Engineering.
authors: Eric
authors: E
authors: Fosler-Lussier
authors: Department of Computer Science and Engineering,; Department of Biomedical Informatics, The Ohio State University, Columbus, OH.; National Institutes of Health, Rehabilitation Medicine Department, Mark O. Hatfield Clinical Research Center, Bethesda, MD.
authors: Albert M
authors: AM
authors: Lai