dTagger: a POS tagger.
The Lexical Systems Group at the National Library of Medicine (NLM) has developed a Part-of-Speech (POS) tagger to be freely distributed with the SPECIALIST NLP Tools. dTagger is specifically designed for use with the SPECIALIST lexicon but it can be used with an arbitrary tag set. It is capable of single or multi-word chunking. It is trainable with previously annotated text and in development is a version that is tunable with untagged text. The tagger allows users to add local lexicon content. It can report likelihoods for each sentence tagged. New words seen while tagging (the unknowns) are handled by shape identification including heuristics based on suffix statistics gleaned during the training. The performance of the supervised training is noted to be 95% on a modified version of the MedPost hand annotated Medline abstracts. Eight percent of the terms within this corpus were multi-word entities.
Divita
Guy
G
National Library of Medicine, Bethesda, Maryland, USA.
Browne
Allen C
AC
Loane
Russell
R
D000043:Abstracting and Indexing; D000465:Algorithms; D008037:Linguistics; D016239:MEDLINE; D008390:Markov Chains; D009323:Natural Language Processing; D012984:Software; D018875:Vocabulary, Controlled