title: Semantic annotation of clinical events for generating a problem list.
abstract: We present a pilot study of an annotation schema representing problems and their attributes, along with their relationship to temporal modifiers. We evaluated the ability for humans to annotate clinical reports using the schema and assessed the contribution of semantic annotations in determining the status of a problem mention as active, inactive, proposed, resolved, negated, or other. Our hypothesis is that the schema captures semantic information useful for generating an accurate problem list. Clinical named entities such as reference events, time points, time durations, aspectual phase, ordering words and their relationships including modifications and ordering relations can be annotated by humans with low to moderate recall. Once identified, most attributes can be annotated with low to moderate agreement. Some attributes - Experiencer, Existence, and Certainty - are more informative than other attributes - Intermittency and Generalized/Conditional - for predicting a problem mention's status. Support vector machine outperformed Naïve Bayes and Decision Tree for predicting a problem's status.
authors.affiliation: University of Pittsburgh, Pittsburgh, PA;
authors.forename: Danielle L
authors.initials: DL
authors.lastname: Mowery
authors.affiliation: University of Pittsburgh, Pittsburgh, PA;
authors.forename: Pamela
authors.initials: P
authors.lastname: Jordan
authors.affiliation: University of Pittsburgh, Pittsburgh, PA;
authors.forename: Janyce
authors.initials: J
authors.lastname: Wiebe
authors.affiliation: University of Pittsburgh, Pittsburgh, PA;
authors.forename: Henk
authors.initials: H
authors.lastname: Harkema
authors.affiliation: University of Pittsburgh, Pittsburgh, PA;
authors.forename: John
authors.initials: J
authors.lastname: Dowling
authors.affiliation: University of California, San Diego, La Jolla, CA.
authors.forename: Wendy W
authors.initials: WW
authors.lastname: Chapman
mesh_terms: D057286:Electronic Health Records; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D010865:Pilot Projects; D012660:Semantics