title: Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports.
abstract: A significant amount of information about drug-related safety issues such as adverse effects are published in medical case reports that can only be explored by human readers due to their unstructured nature. The work presented here aims at generating a systematically annotated corpus that can support the development and validation of methods for the automatic extraction of drug-related adverse effects from medical case reports. The documents are systematically double annotated in various rounds to ensure consistent annotations. The annotated documents are finally harmonized to generate representative consensus annotations. In order to demonstrate an example use case scenario, the corpus was employed to train and validate models for the classification of informative against the non-informative sentences. A Maximum Entropy classifier trained with simple features and evaluated by 10-fold cross-validation resulted in the F₁ score of 0.70 indicating a potential useful application of the corpus.
authors.affiliation: Fraunhofer Institute for Algorithms and Scientific Computing-SCAI, Schloss Birlinghoven, 53754 Sankt Augustin, Germany. harsha.gurulingappa@scai-extern.fraunhofer.de
authors.forename: Harsha
authors.initials: H
authors.lastname: Gurulingappa
authors.forename: Abdul Mateen
authors.initials: AM
authors.lastname: Rajput
authors.forename: Angus
authors.initials: A
authors.lastname: Roberts
authors.forename: Juliane
authors.initials: J
authors.lastname: Fluck
authors.forename: Martin
authors.initials: M
authors.lastname: Hofmann-Apitius
authors.forename: Luca
authors.initials: L
authors.lastname: Toldo
mesh_terms: D001185:Artificial Intelligence; D057225:Data Mining / Q000379:methods*; D016208:Databases, Factual; D004282:Documentation; D064420:Drug-Related Side Effects and Adverse Reactions; D006801:Humans; D039781:PubMed; D015203:Reproducibility of Results; D012660:Semantics