title: Sentiment Analysis of Suicide Notes: A Shared Task.
abstract: This paper reports on a shared task involving the assignment of emotions to suicide notes. Two features distinguished this task from previous shared tasks in the biomedical domain. One is that it resulted in the corpus of fully anonymized clinical text and annotated suicide notes. This resource is permanently available and will (we hope) facilitate future research. The other key feature of the task is that it required categorization with respect to a large set of labels. The number of participants was larger than in any previous biomedical challenge task. We describe the data production process and the evaluation measures, and give a preliminary analysis of the results. Many systems performed at levels approaching the inter-coder agreement, suggesting that human-like performance on this task is within the reach of currently available technologies.
authors.affiliation: Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati OH.
authors.forename: John P
authors.initials: JP
authors.lastname: Pestian
authors.forename: Pawel
authors.initials: P
authors.lastname: Matykiewicz
authors.forename: Michelle
authors.initials: M
authors.lastname: Linn-Gust
authors.forename: Brett
authors.initials: B
authors.lastname: South
authors.forename: Ozlem
authors.initials: O
authors.lastname: Uzuner
authors.forename: Jan
authors.initials: J
authors.lastname: Wiebe
authors.forename: K Bretonnel
authors.initials: KB
authors.lastname: Cohen
authors.forename: John
authors.initials: J
authors.lastname: Hurdle
authors.forename: Christopher
authors.initials: C
authors.lastname: Brew