title: Portable automatic text classification for adverse drug reaction detection via multi-corpus training.
abstract: OBJECTIVE
  Automatic detection of adverse drug reaction (ADR) mentions from text has recently received significant interest in pharmacovigilance research. Current research focuses on various sources of text-based information, including social media-where enormous amounts of user posted data is available, which have the potential for use in pharmacovigilance if collected and filtered accurately. The aims of this study are: (i) to explore natural language processing (NLP) approaches for generating useful features from text, and utilizing them in optimized machine learning algorithms for automatic classification of ADR assertive text segments; (ii) to present two data sets that we prepared for the task of ADR detection from user posted internet data; and (iii) to investigate if combining training data from distinct corpora can improve automatic classification accuracies.
  
  
  METHODS
  One of our three data sets contains annotated sentences from clinical reports, and the two other data sets, built in-house, consist of annotated posts from social media. Our text classification approach relies on generating a large set of features, representing semantic properties (e.g., sentiment, polarity, and topic), from short text nuggets. Importantly, using our expanded feature sets, we combine training data from different corpora in attempts to boost classification accuracies.
  
  
  RESULTS
  Our feature-rich classification approach performs significantly better than previously published approaches with ADR class F-scores of 0.812 (previously reported best: 0.770), 0.538 and 0.678 for the three data sets. Combining training data from multiple compatible corpora further improves the ADR F-scores for the in-house data sets to 0.597 (improvement of 5.9 units) and 0.704 (improvement of 2.6 units) respectively.
  
  
  CONCLUSIONS
  Our research results indicate that using advanced NLP techniques for generating information rich features from text can significantly improve classification accuracies over existing benchmarks. Our experiments illustrate the benefits of incorporating various semantic features such as topics, concepts, sentiments, and polarities. Finally, we show that integration of information from compatible corpora can significantly improve classification performance. This form of multi-corpus training may be particularly useful in cases where data sets are heavily imbalanced (e.g., social media data), and may reduce the time and costs associated with the annotation of data in the future.
authors.affiliation: Department of Biomedical Informatics, Arizona State University, 13212 East Shea Blvd., Scottsdale, AZ 85259, USA. Electronic address: abeed.sarker@asu.edu.
authors.forename: Abeed
authors.initials: A
authors.lastname: Sarker
authors.affiliation: Department of Biomedical Informatics, Arizona State University, 13212 East Shea Blvd., Scottsdale, AZ 85259, USA. Electronic address: graciela.gonzalez@asu.edu.
authors.forename: Graciela
authors.initials: G
authors.lastname: Gonzalez
mesh_terms: D016907:Adverse Drug Reaction Reporting Systems; D000465:Algorithms; D001185:Artificial Intelligence; D019985:Benchmarking; D003625:Data Collection; D057225:Data Mining / Q000379:methods*; D016208:Databases, Factual; D064420:Drug-Related Side Effects and Adverse Reactions; D001330:Electronic Data Processing; D006801:Humans; D020407:Internet; D009323:Natural Language Processing; D060735:Pharmacovigilance; D015203:Reproducibility of Results; D061108:Social Media
keywords: Adverse drug reaction; Natural language processing; Pharmacovigilance; Social media monitoring; Text classification