title: Optimization on machine learning based approaches for sentiment analysis on HPV vaccines related tweets.
abstract: BACKGROUND
  Analysing public opinions on HPV vaccines on social media using machine learning based approaches will help us understand the reasons behind the low vaccine coverage and come up with corresponding strategies to improve vaccine uptake.
  
  
  OBJECTIVE
  To propose a machine learning system that is able to extract comprehensive public sentiment on HPV vaccines on Twitter with satisfying performance.
  
  
  METHODS
  We collected and manually annotated 6,000 HPV vaccines related tweets as a gold standard. SVM model was chosen and a hierarchical classification method was proposed and evaluated. Additional feature sets evaluation and model parameters optimization was done to maximize the machine learning model performance.
  
  
  RESULTS
  A hierarchical classification scheme that contains 10 categories was built to access public opinions toward HPV vaccines comprehensively. A 6,000 annotated tweets gold corpus with Kappa annotation agreement at 0.851 was created and made public available. The hierarchical classification model with optimized feature sets and model parameters has increased the micro-averaging and macro-averaging F score from 0.6732 and 0.3967 to 0.7442 and 0.5883 respectively, compared with baseline model.
  
  
  CONCLUSIONS
  Our work provides a systematical way to improve the machine learning model performance on the highly unbalanced HPV vaccines related tweets corpus. Our system can be further applied on a large tweets corpus to extract large-scale public opinion towards HPV vaccines.
authors.affiliation: The University of Texas School of Biomedical Informatics, 7000 Fannin St Suite 600, Houston, TX, 77030, USA.
authors.forename: Jingcheng
authors.initials: J
authors.lastname: Du
authors.affiliation: The University of Texas School of Biomedical Informatics, 7000 Fannin St Suite 600, Houston, TX, 77030, USA.
authors.forename: Jun
authors.initials: J
authors.lastname: Xu
authors.affiliation: The University of Texas School of Biomedical Informatics, 7000 Fannin St Suite 600, Houston, TX, 77030, USA.
authors.forename: Hsingyi
authors.initials: H
authors.lastname: Song
authors.affiliation: The University of Texas School of Public Health, 1200 Pressler Street, Houston, TX, 77030, USA.
authors.forename: Xiangyu
authors.initials: X
authors.lastname: Liu
authors.affiliation: The University of Texas School of Biomedical Informatics, 7000 Fannin St Suite 600, Houston, TX, 77030, USA. cui.tao@uth.tmc.edu.
authors.forename: Cui
authors.initials: C
authors.lastname: Tao
mesh_terms: D001294:Attitude to Health; D057225:Data Mining; D004644:Emotions; D006801:Humans; D000069550:Machine Learning; D053918:Papillomavirus Vaccines; D061108:Social Media
chemical_list: D053918:Papillomavirus Vaccines
keywords: Gold standard; Hierarchical classification; Sentiment analysis; Social media; Support vector machines; Twitter