title: Prediction of advertisement preference by fusing EEG response and sentiment analysis.
abstract: This paper presents a novel approach to predict rating of video-advertisements based on a multimodal framework combining physiological analysis of the user and global sentiment-rating available on the internet. We have fused Electroencephalogram (EEG) waves of user and corresponding global textual comments of the video to understand the user's preference more precisely. In our framework, the users were asked to watch the video-advertisement and simultaneously EEG signals were recorded. Valence scores were obtained using self-report for each video. A higher valence corresponds to intrinsic attractiveness of the user. Furthermore, the multimedia data that comprised of the comments posted by global viewers, were retrieved and processed using Natural Language Processing (NLP) technique for sentiment analysis. Textual contents from review comments were analyzed to obtain a score to understand sentiment nature of the video. A regression technique based on Random forest was used to predict the rating of an advertisement using EEG data. Finally, EEG based rating is combined with NLP-based sentiment score to improve the overall prediction. The study was carried out using 15 video clips of advertisements available online. Twenty five participants were involved in our study to analyze our proposed system. The results are encouraging and these suggest that the proposed multimodal approach can achieve lower RMSE in rating prediction as compared to the prediction using only EEG data.
authors.affiliation: Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India. Electronic address: gauba.himanshu@gmail.com.
authors.forename: Himaanshu
authors.initials: H
authors.lastname: Gauba
authors.affiliation: Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India.
authors.forename: Pradeep
authors.initials: P
authors.lastname: Kumar
authors.affiliation: Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India.
authors.forename: Partha Pratim
authors.initials: PP
authors.lastname: Roy
authors.affiliation: Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India.
authors.forename: Priyanka
authors.initials: P
authors.lastname: Singh
authors.affiliation: School of Electrical Sciences, Indian Institute of Technology, Bhubaneswar, India.
authors.forename: Debi Prosad
authors.initials: DP
authors.lastname: Dogra
authors.affiliation: Department of Computer Science and Engineering, Indian Institute of Technology, Roorkee, India.
authors.forename: Balasubramanian
authors.initials: B
authors.lastname: Raman
mesh_terms: D000329:Advertising; D001921:Brain / Q000502:physiology*; D003258:Consumer Behavior; D004569:Electroencephalography / Q000379:methods*; D006801:Humans; D020407:Internet; D008959:Models, Neurological; D009323:Natural Language Processing
keywords: EEG signal analysis; Multimedia indexing and retrieval; Multimodal rating; Predictive modeling; Sentiment analysis