title: Analyzing the dynamics of emotional scene sequence using recurrent neuro-fuzzy network.
abstract: In this paper, we propose a new framework to analyze the temporal dynamics of the emotional stimuli. For this framework, both electroencephalography signal and visual information are of great importance. The fusion of visual information with brain signals allows us to capture the users' emotional state. Thus we adopt previously proposed fuzzy-GIST as emotional feature to summarize the emotional feedback. In order to model the dynamics of the emotional stimuli sequence, we develop a recurrent neuro-fuzzy network for modeling the dynamic events of emotional dimensions including valence and arousal. It can incorporate human expertise by IF-THEN fuzzy rule while recurrent connections allow the fuzzy rules of network to see its own previous output. The results show that such a framework can interact with human subjects and generate arbitrary emotional sequences after learning the dynamics of an emotional sequence with enough number of samples.
authors.affiliation: China Samsung Telecom R&D Center, Chaoyang District, Beijing, 100-125 China.
authors.forename: Qing
authors.initials: Q
authors.lastname: Zhang
authors.affiliation: School of Electrical Engineering and Computer Science, Kyungpook National University, 1370 Sankyuk-Dong, Puk-Gu, Taegu, 702-701 South Korea.
authors.forename: Minho
authors.initials: M
authors.lastname: Lee
keywords: Dynamics of emotion; Electroencephalography (EEG); Fuzzy-GIST; International affective picture system (IAPS); Recurrent neuro-fuzzy network (RNF)