title: Towards emotion detection in educational scenarios from facial expressions and body movements through multimodal approaches.
abstract: We report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial expression and body movements that conform to changes in the affective states of learners while dealing with cognitive tasks in a learning process. The ultimate goal is to combine these annotations with additional affective information collected during experimental learning sessions from different sources such as qualitative, self-reported, physiological, and behavioral information. These data altogether are to train data mining algorithms that serve to automatically identify changes in the learners' affective states when dealing with cognitive tasks which help to provide emotional personalized support.
authors.affiliation: aDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, Spain.
authors.forename: Mar
authors.initials: M
authors.lastname: Saneiro
authors.affiliation: aDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, Spain.
authors.forename: Olga C
authors.identifier: 0000-0002-9281-4209
authors.initials: OC
authors.lastname: Santos
authors.affiliation: aDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, Spain.
authors.forename: Sergio
authors.initials: S
authors.lastname: Salmeron-Majadas
authors.affiliation: aDeNu Research Group, Artificial Intelligence Department, UNED, Calle Juan del Rosal 16, 28040 Madrid, Spain.
authors.forename: Jesus G
authors.identifier: 0000-0003-4949-9220
authors.initials: JG
authors.lastname: Boticario
mesh_terms: D004493:Education; D004644:Emotions; D005149:Facial Expression; D006801:Humans; D007858:Learning; D009068:Movement