Automatic analysis of multimodal group actions in meetings.
This paper investigates the recognition of group actions in meetings. A framework is employed in which group actions result from the interactions of the individual participants. The group actions are modeled using different HMM-based approaches, where the observations are provided by a set of audiovisual features monitoring the actions of individuals. Experiments demonstrate the importance of taking interactions into account in modeling the group actions. It is also shown that the visual modality contains useful information, even for predominantly audio-based events, motivating a multimodal approach to meeting analysis.
McCowan
Iain
I
IDIAP Research Institute, Rue du Simplon 4, CP 592, CH-1920 Martigny, Switzerland. mccowan@idiap.ch
Gatica-Perez
Daniel
D
Bengio
Samy
S
Lathoud
Guillaume
G
Barnard
Mark
M
Zhang
Dong
D
D000465:Algorithms; D001185:Artificial Intelligence; D001525:Behavioral Sciences / Q000379:methods*; D016000:Cluster Analysis; D003198:Computer Simulation; D006126:Group Processes; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D008954:Models, Biological; D015233:Models, Statistical; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012919:Social Behavior