Mapping and manipulating facial expression.
Nonverbal visual cues accompany speech to supplement the meaning of spoken words, signify emotional state, indicate position in discourse, and provide back-channel feedback. This visual information includes head movements, facial expressions and body gestures. In this article we describe techniques for manipulating both verbal and nonverbal facial gestures in video sequences of people engaged in conversation. We are developing a system for use in psychological experiments, where the effects of manipulating individual components of nonverbal visual behavior during live face-to-face conversation can be studied. In particular, the techniques we describe operate in real-time at video frame-rate and the manipulation can be applied so both participants in a conversation are kept blind to the experimental conditions.
Theobald
Barry-John
BJ
School of Computing Sciences, University of East Anglia, Norwich, UK. bjt@cmp.uea.ac.uk
Matthews
Iain
I
Mangini
Michael
M
Spies
Jeffrey R
JR
Brick
Timothy R
TR
Cohn
Jeffrey F
JF
Boker
Steven M
SM
D000465:Algorithms; D005145:Face; D005149:Facial Expression; D005260:Female; D006801:Humans; D007398:Interpersonal Relations; D008297:Male; D008953:Models, Anatomic; D011597:Psychomotor Performance; D013060:Speech; D013997:Time Factors; D014741:Video Recording / Q000379:methods*; D014796:Visual Perception