title: Mapping and manipulating facial expression.
abstract: Nonverbal visual cues accompany speech to supplement the meaning of spoken words, signify emotional state, indicate position in discourse, and provide back-channel feedback. This visual information includes head movements, facial expressions and body gestures. In this article we describe techniques for manipulating both verbal and nonverbal facial gestures in video sequences of people engaged in conversation. We are developing a system for use in psychological experiments, where the effects of manipulating individual components of nonverbal visual behavior during live face-to-face conversation can be studied. In particular, the techniques we describe operate in real-time at video frame-rate and the manipulation can be applied so both participants in a conversation are kept blind to the experimental conditions.
authors.affiliation: School of Computing Sciences, University of East Anglia, Norwich, UK. bjt@cmp.uea.ac.uk
authors.forename: Barry-John
authors.initials: BJ
authors.lastname: Theobald
authors.forename: Iain
authors.initials: I
authors.lastname: Matthews
authors.forename: Michael
authors.initials: M
authors.lastname: Mangini
authors.forename: Jeffrey R
authors.initials: JR
authors.lastname: Spies
authors.forename: Timothy R
authors.initials: TR
authors.lastname: Brick
authors.forename: Jeffrey F
authors.initials: JF
authors.lastname: Cohn
authors.forename: Steven M
authors.initials: SM
authors.lastname: Boker
mesh_terms: D000465:Algorithms; D005145:Face; D005149:Facial Expression; D005260:Female; D006801:Humans; D007398:Interpersonal Relations; D008297:Male; D008953:Models, Anatomic; D011597:Psychomotor Performance; D013060:Speech; D013997:Time Factors; D014741:Video Recording / Q000379:methods*; D014796:Visual Perception