title: Gesture and metaphor comprehension: electrophysiological evidence of cross-modal coordination by audiovisual stimulation.
abstract: In recent years, studies have suggested that gestures influence comprehension of linguistic expressions, for example, eliciting an N400 component in response to a speech/gesture mismatch. In this paper, we investigate the role of gestural information in the understanding of metaphors. Event related potentials (ERPs) were recorded while participants viewed video clips of an actor uttering metaphorical expressions and producing bodily gestures that were congruent or incongruent with the metaphorical meaning of such expressions. This modality of stimuli presentation allows a more ecological approach to meaning integration. When ERPs were calculated using gesture stroke as time-lock event, gesture incongruity with metaphorical expression modulated the amplitude of the N400 and of the late positive complex (LPC). This suggests that gestural and speech information are combined online to make sense of the interlocutor's linguistic production in an early stage of metaphor comprehension. Our data favor the idea that meaning construction is globally integrative and highly context-sensitive.
authors.affiliation: Escuela de Psicología, Pontificia Universidad Católica de Chile, Av. Vicuña Mackenna 4860, Macul, Santiago, Chile. cca@puc.cl
authors.forename: Carlos
authors.initials: C
authors.lastname: Cornejo
authors.forename: Franco
authors.initials: F
authors.lastname: Simonetti
authors.forename: Agustín
authors.initials: A
authors.lastname: Ibáñez
authors.forename: Nerea
authors.initials: N
authors.lastname: Aldunate
authors.forename: Francisco
authors.initials: F
authors.lastname: Ceric
authors.forename: Vladimir
authors.initials: V
authors.lastname: López
authors.forename: Rafael E
authors.initials: RE
authors.lastname: Núñez
mesh_terms: D000704:Analysis of Variance; D001921:Brain / Q000502:physiology*; D032882:Comprehension / Q000502:physiology*; D004569:Electroencephalography; D004585:Electrooculography; D005071:Evoked Potentials; D005260:Female; D005868:Gestures; D006801:Humans; D008297:Male; D019365:Metaphor; D011578:Psycholinguistics; D011930:Reaction Time; D013647:Task Performance and Analysis; D055815:Young Adult