title: Iconic Gestures Facilitate Discourse Comprehension in Individuals With Superior Immediate Memory for Body Configurations.
abstract: To understand a speaker's gestures, people may draw on kinesthetic working memory (KWM)-a system for temporarily remembering body movements. The present study explored whether sensitivity to gesture meaning was related to differences in KWM capacity. KWM was evaluated through sequences of novel movements that participants viewed and reproduced with their own bodies. Gesture sensitivity was assessed through a priming paradigm. Participants judged whether multimodal utterances containing congruent, incongruent, or no gestures were related to subsequent picture probes depicting the referents of those utterances. Individuals with low KWM were primarily inhibited by incongruent speech-gesture primes, whereas those with high KWM showed facilitation-that is, they were able to identify picture probes more quickly when preceded by congruent speech and gestures than by speech alone. Group differences were most apparent for discourse with weakly congruent speech and gestures. Overall, speech-gesture congruency effects were positively correlated with KWM abilities, which may help listeners match spatial properties of gestures to concepts evoked by speech.
authors.affiliation: Institute for Neural Computation.
authors.forename: Ying Choon
authors.initials: YC
authors.lastname: Wu
authors.affiliation: Department of Cognitive Science, University of California, San Diego coulson@cogsci.ucsd.edu.
authors.forename: Seana
authors.initials: S
authors.lastname: Coulson
mesh_terms: D032882:Comprehension; D005260:Female; D005868:Gestures; D064368:Healthy Volunteers; D006801:Humans; D008297:Male; D008570:Memory, Short-Term; D012660:Semantics; D013067:Speech Perception
keywords: action perception; embodiment; gesture comprehension; grounded cognition; haptic memory; kinesthetic memory; motor resonance; multimodal discourse; working memory