The sound of motion in spoken language: visual information conveyed by acoustic properties of speech.
Language is generally viewed as conveying information through symbols whose form is arbitrarily related to their meaning. This arbitrary relation is often assumed to also characterize the mental representations underlying language comprehension. We explore the idea that visuo-spatial information can be analogically conveyed through acoustic properties of speech and that such information is integrated into an analog perceptual representation as a natural part of comprehension. Listeners heard sentences describing objects, spoken at varying speaking rates. After each sentence, participants saw a picture of an object and judged whether it had been mentioned in the sentence. Participants were faster to recognize the object when motion implied by speaking rate matched the motion implied by the picture. Results suggest that visuo-spatial referential information can be analogically conveyed and represented.
Shintel
Hadas
H
Department of Psychology and Center for Cognitive and Social Neuroscience, The University of Chicago, Beecher 102, 5848 South University Avenue, Chicago, IL 60637, USA. hadas@uchicago.edu
Nusbaum
Howard C
HC
D006801:Humans; D007802:Language; D013016:Sound; D013060:Speech; D013061:Speech Acoustics; D013067:Speech Perception; D014796:Visual Perception