title: Speech misperception: speaking and seeing interfere differently with hearing.
abstract: Speech perception is thought to be linked to speech motor production. This linkage is considered to mediate multimodal aspects of speech perception, such as audio-visual and audio-tactile integration. However, direct coupling between articulatory movement and auditory perception has been little studied. The present study reveals a clear dissociation between the effects of a listener's own speech action and the effects of viewing another's speech movements on the perception of auditory phonemes. We assessed the intelligibility of the syllables [pa], [ta], and [ka] when listeners silently and simultaneously articulated syllables that were congruent/incongruent with the syllables they heard. The intelligibility was compared with a condition where the listeners simultaneously watched another's mouth producing congruent/incongruent syllables, but did not articulate. The intelligibility of [ta] and [ka] were degraded by articulating [ka] and [ta] respectively, which are associated with the same primary articulator (tongue) as the heard syllables. But they were not affected by articulating [pa], which is associated with a different primary articulator (lips) from the heard syllables. In contrast, the intelligibility of [ta] and [ka] was degraded by watching the production of [pa]. These results indicate that the articulatory-induced distortion of speech perception occurs in an articulator-specific manner while visually induced distortion does not. The articulator-specific nature of the auditory-motor interaction in speech perception suggests that speech motor processing directly contributes to our ability to hear speech.
authors.affiliation: NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Atsugi, Japan. mochida.takemi@lab.ntt.co.jp
authors.forename: Takemi
authors.initials: T
authors.lastname: Mochida
authors.forename: Toshitaka
authors.initials: T
authors.lastname: Kimura
authors.forename: Sadao
authors.initials: S
authors.lastname: Hiroya
authors.forename: Norimichi
authors.initials: N
authors.lastname: Kitagawa
authors.forename: Hiroaki
authors.initials: H
authors.lastname: Gomi
authors.forename: Tadahisa
authors.initials: T
authors.lastname: Kondo
mesh_terms: D000161:Acoustic Stimulation; D000293:Adolescent; D000328:Adult; D005260:Female; D006309:Hearing; D006801:Humans; D008297:Male; D010700:Phonetics; D013060:Speech; D013067:Speech Perception; D014796:Visual Perception; D055815:Young Adult