Auditory-visual perception of speech with reduced optical clarity.
Optical cues for visual and auditory-visual (A-V) perception of speech were varied by placing a sheet of rough-surfaced Plexiglas between talker and lipreader and systematically changing the distance between Plexiglas and talker. This distorts the optical environment in a way that is analogous to masking or filtering in the acoustic domain. In studies with normal-hearing adults and with hearing-impaired children, speech (words, sentences) was presented live under different degrees of optical distortion, and observers attempted to identify the stimuli. Visual-along (lipreading) scores dropped abruptly to the chance level as Plexiglas distance (blurring) was increased. A-V scores were relatively high for clear conditions but diminished gradually as Plexiglas distance (blurring) was increased. Under extremely poor optical conditions, A-V scores reached a plateau. This represents essentially auditory perception without meaningful optical cues for speech. Results parallel those of previous acoustic studies that compared auditory with A-V perception of speech as a function of S/N ratio or sensation level, demonstrating a reciprocal aspect of optical and acoustic cues for speech perception. Optical distortion seems to have potential as an auditory training technique to shift attention of hearing-impaired observers to non-dominant acoustic cues during A-V perception of speech.
D000293:Adolescent; D000328:Adult; D001307:Auditory Perception; D002648:Child; D003463:Cues; D003638:Deafness / Q000523:psychology; D005260:Female; D006801:Humans; D008085:Lipreading; D008722:Methods; D010469:Perceptual Distortion; D013067:Speech Perception; D014796:Visual Perception