A measure for assessing the effects of audiovisual speech integration.
We propose a measure of audiovisual speech integration that takes into account accuracy and response times. This measure should prove beneficial for researchers investigating multisensory speech recognition, since it relates to normal-hearing and aging populations. As an example, age-related sensory decline influences both the rate at which one processes information and the ability to utilize cues from different sensory modalities. Our function assesses integration when both auditory and visual information are available, by comparing performance on these audiovisual trials with theoretical predictions for performance under the assumptions of parallel, independent self-terminating processing of single-modality inputs. We provide example data from an audiovisual identification experiment and discuss applications for measuring audiovisual integration skills across the life span.
Department of Communication Sciences and Disorders, Idaho State University, 921 S. 8th Ave. Stop 8116, Pocatello, ID, 83209, USA, altinich@isu.edu.
Nicholas
N
Altieri
James T
JT
Townsend
Michael J
MJ
Wenger
D000328:Adult; D000368:Aged; D000375:Aging / Q000502:physiology*; D001296:Audiovisual Aids; D003463:Cues; D005260:Female; D006801:Humans; D008875:Middle Aged; D008960:Models, Psychological; D011930:Reaction Time / Q000502:physiology*; D013067:Speech Perception / Q000502:physiology*; D018709:Statistics, Nonparametric; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult