title: The McGurk effect: An investigation of attentional capacity employing response times.
abstract: This paper proposes a novel approach to assess audiovisual integration for both congruent and incongruent speech stimuli using reaction times (RT). The experiments are based on the McGurk effect, in which a listener is presented with incongruent audiovisual speech signals. A typical example involves the auditory consonant/b/combined with a visually articulated/g/, often yielding a perception of/d/. We quantify the amount of integration relative to the predictions of a parallel independent model as a function of attention and congruency between auditory and visual signals. We assessed RT distributions for congruent and incongruent auditory and visual signals in a within-subjects signal detection paradigm under conditions of divided versus focused attention. Results showed that listeners often received only minimal benefit from congruent auditory visual stimuli, even when such information could have improved performance. Incongruent stimuli adversely affected performance in divided and focused attention conditions. Our findings support a parallel model of auditory-visual integration with interactions between auditory and visual channels.
authors.affiliation: Department of Communication Sciences and Disorders, Idaho State University, 921 S. 8th Ave., Stop 8116, Pocatello, ID, 83209, USA. altinich@isu.edu.
authors.forename: Nicholas
authors.initials: N
authors.lastname: Altieri
authors.affiliation: Department of Speech and Hearing Sciences, Indiana University, Bloomington, IN, USA.
authors.forename: Jennifer J
authors.initials: JJ
authors.lastname: Lentz
authors.affiliation: Department of Psychological and Brain Sciences, Indiana University, Bloomington, IN, USA.
authors.forename: James T
authors.initials: JT
authors.lastname: Townsend
authors.affiliation: Department of Psychology, The University of Oklahoma, Norman, OK, USA.
authors.forename: Michael J
authors.initials: MJ
authors.lastname: Wenger
mesh_terms: D000161:Acoustic Stimulation / Q000379:methods; D001288:Attention; D005260:Female; D006801:Humans; D008297:Male; D010775:Photic Stimulation / Q000379:methods; D011930:Reaction Time; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: Attention: Selective; Reaction time methods; Speech perception