title: Matching heard and seen speech: An ERP study of audiovisual word recognition.
abstract: Seeing articulatory gestures while listening to speech-in-noise (SIN) significantly improves speech understanding. However, the degree of this improvement varies greatly among individuals. We examined a relationship between two distinct stages of visual articulatory processing and the SIN accuracy by combining a cross-modal repetition priming task with ERP recordings. Participants first heard a word referring to a common object (e.g., pumpkin) and then decided whether the subsequently presented visual silent articulation matched the word they had just heard. Incongruent articulations elicited a significantly enhanced N400, indicative of a mismatch detection at the pre-lexical level. Congruent articulations elicited a significantly larger LPC, indexing articulatory word recognition. Only the N400 difference between incongruent and congruent trials was significantly correlated with individuals' SIN accuracy improvement in the presence of the talker's face.
authors.affiliation: Department of Speech, Language, and Hearing Sciences, Purdue University, 715 Clinic Drive, West Lafayette, IN 47907-2038, United States; Department of Psychological Sciences, Purdue University, 703 Third Street, West Lafayette, IN 47907-2038, United States. Electronic address: kaganovi@purdue.edu.
authors.forename: Natalya
authors.initials: N
authors.lastname: Kaganovich
authors.affiliation: Department of Speech, Language, and Hearing Sciences, Purdue University, 715 Clinic Drive, West Lafayette, IN 47907-2038, United States.
authors.forename: Jennifer
authors.initials: J
authors.lastname: Schumaker
authors.affiliation: Department of Speech, Language, and Hearing Sciences, Purdue University, 715 Clinic Drive, West Lafayette, IN 47907-2038, United States.
authors.forename: Courtney
authors.initials: C
authors.lastname: Rowland
mesh_terms: D000161:Acoustic Stimulation; D032882:Comprehension / Q000502:physiology*; D005071:Evoked Potentials; D005149:Facial Expression; D005260:Female; D005868:Gestures; D006309:Hearing / Q000502:physiology*; D006801:Humans; D008297:Male; D009622:Noise; D010775:Photic Stimulation; D013060:Speech / Q000502:physiology*; D013067:Speech Perception / Q000502:physiology*; D055815:Young Adult