title: Visual speech acts differently than lexical context in supporting speech perception.
abstract: The speech signal is often badly articulated, and heard under difficult listening conditions. To deal with these problems, listeners make use of various types of context. In the current study, we examine a type of context that in previous work has been shown to affect how listeners report what they hear: visual speech (i.e., the visible movements of the speaker's articulators). Despite the clear utility of this type of context under certain conditions, prior studies have shown that visually driven phonetic percepts (via the "McGurk" effect) are not "real" enough to affect perception of later-occurring speech; such percepts have not produced selective adaptation effects. This failure contrasts with successful adaptation by sounds that are generated by lexical context-the word that a sound occurs within. We demonstrate here that this dissociation is robust, leading to the conclusion that visual and lexical contexts operate differently. We suggest that the dissociation reflects the dual nature of speech as both a perceptual object and a linguistic object. Visual speech seems to contribute directly to the computations of the perceptual object but not the linguistic one, while lexical context is used in both types of computations.
authors.affiliation: Ikerbasque, Basque Foundation for Science.
authors.forename: Arthur G
authors.initials: AG
authors.lastname: Samuel
authors.affiliation: Department of Psychology, Stony Brook University.
authors.forename: Jerrold
authors.initials: J
authors.lastname: Lieblich
mesh_terms: D000328:Adult; D006801:Humans; D007802:Language; D010700:Phonetics; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*
references.citation: Neuroimage. 2012 Jan 2;59(1):781-7
references.pmid: 21787869
references.citation: J Acoust Soc Am. 1984 Dec;76(6):1652-63
references.pmid: 6520303
references.citation: Psychon Bull Rev. 2010 Aug;17(4):522-8
references.pmid: 20702872
references.citation: J Cogn Neurosci. 2010 Jul;22(7):1583-96
references.pmid: 19583474
references.citation: J Exp Psychol Gen. 1981 Dec;110(4):474-94
references.pmid: 6459403
references.citation: J Acoust Soc Am. 1994 Jun;95(6):3658-61
references.pmid: 8046153
references.citation: Psychol Rev. 1967 Nov;74(6):431-61
references.pmid: 4170865
references.citation: Psychol Sci. 2003 Nov;14(6):592-7
references.pmid: 14629691
references.citation: Cogn Psychol. 1986 Oct;18(4):452-99
references.pmid: 3769426
references.citation: Cogsci. 2011;33:1376-1381
references.pmid: 39399657
references.citation: J Exp Psychol Learn Mem Cogn. 1992 Sep;18(5):915-30
references.pmid: 1402716
references.citation: Percept Psychophys. 1981 Oct;30(4):309-14
references.pmid: 7322807
references.citation: Cogn Psychol. 1997 Mar;32(2):97-127
references.pmid: 9095679
references.citation: Brain Res Cogn Brain Res. 2003 Dec;18(1):65-75
references.pmid: 14659498
references.citation: Behav Brain Sci. 2000 Jun;23(3):299-325; discussion 325-70
references.pmid: 11301575
references.citation: Neuropsychologia. 2007 Feb 1;45(3):572-7
references.pmid: 16530233
references.citation: Percept Psychophys. 1998 Apr;60(3):355-76
references.pmid: 9599989
references.citation: Nature. 1976 Dec 23-30;264(5588):746-8
references.pmid: 1012311
references.citation: Eur J Neurosci. 2004 Oct;20(8):2225-34
references.pmid: 15450102
references.citation: J Exp Psychol Hum Percept Perform. 2001 Oct;27(5):1057-71
references.pmid: 11642695
references.citation: J Exp Psychol Hum Percept Perform. 1980 Feb;6(1):110-25
references.pmid: 6444985
references.citation: J Exp Psychol Hum Percept Perform. 1987 May;13(2):291-9
references.pmid: 2953858
references.citation: Proc Natl Acad Sci U S A. 2005 Jan 25;102(4):1181-6
references.pmid: 15647358
references.citation: J Exp Psychol Hum Percept Perform. 2004 Jun;30(3):445-63
references.pmid: 15161378
references.citation: J Exp Psychol Hum Percept Perform. 2001 Feb;27(1):166-77
references.pmid: 11248931
references.citation: J Exp Psychol Learn Mem Cogn. 1996 Sep;22(5):1166-83
references.pmid: 8926483
references.citation: J Exp Psychol Hum Percept Perform. 1993 Aug;19(4):699-725
references.pmid: 8409855
references.citation: Percept Psychophys. 1989 Jun;45(6):485-93
references.pmid: 2740189
references.citation: Psychol Sci. 2001 Jul;12(4):348-51
references.pmid: 11476105
references.citation: J Cogn Neurosci. 2007 Dec;19(12):1964-73
references.pmid: 17892381
references.citation: J Acoust Soc Am. 1981 Feb;69(2):548-58
references.pmid: 7462477
references.citation: Science. 1970 Jan 23;167(3917):392-3
references.pmid: 5409744