Cross-modal noise compensation in audiovisual words.
Perceiving linguistic input is vital for human functioning, but the process is complicated by the fact that the incoming signal is often degraded. However, humans can compensate for unimodal noise by relying on simultaneous sensory input from another modality. Here, we investigated noise-compensation for spoken and printed words in two experiments. In the first behavioral experiment, we observed that accuracy was modulated by reaction time, bias and sensitivity, but noise compensation could nevertheless be explained via accuracy differences when controlling for RT, bias and sensitivity. In the second experiment, we also measured Event Related Potentials (ERPs) and observed robust electrophysiological correlates of noise compensation starting at around 350 ms after stimulus onset, indicating that noise compensation is most prominent at lexical/semantic processing levels.
BCBL. Basque Center on Cognition, Brain and Language, Donostia - San Sebastián, Spain.|Department of Cognitive Neuropsychology, Tilburg University, Tilburg, The Netherlands.
Martijn
M
Baart
BCBL. Basque Center on Cognition, Brain and Language, Donostia - San Sebastián, Spain.|Department of Psychology &Centre for French &Linguistics at Scarborough, University of Toronto, Toronto, Canada.
Blair C
BC
Armstrong
BCBL. Basque Center on Cognition, Brain and Language, Donostia - San Sebastián, Spain.|IKERBASQUE Basque Foundation for Science, Bilbao, Spain.
Clara D
CD
Martin
BCBL. Basque Center on Cognition, Brain and Language, Donostia - San Sebastián, Spain.|Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel.|Haskins Laboratories, New Haven, CT, USA.
Ram
R
Frost
BCBL. Basque Center on Cognition, Brain and Language, Donostia - San Sebastián, Spain.|IKERBASQUE Basque Foundation for Science, Bilbao, Spain.|University of the Basque Country. UPV/EHU, Bilbao, Spain.
Manuel
M
Carreiras
D000161:Acoustic Stimulation / Q000379:methods; D001309:Auditory Threshold / Q000502:physiology*; D001921:Brain / Q000502:physiology; D005071:Evoked Potentials / Q000502:physiology*; D005260:Female; D006801:Humans; D008037:Linguistics; D008297:Male; D009622:Noise; D011930:Reaction Time / Q000502:physiology; D012660:Semantics; D013060:Speech / Q000502:physiology; D013067:Speech Perception / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult