title: A phonologically congruent sound boosts a visual target into perceptual awareness.
abstract: Capacity limitations of attentional resources allow only a fraction of sensory inputs to enter our awareness. Most prominently, in the attentional blink the observer often fails to detect the second of two rapidly successive targets that are presented in a sequence of distractor items. To investigate how auditory inputs enable a visual target to escape the attentional blink, this study presented the visual letter targets T1 and T2 together with phonologically congruent or incongruent spoken letter names. First, a congruent relative to an incongruent sound at T2 rendered visual T2 more visible. Second, this T2 congruency effect was amplified when the sound was congruent at T1 as indicated by a T1 congruency × T2 congruency interaction. Critically, these effects were observed both when the sounds were presented in synchrony with and prior to the visual target letters suggesting that the sounds may increase visual target identification via multiple mechanisms such as audiovisual priming or decisional interactions. Our results demonstrate that a sound around the time of T2 increases subjects' awareness of the visual target as a function of T1 and T2 congruency. Consistent with Bayesian causal inference, the brain may thus combine (1) prior congruency expectations based on T1 congruency and (2) phonological congruency cues provided by the audiovisual inputs at T2 to infer whether auditory and visual signals emanate from a common source and should hence be integrated for perceptual decisions.
authors.affiliation: Cognitive Neuroimaging Group, Max Planck Institute for Biological Cybernetics Tuebingen, Germany ; Department of General Psychiatry, Center of Psychosocial Medicine, University of Heidelberg Heidelberg, Germany ; Institute for Stroke and Dementia Research, Ludwig-Maximilian-University Munich, Germany.
authors.forename: Ruth
authors.initials: R
authors.lastname: Adam
authors.affiliation: Cognitive Neuroimaging Group, Max Planck Institute for Biological Cybernetics Tuebingen, Germany ; Department of Psychology, Centre for Computational Neuroscience and Cognitive Robotics, University of Birmingham Birmingham, UK.
authors.forename: Uta
authors.initials: U
authors.lastname: Noppeney
keywords: Bayesian causal inference; attentional blink; audiovisual synchrony; awareness; crossmodal integration; multisensory integration