The interplay of bottom-up and top-down mechanisms in visual guidance during object naming.
An ongoing issue in visual cognition concerns the roles played by low- and high-level information in guiding visual attention, with current research remaining inconclusive about the interaction between the two. In this study, we bring fresh evidence into this long-standing debate by investigating visual saliency and contextual congruency during object naming (Experiment 1), a task in which visual processing interacts with language processing. We then compare the results of this experiment to data of a memorization task using the same stimuli (Experiment 2). In Experiment 1, we find that both saliency and congruency influence visual and naming responses and interact with linguistic factors. In particular, incongruent objects are fixated later and less often than congruent ones. However, saliency is a significant predictor of object naming, with salient objects being named earlier in a trial. Furthermore, the saliency and congruency of a named object interact with the lexical frequency of the associated word and mediate the time-course of fixations at naming. In Experiment 2, we find a similar overall pattern in the eye-movement responses, but only the congruency of the target is a significant predictor, with incongruent targets fixated less often than congruent targets. Crucially, this finding contrasts with claims in the literature that incongruent objects are more informative than congruent objects by deviating from scene context and hence need a longer processing. Overall, this study suggests that different sources of information are interactively used to guide visual attention on the targets to be named and raises new questions for existing theories of visual attention.
a School of Informatics (ILCC) , University of Edinburgh , Edinburgh , UK.
Moreno I
MI
Coco
George L
GL
Malcolm
Frank
F
Keller
D000161:Acoustic Stimulation; D001288:Attention / Q000502:physiology*; D005260:Female; D005403:Fixation, Ocular; D006801:Humans; D016014:Linear Models; D008037:Linguistics; D008297:Male; D009275:Names; D010364:Pattern Recognition, Visual / Q000502:physiology*; D010775:Photic Stimulation; D011930:Reaction Time / Q000502:physiology
Cross-modal processing; Eye movements; Object naming; Scene understanding; Visual guidance.