title: An amodal shared resource model of language-mediated visual attention.
abstract: Language-mediated visual attention describes the interaction of two fundamental components of the human cognitive system, language and vision. Within this paper we present an amodal shared resource model of language-mediated visual attention that offers a description of the information and processes involved in this complex multimodal behavior and a potential explanation for how this ability is acquired. We demonstrate that the model is not only sufficient to account for the experimental effects of Visual World Paradigm studies but also that these effects are emergent properties of the architecture of the model itself, rather than requiring separate information processing channels or modular processing systems. The model provides an explicit description of the connection between the modality-specific input from language and vision and the distribution of eye gaze in language-mediated visual attention. The paper concludes by discussing future applications for the model, specifically its potential for investigating the factors driving observed individual differences in language-mediated eye gaze.
authors: Max Planck Institute for Psycholinguistics Nijmegen, Netherlands ; International Max Planck Research School for Language Sciences Nijmegen, Netherlands.
authors: Alastair C
authors: AC
authors: Smith
authors: Padraic
authors: P
authors: Monaghan
authors: Falk
authors: F
authors: Huettig
keywords: attention; computational modeling; eye movements; language; semantics; vision
references: Cognition. 2005 May;96(1):B23-32
references: 15833303
references: Acta Psychol (Amst). 2011 Jun;137(2):181-9
references: 20961519
references: Brain Res. 2010 Dec 13;1365:66-81
references: 20869349
references: Acta Psychol (Amst). 2006 Jan;121(1):65-80
references: 16098943
references: Trends Cogn Sci. 2003 Feb;7(2):84-91
references: 12584027
references: Nature. 1996 Sep 19;383(6597):254-6
references: 8805700
references: J Cogn Neurosci. 2003 May 15;15(4):600-9
references: 12803970
references: Cogn Neuropsychol. 2003 May 1;20(3):451-86
references: 20957580
references: Cogn Neuropsychol. 2008 Mar;25(2):136-64
references: 18568816
references: Front Psychol. 2012 Jan 09;2:394
references: 22291672
references: Cogn Sci. 2011 Aug;35(6):1009-51
references: 21609355
references: Cognition. 2012 Apr;123(1):133-43
references: 22245031
references: Acta Psychol (Amst). 2011 Jun;137(2):151-71
references: 21288498
references: Proc Natl Acad Sci U S A. 2007 Dec 11;104(50):20137-41
references: 18056637
references: J Exp Psychol Gen. 2003 Jun;132(2):163-201
references: 12825636
references: Mem Cognit. 2009 Oct;37(7):1026-39
references: 19744941
references: J Exp Psychol Gen. 2003 Jun;132(2):202-27
references: 12825637
references: Front Psychol. 2011 Oct 28;2:285
references: 22059083
references: Science. 1995 Jun 16;268(5217):1632-4
references: 7777863
references: Proc Natl Acad Sci U S A. 2010 Feb 9;107(6):2717-22
references: 20133780
references: Psychol Bull. 2005 Jan;131(1):3-29
references: 15631549
references: Psychol Rev. 2004 Jan;111(1):205-35
references: 14756594
references: Cogn Psychol. 1986 Jan;18(1):1-86
references: 3753912
references: Cognition. 2009 Mar;110(3):412-31
references: 19135654
references: Dev Psychol. 2013 Jun;49(6):1036-44
references: 22845828
references: Cogn Psychol. 2006 Dec;53(4):310-44
references: 16875685
references: Cogn Sci. 2009 May;33(3):449-96
references: 21585477
references: Psychon Bull Rev. 2005 Jun;12(3):453-9
references: 16235628
references: Psychol Rev. 2008 Apr;115(2):357-95
references: 18426294
references: Cognition. 2011 Feb;118(2):211-33
references: 21093853
references: Cogn Neuropsychol. 2002 Oct 1;19(7):603-39
references: 20957556
references: Ann N Y Acad Sci. 2008 Mar;1124:61-76
references: 18400924
references: J Exp Psychol Learn Mem Cogn. 2000 May;26(3):719-50
references: 10855428
references: Psychol Rev. 2004 Jul;111(3):662-720
references: 15250780
references: Acta Psychol (Amst). 2011 Jun;137(2):138-50
references: 20817134
references: Cognition. 1998 Jan;65(2-3):231-62
references: 9557384
references: J Exp Psychol Learn Mem Cogn. 2006 Jan;32(1):1-14
references: 16478336
references: J Physiol Paris. 2008 Jan-May;102(1-3):59-70
references: 18448316
references: Cognition. 1987 Mar;25(1-2):71-102
references: 3581730
references: Cognition. 2006 Jul;100(3):B32-42
references: 16288732
references: J Acoust Soc Am. 2012 Jan;131(1):509-17
references: 22280612
references: Q J Exp Psychol (Hove). 2007 May;60(5):661-71
references: 17455074
references: Front Psychol. 2012 Mar 08;3:54
references: 22408629
references: Q J Exp Psychol A. 2004 Oct;57(7):1153-71
references: 15513241