title: On the mental representations originating during the interaction between language and vision.
abstract: The interaction between vision and language processing is clearly of interest to both cognitive psychologists and psycholinguists. Recent research has begun to create understanding of the interaction between vision and language in terms of the representational issues involved. In this paper, we first review some of the theoretical and methodological issues in the current vision-language interaction debate. Later, we develop a model that attempts to account for effects of affordances and visual context on language-scene interaction as well as the role of sensorimotor simulation. The paper addresses theoretical issues related to the mental representations that arise when visual and linguistic systems interact.
authors.affiliation: Centre for Behavioural and Cognitive Science, The University of Allahabad, Psychology building, Allahabad 211002, India. rkmishra@cbcs.ac.in
authors.forename: Ramesh Kumar
authors.initials: RK
authors.lastname: Mishra
authors.forename: Fernando
authors.initials: F
authors.lastname: Marmolejo-Ramos
mesh_terms: D001288:Attention / Q000502:physiology; D003071:Cognition / Q000502:physiology*; D005133:Eye Movements / Q000502:physiology; D006801:Humans; D007802:Language; D014785:Vision, Ocular / Q000502:physiology*; D014796:Visual Perception / Q000502:physiology*
references.citation: Prog Brain Res. 2009;176:277-92
references.pmid: 19733763
references.citation: Cogn Psychol. 2002 Dec;45(4):447-81
references.pmid: 12480476
references.citation: J Exp Psychol Hum Percept Perform. 1978 Nov;4(4):565-72
references.pmid: 722248
references.citation: Psychol Rev. 2006 Oct;113(4):766-86
references.pmid: 17014302
references.citation: Trends Cogn Sci. 2005 Aug;9(8):389-96
references.pmid: 16006171
references.citation: Brain Res. 2007 May 18;1146:2-22
references.pmid: 17045978
references.citation: Open Neuroimag J. 2010 Jul 08;4:46-52
references.pmid: 21379399
references.citation: Vision Res. 2007 Sep;47(21):2714-26
references.pmid: 17614113
references.citation: J Exp Psychol Gen. 2006 Feb;135(1):1-11
references.pmid: 16478313
references.citation: Cognition. 2004 Sep;93(2):B79-87
references.pmid: 15147941
references.citation: Cognition. 2008 Jul;108(1):155-84
references.pmid: 18395705
references.citation: Nat Rev Neurosci. 2001 Mar;2(3):194-203
references.pmid: 11256080
references.citation: J Mem Lang. 2007 Nov;57(4):570-595
references.pmid: 18037980
references.citation: J Vis. 2007 Jan 31;7(1):10
references.pmid: 17461678
references.citation: Trends Cogn Sci. 1999 Jul;3(7):264-271
references.pmid: 10377541
references.citation: Science. 1995 Jun 16;268(5217):1632-4
references.pmid: 7777863
references.citation: Psychon Bull Rev. 2008 Jun;15(3):566-73
references.pmid: 18567256
references.citation: Annu Rev Psychol. 1999;50:243-71
references.pmid: 10074679
references.citation: J Exp Psychol Learn Mem Cogn. 2004 May;30(3):687-96
references.pmid: 15099136
references.citation: Cognition. 2009 Apr;111(1):55-71
references.pmid: 19193366
references.citation: Brain Cogn. 2009 Apr;69(3):481-9
references.pmid: 19046798
references.citation: Psychol Rev. 2008 Oct;115(4):787-835
references.pmid: 18954205
references.citation: Trends Cogn Sci. 2006 May;10(5):227-32
references.pmid: 16603407
references.citation: Cogn Sci. 2006 May 6;30(3):481-529
references.pmid: 21702823
references.citation: Perception. 2005;34(9):1069-82
references.pmid: 16245486
references.citation: J Psycholinguist Res. 1995 Nov;24(6):409-36
references.pmid: 8531168
references.citation: Perception. 2009;38(4):479-91
references.pmid: 19522318
references.citation: Cogn Sci. 2009 Jun;33(4):583-609
references.pmid: 20396405
references.citation: Acta Psychol (Amst). 2006 Jan;121(1):65-80
references.pmid: 16098943
references.citation: Neuropsychologia. 2009 Oct;47(12):2593-9
references.pmid: 19463837
references.citation: Cogn Sci. 2009 May;33(3):449-96
references.pmid: 21585477
references.citation: Cognition. 1999 Dec 17;73(3):247-64
references.pmid: 10585516
references.citation: Psychol Rev. 1970 Mar;77(2):73-99
references.pmid: 5454129
references.citation: Trends Cogn Sci. 2003 Feb;7(2):84-91
references.pmid: 12584027
references.citation: Spat Vis. 2003;16(2):125-54
references.pmid: 12696858
references.citation: Cognition. 2005 Jan;94(3):B79-89
references.pmid: 15617669
references.citation: Psychol Res. 2001 Nov;65(4):235-41
references.pmid: 11789427
references.citation: Proc Natl Acad Sci U S A. 2008 Mar 11;105(10):4004-9
references.pmid: 18316728
references.citation: Neuron. 2004 Jan 22;41(2):301-7
references.pmid: 14741110
references.citation: Trends Cogn Sci. 2007 Aug;11(8):349-55
references.pmid: 17629544
references.citation: Cognition. 1999 Jun 22;71(2):109-47
references.pmid: 10444906
references.citation: Brain Lang. 2010 Mar;112(3):189-201
references.pmid: 19450874
references.citation: Cognition. 2009 Jul;112(1):55-80
references.pmid: 19426968
references.citation: Cogn Psychol. 2007 May;54(3):218-50
references.pmid: 16973144
references.citation: Behav Brain Sci. 1999 Aug;22(4):577-609; discussion 610-60
references.pmid: 11301525
references.citation: Science. 1972 Jul 7;177(4043):77-80
references.pmid: 5041781
references.citation: Cognition. 2009 May;111(2):270-4
references.pmid: 19285660
references.citation: Behav Brain Sci. 2001 Oct;24(5):939-73; discussion 973-1031
references.pmid: 12239892
references.citation: Brain Cogn. 2010 Apr;72(3):394-9
references.pmid: 20031292
references.citation: Cognition. 2007 Jan;102(1):129-38
references.pmid: 16434031
references.citation: Q J Exp Psychol (Hove). 2009 Aug;62(8):1457-506
references.pmid: 19449261
references.citation: Annu Rev Psychol. 2008;59:617-45
references.pmid: 17705682
references.citation: Trends Cogn Sci. 2003 Nov;7(11):498-504
references.pmid: 14585447
references.citation: J Vis. 2009 Mar 13;9(3):6.1-15
references.pmid: 19757945
references.citation: J Exp Psychol Learn Mem Cogn. 2006 Jan;32(1):1-14
references.pmid: 16478336
references.citation: Mem Cognit. 2004 Sep;32(6):863-73
references.pmid: 15673175
references.citation: Cognition. 2005 Feb;95(1):95-127
references.pmid: 15629475
references.citation: Psychol Sci. 2009 Jan;20(1):6-10
references.pmid: 19037907
references.citation: Dev Sci. 2007 Jan;10(1):75-83
references.pmid: 17181703
references.citation: Psychol Bull. 1998 Nov;124(3):372-422
references.pmid: 9849112
references.citation: Curr Biol. 2006 Jan 10;16(1):69-74
references.pmid: 16401424
references.citation: Cogn Psychol. 2009 Mar;58(2):137-76
references.pmid: 18762289
references.citation: Behav Brain Sci. 1997 Mar;20(1):1-19; discussion 19-55
references.pmid: 10096994