title: Real-world scene representations in high-level visual cortex: it's the spaces more than the places.
abstract: Real-world scenes are incredibly complex and heterogeneous, yet we are able to identify and categorize them effortlessly. In humans, the ventral temporal parahippocampal place area (PPA) has been implicated in scene processing, but scene information is contained in many visual areas, leaving their specific contributions unclear. Although early theories of PPA emphasized its role in spatial processing, more recent reports of its function have emphasized semantic or contextual processing. Here, using functional imaging, we reconstructed the organization of scene representations across human ventral visual cortex by analyzing the distributed response to 96 diverse real-world scenes. We found that, although individual scenes could be decoded in both PPA and early visual cortex (EVC), the structure of representations in these regions was vastly different. In both regions, spatial rather than semantic factors defined the structure of representations. However, in PPA, representations were defined primarily by the spatial factor of expanse (open, closed) and in EVC primarily by distance (near, far). Furthermore, independent behavioral ratings of expanse and distance correlated strongly with representations in PPA and peripheral EVC, respectively. In neither region was content (manmade, natural) a major contributor to the overall organization. Furthermore, the response of PPA could not be used to decode the high-level semantic category of scenes even when spatial factors were held constant, nor could category be decoded across different distances. These findings demonstrate, contrary to recent reports, that the response PPA primarily reflects spatial, not categorical or contextual, aspects of real-world scenes.
authors: Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892, USA. kravitzd@mail.nih.gov
authors: Dwight J
authors: DJ
authors: Kravitz
authors: Cynthia S
authors: CS
authors: Peng
authors: Chris I
authors: CI
authors: Baker
references: Nat Neurosci. 2001 May;4(5):533-9
references: 11319563
references: J Neurosci. 2009 Aug 26;29(34):10638-52
references: 19710316
references: Network. 2003 Aug;14(3):391-412
references: 12938764
references: Cortex. 2002 Dec;38(5):717-25
references: 12507041
references: J Vis. 2010 Jan 08;10(1):2.1-25
references: 20143895
references: Cogn Psychol. 2009 Mar;58(2):137-76
references: 18762289
references: Hippocampus. 2004;14(7):826-35
references: 15382253
references: Front Syst Neurosci. 2008 Nov 24;2:4
references: 19104670
references: Neuron. 1999 May;23(1):115-25
references: 10402198
references: Neuropsychologia. 2003;41(10):1387-95
references: 12757910
references: J Neurosci. 2008 Aug 20;28(34):8539-44
references: 18716212
references: Nat Neurosci. 2010 Apr;13(4):417-8
references: 20208528
references: Nat Neurosci. 2007 Apr;10(4):505-11
references: 17334361
references: Neuroimage. 2010 Oct 15;53(1):103-18
references: 20580933
references: J Neurosci. 2009 Aug 26;29(34):10573-81
references: 19710310
references: J Neurophysiol. 2007 Oct;98(4):2089-98
references: 17652421
references: J Vis. 2008 Jan 11;8(1):4.1-9
references: 18318607
references: Proc Natl Acad Sci U S A. 2006 Mar 7;103(10):3863-8
references: 16537458
references: Nature. 2008 Mar 20;452(7185):352-5
references: 18322462
references: J Exp Psychol Hum Percept Perform. 2007 Oct;33(5):1013-26
references: 17924804
references: Proc Natl Acad Sci U S A. 2008 Mar 18;105(11):4447-52
references: 18326624
references: Neuron. 1998 Aug;21(2):373-83
references: 9728918
references: Neuropsychologia. 2000;38(6):820-36
references: 10689057
references: Nat Rev Neurosci. 2011 Apr;12(4):217-30
references: 21415848
references: Cereb Cortex. 2010 Dec;20(12):2916-25
references: 20351021
references: J Neurosci. 2011 Jan 26;31(4):1333-40
references: 21273418
references: Neuron. 2008 Dec 26;60(6):1126-41
references: 19109916
references: Neuron. 2002 Apr 25;34(3):479-90
references: 11988177
references: Nature. 1998 Apr 9;392(6676):598-601
references: 9560155
references: Cereb Cortex. 2010 Feb;20(2):294-303
references: 19457939
references: J Neurophysiol. 2008 Jul;100(1):249-67
references: 18463186
references: J Neurophysiol. 2007 May;97(5):3670-83
references: 17376855
references: Cereb Cortex. 2007 Jul;17(7):1680-93
references: 16997905
references: J Neurosci. 1997 Jun 1;17(11):4302-11
references: 9151747
references: Neuron. 2003 Mar 6;37(5):865-76
references: 12628176
references: Science. 2001 Sep 28;293(5539):2425-30
references: 11577229
references: Brain Res Cogn Brain Res. 2004 Jun;20(1):37-45
references: 15130587
references: J Vis. 2009 Sep 09;9(10):6.1-16
references: 19810787
references: J Cogn Neurosci. 2008 Mar;20(3):371-88
references: 18004950
references: Nat Neurosci. 2007 Jun;10(6):685-6
references: 17486103
references: Psychol Sci. 2009 Apr;20(4):464-72
references: 19399976
references: Nat Neurosci. 2008 Dec;11(12):1439-45
references: 18978780
references: Neuropsychologia. 2006;44(7):1145-58
references: 16303149
references: Brain. 1999 Sep;122 ( Pt 9):1613-28
references: 10468502
references: Cereb Cortex. 2009 Oct;19(10):2269-80
references: 19176637
references: Nat Rev Neurosci. 2004 Aug;5(8):617-29
references: 15263892
references: Proc Biol Sci. 1996 Dec 22;263(1377):1745-50
references: 9025317
references: Trends Cogn Sci. 2008 Oct;12(10):388-96
references: 18760955
references: Nat Neurosci. 2000 Nov;3(11):1143-8
references: 11036272
references: Exp Brain Res. 2007 May;179(1):75-84
references: 17123070
references: Vision Res. 2007 Dec;47(26):3286-97
references: 17967472
references: Hippocampus. 2007;17(9):873-89
references: 17604348