title: Feature diagnosticity and task context shape activity in human scene-selective cortex.
abstract: Scenes are constructed from multiple visual features, yet previous research investigating scene processing has often focused on the contributions of single features in isolation. In the real world, features rarely exist independently of one another and likely converge to inform scene identity in unique ways. Here, we utilize fMRI and pattern classification techniques to examine the interactions between task context (i.e., attend to diagnostic global scene features; texture or layout) and high-level scene attributes (content and spatial boundary) to test the novel hypothesis that scene-selective cortex represents multiple visual features, the importance of which varies according to their diagnostic relevance across scene categories and task demands. Our results show for the first time that scene representations are driven by interactions between multiple visual features and high-level scene attributes. Specifically, univariate analysis of scene-selective cortex revealed that task context and feature diagnosticity shape activity differentially across scene categories. Examination using multivariate decoding methods revealed results consistent with univariate findings, but also evidence for an interaction between high-level scene attributes and diagnostic visual features within scene categories. Critically, these findings suggest visual feature representations are not distributed uniformly across scene categories but are shaped by task context and feature diagnosticity. Thus, we propose that scene-selective cortex constructs a flexible representation of the environment by integrating multiple diagnostically relevant visual features, the nature of which varies according to the particular scene being perceived and the goals of the observer.
authors.affiliation: Department of Psychology at Scarborough, University of Toronto, Toronto, ON M1C 1A4, Canada; Department of Psychology at St. George, University of Toronto, Toronto, ON M5S 3G3, Canada. Electronic address: matthew.lowe@mail.utoronto.ca.
authors.forename: Matthew X
authors.initials: MX
authors.lastname: Lowe
authors.affiliation: Centre for Neuroscience Studies, Queen's University, Kingston, ON K7L 3N6, Canada; Department of Psychology, Queen's University, Kingston, ON K7L 3N6, Canada.
authors.forename: Jason P
authors.initials: JP
authors.lastname: Gallivan
authors.affiliation: Department of Psychology at St. George, University of Toronto, Toronto, ON M5S 3G3, Canada; Rotman Research Institute, Baycrest, Toronto, ON M6A 2E1, Canada.
authors.forename: Susanne
authors.initials: S
authors.lastname: Ferber
authors.affiliation: Department of Psychology at Scarborough, University of Toronto, Toronto, ON M1C 1A4, Canada.
authors.forename: Jonathan S
authors.initials: JS
authors.lastname: Cant
mesh_terms: D000328:Adult; D001931:Brain Mapping; D005260:Female; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008279:Magnetic Resonance Imaging; D008297:Male; D010364:Pattern Recognition, Visual / Q000502:physiology*; D014793:Visual Cortex / Q000502:physiology*
keywords: Attention; Feature integration; Layout; Scene recognition; Texture; Ventral visual cortex