title: Visual information representation and rapid-scene categorization are simultaneous across cortex: An MEG study.
abstract: Perceiving the visual world around us requires the brain to represent the features of stimuli and to categorize the stimulus based on these features. Incorrect categorization can result either from errors in visual representation or from errors in processes that lead to categorical choice. To understand the temporal relationship between the neural signatures of such systematic errors, we recorded whole-scalp magnetoencephalography (MEG) data from human subjects performing a rapid-scene categorization task. We built scene category decoders based on (1) spatiotemporally resolved neural activity, (2) spatial envelope (SpEn) image features, and (3) behavioral responses. Using confusion matrices, we tracked how well the pattern of errors from neural decoders could be explained by SpEn decoders and behavioral errors, over time and across cortical areas. Across the visual cortex and the medial temporal lobe, we found that both SpEn and behavioral errors explained unique variance in the errors of neural decoders. Critically, these effects were nearly simultaneous, and most prominent between 100 and 250ms after stimulus onset. Thus, during rapid-scene categorization, neural processes that ultimately result in behavioral categorization are simultaneous and co-localized with neural processes underlying visual information representation.
authors.affiliation: Brain Research Unit, O.V. Lounasmaa Laboratory, Aalto University School of Science, Espoo, Finland. Electronic address: pavan.ramkumar@northwestern.edu.
authors.forename: Pavan
authors.initials: P
authors.lastname: Ramkumar
authors.affiliation: Department of Psychology and Neuroscience Program, Colgate University, Hamilton, NY, USA. Electronic address: bchansen@colgate.edu.
authors.forename: Bruce C
authors.initials: BC
authors.lastname: Hansen
authors.affiliation: Brain Research Unit, O.V. Lounasmaa Laboratory, Aalto University School of Science, Espoo, Finland; Department of Psychology, Technische Universtät Dresden, Dresden, Germany. Electronic address: Sebastian.Pannasch@tu-dresden.de.
authors.forename: Sebastian
authors.initials: S
authors.lastname: Pannasch
authors.affiliation: Department of Psychological Sciences, Kansas State University, Manhattan, KS, USA. Electronic address: loschky@ksu.edu.
authors.forename: Lester C
authors.initials: LC
authors.lastname: Loschky
mesh_terms: D000328:Adult; D001931:Brain Mapping / Q000379:methods*; D002540:Cerebral Cortex / Q000502:physiology*; D005260:Female; D006801:Humans; D015225:Magnetoencephalography / Q000379:methods*; D008297:Male; D009415:Nerve Net / Q000502:physiology; D010364:Pattern Recognition, Visual / Q000502:physiology*; D011930:Reaction Time / Q000502:physiology; D021641:Recognition, Psychology / Q000502:physiology*; D013647:Task Performance and Analysis
keywords: Confusion matrices; MEG; Multiple linear regression; Multivariate decoding; Scene gist; Spatial envelope; Timing of visual perception