title: Sparseness and expansion in sensory representations.
abstract: In several sensory pathways, input stimuli project to sparsely active downstream populations that have more neurons than incoming axons. Here, we address the computational benefits of expansion and sparseness for clustered inputs, where different clusters represent behaviorally distinct stimuli and intracluster variability represents sensory or neuronal noise. Through analytical calculations and numerical simulations, we show that expansion implemented by feed-forward random synaptic weights amplifies variability in the incoming stimuli, and this noise enhancement increases with sparseness of the expanded representation. In addition, the low dimensionality of the input layer generates overlaps between the induced representations of different stimuli, limiting the benefit of expansion. Highly sparse expansive representations obtained through synapses that encode the clustered structure of the input reduce both intrastimulus variability and the excess overlaps between stimuli, enhancing the ability of downstream neurons to perform classification and recognition tasks. Implications for olfactory, cerebellar, and visual processing are discussed.
authors.affiliation: Swartz Program in Theoretical Neuroscience, Center for Brain Science, Harvard University, Cambridge, MA 02138, USA.
authors.forename: Baktash
authors.initials: B
authors.lastname: Babadi
authors.affiliation: Swartz Program in Theoretical Neuroscience, Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; Edmond and Lily Safra Center for Brain Sciences, Hebrew University, Jerusalem 91904, Israel. Electronic address: haim@fiz.huji.ac.il.
authors.forename: Haim
authors.initials: H
authors.lastname: Sompolinsky
mesh_terms: D000344:Afferent Pathways / Q000502:physiology*; D002540:Cerebral Cortex / Q000166:cytology*; D006801:Humans; D007858:Learning / Q000502:physiology; D008959:Models, Neurological; D009415:Nerve Net / Q000502:physiology*; D009474:Neurons / Q000502:physiology*; D010812:Physical Stimulation; D012677:Sensation / Q000502:physiology*