Memorization and association on a realistic neural model.
A central open question of computational neuroscience is to identify the data structures and algorithms that are used in mammalian cortex to support successive acts of the basic cognitive tasks of memorization and association. This letter addresses the simultaneous challenges of realizing these two distinct tasks with the same data structure, and doing so while respecting the following four basic quantitative parameters of cortex: the neuron number, the synapse number, the synapse strengths, and the switching times. Previous work has not succeeded in reconciling these opposing constraints, the low values of synapse strengths that are typically observed experimentally having contributed a particular obstacle. In this article, we describe a computational scheme that supports both memory formation and association and is feasible on networks of model neurons that respect the widely observed values of the four quantitative parameters. Our scheme allows for both disjoint and shared representations. The algorithms are simple, and in one version both memorization and association require just one step of vicinal or neighborly influence. The issues of interference among the different circuits that are established, of robustness to noise, and of the stability of the hierarchical memorization process are addressed. A calculus therefore is implied for analyzing the capabilities of particular neural systems and subsystems, in terms of their basic numerical parameters.
Valiant
Leslie G
LG
Division of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA. valiant@deas.harvard.edu
D000465:Algorithms; D000818:Animals; D002452:Cell Count; D002540:Cerebral Cortex / Q000166:cytology* / Q000502:physiology; D003198:Computer Simulation; D006801:Humans; D008568:Memory / Q000502:physiology*; D008959:Models, Neurological; D016571:Neural Networks, Computer; D009474:Neurons / Q000502:physiology*; D013569:Synapses / Q000502:physiology; D013997:Time Factors