title: Associative memory model with long-tail-distributed Hebbian synaptic connections.
abstract: The postsynaptic potentials of pyramidal neurons have a non-Gaussian amplitude distribution with a heavy tail in both hippocampus and neocortex. Such distributions of synaptic weights were recently shown to generate spontaneous internal noise optimal for spike propagation in recurrent cortical circuits. However, whether this internal noise generation by heavy-tailed weight distributions is possible for and beneficial to other computational functions remains unknown. To clarify this point, we construct an associative memory (AM) network model of spiking neurons that stores multiple memory patterns in a connection matrix with a lognormal weight distribution. In AM networks, non-retrieved memory patterns generate a cross-talk noise that severely disturbs memory recall. We demonstrate that neurons encoding a retrieved memory pattern and those encoding non-retrieved memory patterns have different subthreshold membrane-potential distributions in our model. Consequently, the probability of responding to inputs at strong synapses increases for the encoding neurons, whereas it decreases for the non-encoding neurons. Our results imply that heavy-tailed distributions of connection weights can generate noise useful for AM recall.
authors: Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, The University of Tokyo Kashiwa, Japan ; Laboratory for Neural Circuit Theory, RIKEN Brain Science Institute Wako, Japan.
authors: Naoki
authors: N
authors: Hiratani
authors: Jun-Nosuke
authors: JN
authors: Teramae
authors: Tomoki
authors: T
authors: Fukai
keywords: attractor; hippocampus; integrate-and-fire; mean-field; stochastic resonance; storage capacity
references: Neural Netw. 2001 Jul-Sep;14(6-7):825-34
references: 11665774
references: Phys Rev Lett. 1993 Dec 6;71(23):3886-3889
references: 10055098
references: Proc Natl Acad Sci U S A. 1984 May;81(10):3088-92
references: 6587342
references: PLoS Biol. 2005 Mar;3(3):e68
references: 15737062
references: Neural Comput. 2005 Mar;17(3):691-713
references: 15802011
references: J Neurosci. 1999 Nov 1;19(21):9587-603
references: 10531461
references: Sci Rep. 2012;2:485
references: 22761993
references: Phys Rev Lett. 2012 Apr 13;108(15):158101
references: 22587287
references: Neural Comput. 2004 Dec;16(12):2597-637
references: 15516275
references: Front Comput Neurosci. 2007 Nov 02;1:5
references: 18946527
references: PLoS Comput Biol. 2010 Jun 03;6(6):e1000803
references: 20532199
references: Nature. 2005 Feb 24;433(7028):868-73
references: 15729343
references: PLoS One. 2011;6(10):e25339
references: 22003389
references: Cereb Cortex. 1997 Apr-May;7(3):237-52
references: 9143444
references: J Neurosci. 2011 Nov 9;31(45):16217-26
references: 22072673
references: Neuron. 2009 Jan 29;61(2):301-16
references: 19186171
references: Neuron. 2010 Dec 22;68(6):1043-50
references: 21172607
references: PLoS Comput Biol. 2007 Sep;3(9):1679-700
references: 17845070
references: Phys Rev A Gen Phys. 1985 Aug;32(2):1007-1018
references: 9896156
references: Cereb Cortex. 1997 Sep;7(6):523-33
references: 9276177
references: Neural Comput. 2004 Jul;16(7):1385-412
references: 15165395
references: PLoS Biol. 2005 Nov;3(11):e343
references: 16187794
references: Neural Comput. 2007 Jan;19(1):1-46
references: 17134316
references: Cereb Cortex. 2013 Feb;23(2):293-304
references: 22314044
references: J Neurosci. 2009 Mar 25;29(12):3685-94
references: 19321765
references: Science. 2002 Jul 12;297(5579):211-8
references: 12040087
references: Proc Natl Acad Sci U S A. 2011 Mar 29;108(13):5419-24
references: 21383177
references: Proc Natl Acad Sci U S A. 2005 Jan 18;102(3):880-5
references: 15630093
references: J Physiol. 2003 Aug 15;551(Pt 1):139-53
references: 12813147
references: Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554-8
references: 6953413
references: J Comput Neurosci. 2000 May-Jun;8(3):183-208
references: 10809012
references: J Neurosci. 2004 Sep 29;24(39):8441-53
references: 15456817