title: Synaptic encoding of temporal contiguity.
abstract: Often we need to perform tasks in an environment that changes stochastically. In these situations it is important to learn the statistics of sequences of events in order to predict the future and the outcome of our actions. The statistical description of many of these sequences can be reduced to the set of probabilities that a particular event follows another event (temporal contiguity). Under these conditions, it is important to encode and store in our memory these transition probabilities. Here we show that for a large class of synaptic plasticity models, the distribution of synaptic strengths encodes transitions probabilities. Specifically, when the synaptic dynamics depend on pairs of contiguous events and the synapses can remember multiple instances of the transitions, then the average synaptic weights are a monotonic function of the transition probabilities. The synaptic weights converge to the distribution encoding the probabilities also when the correlations between consecutive synaptic modifications are considered. We studied how this distribution depends on the number of synaptic states for a specific model of a multi-state synapse with hard bounds. In the case of bistable synapses, the average synaptic weights are a smooth function of the transition probabilities and the accuracy of the encoding depends on the learning rate. As the number of synaptic states increases, the average synaptic weights become a step function of the transition probabilities. We finally show that the information stored in the synaptic weights can be read out by a simple rate-based neural network. Our study shows that synapses encode transition probabilities under general assumptions and this indicates that temporal contiguity is likely to be encoded and harnessed in almost every neural circuit in the brain.
authors: Department of Neuroscience, Center for Theoretical Neuroscience, Columbia University Medical Center New York, NY, USA ; Department Etudes Cognitives, CNRS, Group for Neural Theory, LNC INSERM U960, Ecole Normale Superieure Paris, France.
authors: Srdjan
authors: S
authors: Ostojic
authors: Stefano
authors: S
authors: Fusi
keywords: Markov processes; forgetting; learning and memory; synaptic plasticity; temporal contiguity
references: Trends Neurosci. 1998 Aug;21(8):317-23
references: 9720595
references: Front Comput Neurosci. 2010 Oct 04;4:24
references: 21048899
references: Nature. 1988 Oct 27;335(6193):817-20
references: 3185711
references: J Neurosci. 1998 Dec 15;18(24):10464-72
references: 9852584
references: Proc Natl Acad Sci U S A. 2001 Mar 27;98(7):4265-70
references: 11259678
references: PLoS Comput Biol. 2007 Nov;3(11):e221
references: 18052535
references: Nature. 2004 Jan 15;427(6971):244-7
references: 14724638
references: Mem Cognit. 1996 Jan;24(1):103-9
references: 8822162
references: Neuron. 2005 Feb 17;45(4):599-611
references: 15721245
references: Neural Comput. 1996 Nov 15;8(8):1677-710
references: 8888613
references: Hippocampus. 1996;6(6):579-90
references: 9034847
references: J Neurosci. 1999 Jul 1;19(13):5493-505
references: 10377358
references: Nat Neurosci. 2010 Mar;13(3):344-52
references: 20098420
references: Neuron. 2007 Apr 19;54(2):319-33
references: 17442251
references: Annu Rev Neurosci. 1988;11:329-52
references: 3284445
references: Proc Natl Acad Sci U S A. 2012 Mar 6;109(10):3991-6
references: 22357758
references: Learn Mem. 1996 Sep-Oct;3(2-3):264-78
references: 10456096
references: Neuroimage. 2010 Sep;52(3):833-47
references: 20100580
references: J Neurosci. 2006 Jan 25;26(4):1314-28
references: 16436619
references: Proc Natl Acad Sci U S A. 2006 Jun 6;103(23):8876-81
references: 16731625
references: Neuron. 2009 Apr 30;62(2):242-53
references: 19409269
references: Nature. 2006 Feb 16;439(7078):865-70
references: 16482160
references: Biol Cybern. 2002 Dec;87(5-6):459-70
references: 12461635
references: Nature. 1991 Nov 14;354(6349):152-5
references: 1944594
references: J Exp Psychol Gen. 1991 Sep;120(3):235-53
references: 1836490
references: Science. 2011 Jan 7;331(6013):83-7
references: 21212356
references: Neuron. 2010 Sep 23;67(6):1062-75
references: 20869601
references: Neural Comput. 2002 Apr;14(4):715-70
references: 11936959
references: Biophys J. 2000 Nov;79(5):2211-21
references: 11053103
references: Neuron. 2001 Dec 20;32(6):1149-64
references: 11754844
references: Proc Natl Acad Sci U S A. 1998 Apr 14;95(8):4732-7
references: 9539807
references: J Neurosci. 2006 Apr 5;26(14):3731-44
references: 16597727
references: J Neurophysiol. 1997 Jul;78(1):393-408
references: 9242288
references: PLoS Comput Biol. 2008 Dec;4(12):e1000248
references: 19112486
references: Neural Comput. 2012 Jun;24(6):1553-68
references: 22364500
references: Proc Natl Acad Sci U S A. 2005 Jul 5;102(27):9679-84
references: 15983385
references: Science. 1997 Jan 10;275(5297):213-5
references: 8985014
references: Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554-8
references: 6953413
references: Nat Neurosci. 2007 Apr;10(4):485-93
references: 17351638
references: Neuron. 2005 May 19;46(4):681-92
references: 15944135
references: Phys Rev Lett. 1986 Dec 1;57(22):2861-2864
references: 10033885
references: J Comput Neurosci. 2001 Jul-Aug;11(1):63-85
references: 11524578
references: Nature. 1984 Nov 8-14;312(5990):101
references: 6504122
references: Science. 2008 Sep 12;321(5895):1502-7
references: 18787171
references: Network. 1998 Feb;9(1):123-52
references: 9861982
references: Eur J Neurosci. 2003 Oct;18(7):2011-24
references: 14622234
references: Nat Neurosci. 2010 Jan;13(1):112-9
references: 20010823
references: Nat Neurosci. 2006 Nov;9(11):1432-8
references: 17057707
references: Neuroscience. 1983 Apr;8(4):791-7
references: 6306504
references: J Neurosci. 1994 Nov;14(11 Pt 1):6435-45
references: 7965048
references: Nat Neurosci. 1998 Aug;1(4):310-7
references: 10195165
references: J Neurophysiol. 2006 Dec;96(6):3147-56
references: 16943310
references: Neuron. 2002 Dec 5;36(5):955-68
references: 12467598