title: Emerging phenomena in neural networks with dynamic synapses and their computational implications.
abstract: In this paper we review our research on the effect and computational role of dynamical synapses on feed-forward and recurrent neural networks. Among others, we report on the appearance of a new class of dynamical memories which result from the destabilization of learned memory attractors. This has important consequences for dynamic information processing allowing the system to sequentially access the information stored in the memories under changing stimuli. Although storage capacity of stable memories also decreases, our study demonstrated the positive effect of synaptic facilitation to recover maximum storage capacity and to enlarge the capacity of the system for memory recall in noisy conditions. Possibly, the new dynamical behavior can be associated with the voltage transitions between up and down states observed in cortical areas in the brain. We investigated the conditions for which the permanence times in the up state are power-law distributed, which is a sign for criticality, and concluded that the experimentally observed large variability of permanence times could be explained as the result of noisy dynamic synapses with large recovery times. Finally, we report how short-term synaptic processes can transmit weak signals throughout more than one frequency range in noisy neural networks, displaying a kind of stochastic multi-resonance. This effect is due to competition between activity-dependent synaptic fluctuations (due to dynamic synapses) and the existence of neuron firing threshold which adapts to the incoming mean synaptic input.
authors: Granada Neurophysics Group at Institute "Carlos I" for Theoretical and Computational Physics, University of Granada Granada, Spain.
authors: Joaquin J
authors: JJ
authors: Torres
authors: Hilbert J
authors: HJ
authors: Kappen
keywords: criticality in up–down cortical transitions; emergence of dynamic memories; memory storage capacity; neural stochastic multiresonances; short-term synaptic plasticity
references: J Comput Neurosci. 2010 Apr;28(2):193-209
references: 19866351
references: Phys Rev A Gen Phys. 1989 Jul 15;40(2):1036-1044
references: 9902229
references: Science. 1997 Jan 10;275(5297):220-4
references: 8985017
references: PLoS Comput Biol. 2007 Feb 23;3(2):e35
references: 17319739
references: Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics. 1999 Aug;60(2 Pt B):2160-70
references: 11970009
references: J R Soc Interface. 2013 Jan 6;10(78):20120558
references: 22977096
references: J Neurosci. 1993 Aug;13(8):3252-65
references: 8340806
references: Nature. 1995 Jun 8;375(6531):493-7
references: 7777058
references: Neural Comput. 1999 Oct 1;11(7):1579-94
references: 10490939
references: Hippocampus. 1996;6(6):591-600
references: 9034848
references: Front Comput Neurosci. 2012 Aug 28;6:64
references: 22973221
references: PLoS One. 2011 Mar 08;6(3):e17255
references: 21408148
references: Neural Comput. 1998 May 15;10(4):815-9
references: 9573406
references: Neural Netw. 2007 Mar;20(2):230-5
references: 17196366
references: Phys Rev E Stat Nonlin Soft Matter Phys. 2002 Dec;66(6 Pt 1):061910
references: 12513321
references: Neural Comput. 2002 Dec;14(12):2903-23
references: 12487797
references: Nature. 1996 Aug 29;382(6594):807-10
references: 8752273
references: J Neurosci. 2000 Jan 1;20(1):RC50
references: 10627627
references: Annu Rev Neurosci. 1989;12:13-31
references: 2648947
references: Science. 2008 Mar 14;319(5869):1543-6
references: 18339943
references: Phys Rev Lett. 2009 Mar 20;102(11):118110
references: 19392248
references: PLoS One. 2012;7(12):e51170
references: 23272090
references: J Neurosci. 2003 Apr 15;23(8):3186-95
references: 12716926
references: Annu Rev Physiol. 2002;64:355-405
references: 11826273
references: Phys Rev Lett. 1991 Jul 29;67(5):656-659
references: 10044954
references: PLoS One. 2010 Nov 08;5(11):e13651
references: 21079740
references: Neural Comput. 1998 May 15;10(4):821-35
references: 9573407
references: Neural Comput. 2009 Mar;21(3):851-71
references: 18928372
references: Science. 1993 Oct 29;262(5134):679-85
references: 8235588
references: Proc Natl Acad Sci U S A. 1982 Apr;79(8):2554-8
references: 6953413
references: Network. 2002 Feb;13(1):115-29
references: 11873841
references: Front Physiol. 2012 Feb 08;3:15
references: 22347863
references: Neural Comput. 2007 Oct;19(10):2739-55
references: 17716010
references: Proc Natl Acad Sci U S A. 1998 Apr 28;95(9):5323-8
references: 9560274
references: PLoS One. 2012;7(8):e40710
references: 22879879
references: Proc Natl Acad Sci U S A. 1997 Jan 21;94(2):719-23
references: 9012851
references: J Neurophysiol. 2003 May;89(5):2707-25
references: 12612051
references: Network. 2001 Feb;12(1):75-87
references: 11254083
references: Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics. 1995 Oct;52(4):R3321-R3324
references: 9963950
references: J Neurophysiol. 1996 May;75(5):1919-31
references: 8734591
references: Phys Rev Lett. 2008 Mar 21;100(11):118103
references: 18517832
references: PLoS Comput Biol. 2006 Mar;2(3):e23
references: 16557293
references: Neural Comput. 2006 Mar;18(3):614-33
references: 16483410
references: Nat Phys. 2010 Oct;6(10):801-805
references: 21804861
references: J Neurosci. 2003 Dec 3;23(35):11167-77
references: 14657176