title: Neural dynamics as sampling: a model for stochastic computation in recurrent networks of spiking neurons.
abstract: The organization of computations in networks of spiking neurons in the brain is still largely unknown, in particular in view of the inherently stochastic features of their firing activity and the experimentally observed trial-to-trial variability of neural systems in the brain. In principle there exists a powerful computational framework for stochastic computations, probabilistic inference by sampling, which can explain a large number of macroscopic experimental data in neuroscience and cognitive science. But it has turned out to be surprisingly difficult to create a link between these abstract models for stochastic computations and more detailed models of the dynamics of networks of spiking neurons. Here we create such a link and show that under some conditions the stochastic firing activity of networks of spiking neurons can be interpreted as probabilistic inference via Markov chain Monte Carlo (MCMC) sampling. Since common methods for MCMC sampling in distributed systems, such as Gibbs sampling, are inconsistent with the dynamics of spiking neurons, we introduce a different approach based on non-reversible Markov chains that is able to reflect inherent temporal processes of spiking neuronal activity through a suitable choice of random variables. We propose a neural network model and show by a rigorous theoretical analysis that its neural activity implements MCMC sampling of a given distribution, both for the case of discrete and continuous time. This provides a step towards closing the gap between abstract functional models of cortical computation and more detailed models of networks of spiking neurons.
authors.affiliation: Institute for Theoretical Computer Science, Graz University of Technology, Graz, Austria. lars@gatsby.ucl.ac.uk
authors.forename: Lars
authors.initials: L
authors.lastname: Buesing
authors.forename: Johannes
authors.initials: J
authors.lastname: Bill
authors.forename: Bernhard
authors.initials: B
authors.lastname: Nessler
authors.forename: Wolfgang
authors.initials: W
authors.lastname: Maass
mesh_terms: D000200:Action Potentials / Q000502:physiology*; D000465:Algorithms; D000818:Animals; D003198:Computer Simulation; D006801:Humans; D008390:Markov Chains; D008959:Models, Neurological; D009010:Monte Carlo Method; D009474:Neurons / Q000502:physiology*; D011323:Primates; D013269:Stochastic Processes
references.citation: J Neurosci. 1993 Jan;13(1):334-50
references.pmid: 8423479
references.citation: Front Syst Neurosci. 2010 Jun 23;4:20
references.pmid: 20631840
references.citation: J Vis. 2008 May 23;8(5):12.1-19
references.pmid: 18842083
references.citation: Trends Cogn Sci. 2010 Mar;14(3):119-30
references.pmid: 20153683
references.citation: Philos Trans R Soc Lond B Biol Sci. 2010 Jan 12;365(1537):177-84
references.pmid: 20008395
references.citation: IEEE Trans Pattern Anal Mach Intell. 1984 Jun;6(6):721-41
references.pmid: 22499653
references.citation: J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1434-48
references.pmid: 12868647
references.citation: Curr Opin Neurobiol. 2009 Aug;19(4):439-44
references.pmid: 19647992
references.citation: Biol Cybern. 2010 Mar;102(3):227-60
references.pmid: 20148260
references.citation: Neural Comput. 2006 Jul;18(7):1527-54
references.pmid: 16764513
references.citation: J Neurosci Res. 2010 Nov 1;88(14):2991-3001
references.pmid: 20544831
references.citation: PLoS Comput Biol. 2009 Jul;5(7):e1000433
references.pmid: 19593378
references.citation: J Physiol Paris. 2009 Jan-Mar;103(1-2):98-106
references.pmid: 19501650
references.citation: Nature. 2003 Oct 30;425(6961):954-6
references.pmid: 14586468
references.citation: Neural Comput. 2009 Sep;21(9):2502-23
references.pmid: 19548806
references.citation: Dev Sci. 2007 May;10(3):281-7
references.pmid: 17444969
references.citation: Prog Neurobiol. 2009 May;88(1):1-16
references.pmid: 19428958
references.citation: Trends Cogn Sci. 2006 Jul;10(7):309-18
references.pmid: 16797219
references.citation: Nat Neurosci. 2010 Mar;13(3):369-78
references.pmid: 20173745
references.citation: Behav Brain Sci. 2009 Feb;32(1):69-84; discussion 85-120
references.pmid: 19210833
references.citation: Science. 2011 Jan 7;331(6013):83-7
references.pmid: 21212356
references.citation: Annu Rev Psychol. 2004;55:271-304
references.pmid: 14744217
references.citation: Nature. 2007 Jun 28;447(7148):1075-80
references.pmid: 17546027
references.citation: J Vis. 2010 Oct 01;10(12):3
references.pmid: 21047735
references.citation: Nature. 2004 Jan 15;427(6971):244-7
references.pmid: 14724638
references.citation: Nature. 2004 Sep 30;431(7008):573-8
references.pmid: 15457262
references.citation: Nature. 2008 Aug 21;454(7207):995-9
references.pmid: 18650810
references.citation: Neural Comput. 2002 Aug;14(8):1771-800
references.pmid: 12180402
references.citation: Psychol Sci. 2006 Sep;17(9):767-73
references.pmid: 16984293
references.citation: Biol Cybern. 1985;52(3):141-52
references.pmid: 4027280
references.citation: J Vis. 2006 Oct 26;6(11):1244-56
references.pmid: 17209732
references.citation: Neural Comput. 2003 Oct;15(10):2255-79
references.pmid: 14511521
references.citation: Neural Netw. 2009 Oct;22(8):1071-8
references.pmid: 19632814
references.citation: Nat Rev Neurosci. 2007 Sep;8(9):700-11
references.pmid: 17704812
references.citation: Nat Neurosci. 2002 Jun;5(6):605-9
references.pmid: 11992115
references.citation: Nat Rev Neurosci. 2002 Jan;3(1):13-21
references.pmid: 11823801
references.citation: Annu Rev Neurosci. 2007;30:535-74
references.pmid: 17600525
references.citation: J Neurosci. 1999 Mar 15;19(6):2209-23
references.pmid: 10066274
references.citation: PLoS Comput Biol. 2010 Aug 12;6(8):
references.pmid: 20711353
references.citation: Psychol Sci. 2008 Jul;19(7):645-7
references.pmid: 18727777
references.citation: Neural Comput. 2009 Nov;21(11):3010-56
references.pmid: 19686065
references.citation: Neural Comput. 2008 Jan;20(1):91-117
references.pmid: 18045002
references.citation: J Neurosci. 2004 Sep 29;24(39):8441-53
references.pmid: 15456817