title: Bayesian computation emerges in generic cortical microcircuits through spike-timing-dependent plasticity.
abstract: The principles by which networks of neurons compute, and how spike-timing dependent plasticity (STDP) of synaptic weights generates and maintains their computational function, are unknown. Preceding work has shown that soft winner-take-all (WTA) circuits, where pyramidal neurons inhibit each other via interneurons, are a common motif of cortical microcircuits. We show through theoretical analysis and computer simulations that Bayesian computation is induced in these network motifs through STDP in combination with activity-dependent changes in the excitability of neurons. The fundamental components of this emergent Bayesian computation are priors that result from adaptation of neuronal excitability and implicit generative models for hidden causes that are created in the synaptic weights through STDP. In fact, a surprising result is that STDP is able to approximate a powerful principle for fitting such implicit generative models to high-dimensional spike inputs: Expectation Maximization. Our results suggest that the experimentally observed spontaneous activity and trial-to-trial variability of cortical neurons are essential features of their information processing capability, since their functional role is to represent probability distributions rather than static neural codes. Furthermore it suggests networks of Bayesian computation modules as a new model for distributed information processing in the cortex.
authors: Institute for Theoretical Computer Science, Graz University of Technology, Graz, Austria. nessler@igi.tugraz.at
authors: Bernhard
authors: B
authors: Nessler
authors: Michael
authors: M
authors: Pfeiffer
authors: Lars
authors: L
authors: Buesing
authors: Wolfgang
authors: W
authors: Maass
mesh_terms: D000200:Action Potentials / Q000502:physiology*; D000818:Animals; D001499:Bayes Theorem; D001921:Brain / Q000502:physiology; D019295:Computational Biology / Q000379:methods; D003198:Computer Simulation; D006801:Humans; D008959:Models, Neurological; D009415:Nerve Net / Q000502:physiology; D009473:Neuronal Plasticity / Q000502:physiology*; D009474:Neurons / Q000502:physiology; D011336:Probability; D013569:Synapses / Q000502:physiology; D009435:Synaptic Transmission / Q000502:physiology
references: Neural Comput. 2006 Jun;18(6):1318-48
references: 16764506
references: J Neurosci. 2007 Nov 28;27(48):13316-28
references: 18045926
references: Nat Neurosci. 2009 Nov;12(11):1444-9
references: 19801988
references: Neuron. 2012 Jul 26;75(2):230-49
references: 22841309
references: Nature. 2000 Jun 22;405(6789):947-51
references: 10879535
references: Neural Comput. 2008 Jan;20(1):91-117
references: 18045002
references: Nat Neurosci. 2010 Mar;13(3):344-52
references: 20098420
references: Neural Comput. 2006 Jul;18(7):1527-54
references: 16764513
references: Neural Comput. 2001 Dec;13(12):2709-41
references: 11705408
references: Nat Neurosci. 2000 Nov;3 Suppl:1178-83
references: 11127835
references: Neural Comput. 2005 Aug;17(8):1665-99
references: 15969914
references: Proc Natl Acad Sci U S A. 2012 Mar 6;109(10):3991-6
references: 22357758
references: Front Neurosci. 2011 May 31;5:73
references: 21747754
references: J Physiol. 2009 Jun 15;587(Pt 12):2743-51
references: 19525560
references: Science. 2010 Jan 29;327(5965):584-7
references: 20110506
references: Neuroscience. 2001;107(1):13-24
references: 11744242
references: Nat Rev Neurosci. 2010 Jan;11(1):44-52
references: 19935836
references: Biol Cybern. 2008 Jun;98(6):459-78
references: 18491160
references: Neuron. 1992 Dec;9(6):1089-97
references: 1334418
references: Nature. 2002 Mar 28;416(6879):433-8
references: 11919633
references: Proc Natl Acad Sci U S A. 2011 Nov 29;108(48):19383-8
references: 22080608
references: Prog Brain Res. 2011;191:119-31
references: 21741548
references: J Neurosci. 1998 Dec 15;18(24):10464-72
references: 9852584
references: Trends Cogn Sci. 2010 Mar;14(3):119-30
references: 20153683
references: Neuron. 2011 Mar 24;69(6):1188-203
references: 21435562
references: J Cogn Neurosci. 1991 Winter;3(1):1-8
references: 23964801
references: Annu Rev Neurosci. 2004;27:419-51
references: 15217339
references: Behav Brain Sci. 2009 Feb;32(1):69-84; discussion 85-120
references: 19210833
references: PLoS Comput Biol. 2011 Oct;7(10):e1002231
references: 22046113
references: Neural Comput. 2010 Dec;22(12):3207-20
references: 20858131
references: Nat Neurosci. 2006 May;9(5):676-81
references: 16604068
references: Neural Comput. 2009 Feb;21(2):478-509
references: 19431267
references: PLoS Comput Biol. 2010 Apr 22;6(4):e1000757
references: 20421937
references: PLoS Comput Biol. 2012;8(3):e1002432
references: 22457610
references: Neuron. 2001 Sep 13;31(5):681-97
references: 11567610
references: Nat Rev Neurosci. 2008 Apr;9(4):292-303
references: 18319728
references: Neuron. 2001 Dec 20;32(6):1149-64
references: 11754844
references: Neural Comput. 2009 May;21(5):1259-76
references: 19718815
references: PLoS Comput Biol. 2011 Nov;7(11):e1002211
references: 22096452
references: Annu Rev Neurosci. 2011;34:89-103
references: 21438687
references: Learn Mem. 2003 Nov-Dec;10(6):456-65
references: 14657257
references: Neuron. 2001 Oct 25;32(2):339-50
references: 11684002
references: Nature. 2004 Jan 15;427(6971):244-7
references: 14724638
references: Neuron. 2001 Mar;29(3):691-701
references: 11301028
references: Science. 2006 Jul 28;313(5786):504-7
references: 16873662
references: Nat Rev Neurosci. 2011 Nov 23;13(1):51-62
references: 22108672
references: J Comput Neurosci. 2006 Aug;21(1):35-49
references: 16633938
references: Neural Comput. 2008 Jan;20(1):118-45
references: 18045003
references: PLoS One. 2008 Jan 02;3(1):e1377
references: 18167538
references: Nat Neurosci. 2008 May;11(5):535-7
references: 18376400
references: J Neurophysiol. 2004 Jul;92(1):341-8
references: 14973317
references: PLoS Biol. 2009 Jul;7(7):e1000141
references: 19582146
references: Psychol Sci. 2006 Sep;17(9):767-73
references: 16984293
references: Adv Neural Inf Process Syst. 2009;2009:1105-1113
references: 25284966
references: Nature. 1996 Jun 13;381(6583):607-9
references: 8637596
references: J Neurosci. 2009 Oct 28;29(43):13484-93
references: 19864561
references: Neuron. 2012 Aug 23;75(4):556-71
references: 22920249
references: Cereb Cortex. 2011 Jun;21(6):1254-72
references: 21045004
references: Neural Comput. 2010 Jun;22(6):1399-444
references: 20141476
references: J Neurophysiol. 2008 Sep;100(3):1523-32
references: 18562559
references: Neuron. 2004 Feb 5;41(3):445-54
references: 14766182
references: Nat Neurosci. 2006 Nov;9(11):1432-8
references: 17057707
references: Nat Neurosci. 2000 Sep;3(9):919-26
references: 10966623
references: Front Integr Neurosci. 2009 Jul 30;3:17
references: 19668703
references: PLoS Biol. 2009 Dec;7(12):e1000260
references: 20027205
references: Neural Comput. 2000 Nov;12(11):2519-35
references: 11110125
references: Trends Cogn Sci. 2010 Feb;14(2):72-80
references: 20080054
references: Philos Trans R Soc Lond B Biol Sci. 1997 Aug 29;352(1358):1177-90
references: 9304685
references: Proc Natl Acad Sci U S A. 2005 Apr 5;102(14):5239-44
references: 15795376
references: Neural Comput. 2009 Sep;21(9):2437-65
references: 19548795
references: Front Synaptic Neurosci. 2010 Jun 18;2:21
references: 21423507
references: Annu Rev Neurosci. 2008;31:25-46
references: 18275283
references: J Neurosci. 2007 Nov 7;27(45):12242-54
references: 17989290
references: Neuron. 2004 Sep 30;44(1):23-30
references: 15450157
references: Neural Comput. 2000 Feb;12(2):407-32
references: 10636949
references: PLoS Comput Biol. 2011 Dec;7(12):e1002294
references: 22219717