Nonlinear Hebbian Learning as a Unifying Principle in Receptive Field Formation.
The development of sensory receptive fields has been modeled in the past by a variety of models including normative models such as sparse coding or independent component analysis and bottom-up models such as spike-timing dependent plasticity or the Bienenstock-Cooper-Munro model of synaptic plasticity. Here we show that the above variety of approaches can all be unified into a single common principle, namely nonlinear Hebbian learning. When nonlinear Hebbian learning is applied to natural images, receptive field shapes were strongly constrained by the input statistics and preprocessing, but exhibited only modest variation across different choices of nonlinearities in neuron models or synaptic plasticity rules. Neither overcompleteness nor sparse network activity are necessary for the development of localized receptive fields. The analysis of alternative sensory modalities such as auditory models or V2 development lead to the same conclusions. In all examples, receptive fields can be predicted a priori by reformulating an abstract model as nonlinear Hebbian learning. Thus nonlinear Hebbian learning and natural statistics can account for many aspects of receptive field formation across models and sensory modalities.
School of Computer and Communication Sciences and School of Life Science, Brain Mind Institute, Ecole Polytechnique Federale de Lausanne, Lausanne EPFL, Switzerland.|Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom.
Carlos S N
http://orcid.org/0000-0002-6694-8457
CS
Brito
School of Computer and Communication Sciences and School of Life Science, Brain Mind Institute, Ecole Polytechnique Federale de Lausanne, Lausanne EPFL, Switzerland.
Wulfram
W
Gerstner
Proc Biol Sci. 1998 Mar 7;265(1394):359-66
9523437
Nature. 2006 Feb 23;439(7079):978-82
16495999
Proc Natl Acad Sci U S A. 2014 Jun 10;111(23):8619-24
24812127
J Neurosci. 2006 Sep 20;26(38):9673-82
16988038
Physiol Rev. 2008 Apr;88(2):769-840
18391179
Nature. 2000 Apr 20;404(6780):841-7
10786784
PLoS Comput Biol. 2010 Apr 22;6(4):e1000757
20421937
Trends Neurosci. 2012 Jun;35(6):345-55
22579264
Neuron. 2007 Jun 7;54(5):677-96
17553419
J Neurosci. 2013 Mar 27;33(13):5475-85
23536063
Front Comput Neurosci. 2014 Apr 04;8:38
24772078
Nature. 1996 Jun 13;381(6583):607-9
8637596
Proc Natl Acad Sci U S A. 2011 Nov 29;108(48):19383-8
22080608
J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1434-48
12868647
Curr Opin Neurobiol. 2004 Aug;14(4):481-7
15321069
Nat Neurosci. 2013 Jul;16(7):942-8
23749146
Nat Neurosci. 2011 Aug 14;14(9):1195-201
21841776
Nat Neurosci. 2010 Mar;13(3):344-52
20098420
J Neurophysiol. 2002 Jul;88(1):455-63
12091567
Neuron. 2012 Feb 9;73(3):415-34
22325196
PLoS Comput Biol. 2013;9(5):e1003005
23675290
Neural Comput. 2008 Oct;20(10):2526-63
18439138
Annu Rev Neurosci. 2011;34:89-103
21438687
Phys Rev Lett. 1994 Aug 8;73(6):814-817
10057546
Science. 2010 Nov 19;330(6007):1113-6
21051599
PLoS Comput Biol. 2011 Oct;7(10):e1002250
22046123
Neural Netw. 2000 May-Jun;13(4-5):411-30
10946390
PLoS Comput Biol. 2009 Apr;5(4):e1000336
19343216
PLoS Comput Biol. 2008 Oct;4(10):e1000180
18846203
Neuron. 2001 Dec 20;32(6):1149-64
11754844
J Neurosci. 2013 Jun 5;33(23):9565-75
23739954
Vision Res. 1997 Dec;37(23):3327-38
9425547
J Neurophysiol. 2002 Jan;87(1):516-27
11784767
Nat Neurosci. 2004 Dec;7(12):1345-52
15558066
Vision Res. 1997 Dec;37(23):3311-25
9425546
PLoS Comput Biol. 2013;9(11):e1003330
24244138
J Neurosci. 2013 Oct 2;33(40):15915-29
24089497
Proc Natl Acad Sci U S A. 2012 Mar 6;109(10):3991-6
22357758
J Math Biol. 1982;15(3):267-73
7153672
Biol Cybern. 1990;64(2):165-70
2291903
J Neurosci. 2010 Oct 6;30(40):13326-37
20926659
Neural Comput. 2014 Sep;26(9):1924-72
24922502
Nat Neurosci. 2000 Sep;3(9):919-26
10966623
J Physiol. 1959 Oct;148:574-91
14403679
J Comput Neurosci. 2007 Apr;22(2):135-46
17053994
J Neurosci. 1994 Jan;14(1):409-41
8283248
J Neurophysiol. 1963 Nov;26:1003-17
14084161
Science. 1989 Aug 11;245(4918):605-15
2762813
Proc Natl Acad Sci U S A. 1994 Aug 2;91(16):7797-801
8052662
J Neurosci. 1982 Jan;2(1):32-48
7054394
Nature. 1996 Sep 5;383(6595):76-81
8779718
Science. 2011 Dec 16;334(6062):1569-73
22075724