Recognizing sequences of sequences.
The brain's decoding of fast sensory streams is currently impossible to emulate, even approximately, with artificial agents. For example, robust speech recognition is relatively easy for humans but exceptionally difficult for artificial speech recognition systems. In this paper, we propose that recognition can be simplified with an internal model of how sensory input is generated, when formulated in a Bayesian framework. We show that a plausible candidate for an internal or generative model is a hierarchy of 'stable heteroclinic channels'. This model describes continuous dynamics in the environment as a hierarchy of sequences, where slower sequences cause faster sequences. Under this model, online recognition corresponds to the dynamic decoding of causal sequences, giving a representation of the environment with predictive power on several timescales. We illustrate the ensuing decoding or recognition scheme using synthetic sequences of syllables, where syllables are sequences of phonemes and phonemes are sequences of sound-wave modulations. By presenting anomalous stimuli, we find that the resulting recognition dynamics disclose inference at multiple time scales and are reminiscent of neuronal dynamics seen in the real brain.
Kiebel
Stefan J
SJ
Wellcome Trust Centre for Neuroimaging, London, UK. skiebel@fil.ion.ucl.ac.uk
von Kriegstein
Katharina
K
Daunizeau
Jean
J
Friston
Karl J
KJ
D001499:Bayes Theorem; D003198:Computer Simulation; D008962:Models, Theoretical; D009415:Nerve Net; D016571:Neural Networks, Computer; D046709:Pattern Recognition, Physiological; D049250:Speech Recognition Software; D013816:Thermodynamics
Neuron. 2006 Aug 17;51(4):467-82
16908412
Neural Netw. 2003 Jan;16(1):11-23
12576102
Chaos. 2002 Sep;12(3):672-677
12779595
J Cogn Neurosci. 2005 Nov;17(11):1785-802
16269114
Trends Cogn Sci. 2002 Feb 1;6(2):78-84
15866191
Nature. 2008 Nov 13;456(7219):189-94
19005546
Neuroimage. 2008 Aug 15;42(2):936-44
18602841
PLoS Biol. 2008 May 20;6(5):e126
18494561
Hear Res. 2007 Jul;229(1-2):132-47
17317056
Brain Lang. 2006 Jun;97(3):279-93
16343606
Nat Rev Neurosci. 2008 Dec;9(12):920-33
19020511
J Neurosci. 1999 Nov 1;19(21):9497-507
10531452
J Neurophysiol. 2000 Sep;84(3):1588-98
10980029
Phys Rev Lett. 2001 Aug 6;87(6):068102
11497865
J Neurosci. 2008 Apr 30;28(18):4679-89
18448645
PLoS Comput Biol. 2008 Nov;4(11):e1000209
19008936
J Cogn Neurosci. 2004 May;16(4):577-83
15185677
Learn Mem. 1996 Sep-Oct;3(2-3):264-78
10456096
Science. 2008 Jul 4;321(5885):48-50
18599763
J Theor Biol. 2008 Aug 7;253(3):452-61
18514740
Pain. 2006 Dec 15;126(1-3):309-18
17088019
Chaos. 2004 Dec;14(4):1123-9
15568926
J Cogn Neurosci. 1998 Jan;10(1):108-21
9526086
PLoS Comput Biol. 2008 May 02;4(5):e1000072
18452000
Neuroimage. 1997 Feb;5(2):164-71
9345546
Cogn Psychol. 1986 Jan;18(1):1-86
3753912
Brain Res. 2006 Jun 22;1096(1):163-72
16769041
PLoS Comput Biol. 2008 Nov;4(11):e1000220
18989398
Trends Cogn Sci. 2002 Jan 1;6(1):37-46
11849614
Neurosci Biobehav Rev. 2008;32(1):123-42
17706781
Neuron. 2006 Aug 3;51(3):359-68
16880130
Trends Cogn Sci. 2007 Jun;11(6):229-35
17475536
J Neurosci. 2003 Apr 15;23(8):3423-31
12716950
Trends Cogn Sci. 2006 Jul;10(7):301-8
16784882
PLoS Comput Biol. 2008 Nov;4(11):e1000211
18989391
Science. 1995 Sep 29;269(5232):1880-2
7569931
Proc Biol Sci. 1999 Oct 22;266(1433):2131-6
10902547
Neural Comput. 1997 Nov 15;9(8):1735-80
9377276
Nat Neurosci. 2005 Mar;8(3):389-95
15723061
Philos Trans R Soc Lond B Biol Sci. 2005 Apr 29;360(1456):815-36
15937014
Nat Neurosci. 2008 Dec;11(12):1454-61
19011624
Psychol Rev. 2008 Apr;115(2):357-95
18426294
J Physiol Paris. 2006 Jul-Sep;100(1-3):70-87
17097864
Neuroimage. 2008 Jul 1;41(3):849-85
18434205
Neural Netw. 2008 Dec;21(10):1466-75
18938059
Ann N Y Acad Sci. 2004 Jun;1016:153-70
15313774
J Exp Psychol Gen. 1991 Sep;120(3):235-53
1836490
J Robot Syst. 2005 Nov;22(11):691-710
17710121
J Neurosci. 2007 Aug 8;27(32):8517-24
17687029
Front Neurorobot. 2007 Nov 02;1:2
18958273
Annu Rev Psychol. 2004;55:271-304
14744217
Network. 2003 Nov;14(4):703-32
14653499
Trends Cogn Sci. 2008 May;12(5):193-200
18403252
Nature. 2004 Jan 15;427(6971):244-7
14724638
J Physiol Paris. 2006 Jul-Sep;100(1-3):154-70
17084600
J Neurosci. 2008 Dec 3;28(49):13268-73
19052218
J Cogn Neurosci. 2000 Jul;12(4):635-47
10936916
Speech Commun. 1993 Oct;13(1-2):109-125
21461185
PLoS Comput Biol. 2007 Jun;3(6):e100
17542641
Exp Brain Res. 1980;39(1):87-104
6247179
Nat Rev Neurosci. 2009 Feb;10(2):113-25
19145235
Psychol Rev. 2006 Apr;113(2):201-33
16637760
Neurosci Biobehav Rev. 2001 Jun;25(4):355-73
11445140
PLoS Biol. 2006 May;4(5):e120
16605306
Neuron. 2006 Jun 15;50(6):963-74
16772176
J Neurophysiol. 2001 Sep;86(3):1445-58
11535690
Neuroimage. 2007 Sep 1;37(3):966-73
17616403
J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1434-48
12868647
Neuroscience. 2008 Jun 12;154(1):294-303
18555164
Curr Biol. 2008 Dec 9;18(23):1855-9
19062286
Trends Cogn Sci. 2008 May;12(5):201-8
18420448
Eur J Neurosci. 2008 Jan;27(1):217-27
18093174
J Acoust Soc Am. 2002 Jan;111(1 Pt 1):401-8
11831813
Psychol Bull. 1969 Jul;72(1):50-62
4897155
Biol Cybern. 2007 Dec;97(5-6):363-78
17912544
Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):1071-86
17890189
J Am Acad Audiol. 2006 Jul-Aug;17(7):506-18
16927515
Brain Topogr. 2000 Winter;13(2):79-96
11154104
Curr Opin Neurobiol. 2008 Aug;18(4):413-7
18805485
J Neurosci. 2008 Oct 29;28(44):11378-90
18971480
Neural Comput. 1997 Jan 1;9(1):77-97
9117902
J Acoust Soc Am. 2002 May;111(5 Pt 1):2178-88
12051437