title: Recognizing sequences of sequences.
abstract: The brain's decoding of fast sensory streams is currently impossible to emulate, even approximately, with artificial agents. For example, robust speech recognition is relatively easy for humans but exceptionally difficult for artificial speech recognition systems. In this paper, we propose that recognition can be simplified with an internal model of how sensory input is generated, when formulated in a Bayesian framework. We show that a plausible candidate for an internal or generative model is a hierarchy of 'stable heteroclinic channels'. This model describes continuous dynamics in the environment as a hierarchy of sequences, where slower sequences cause faster sequences. Under this model, online recognition corresponds to the dynamic decoding of causal sequences, giving a representation of the environment with predictive power on several timescales. We illustrate the ensuing decoding or recognition scheme using synthetic sequences of syllables, where syllables are sequences of phonemes and phonemes are sequences of sound-wave modulations. By presenting anomalous stimuli, we find that the resulting recognition dynamics disclose inference at multiple time scales and are reminiscent of neuronal dynamics seen in the real brain.
authors.affiliation: Wellcome Trust Centre for Neuroimaging, London, UK. skiebel@fil.ion.ucl.ac.uk
authors.forename: Stefan J
authors.initials: SJ
authors.lastname: Kiebel
authors.forename: Katharina
authors.initials: K
authors.lastname: von Kriegstein
authors.forename: Jean
authors.initials: J
authors.lastname: Daunizeau
authors.forename: Karl J
authors.initials: KJ
authors.lastname: Friston
mesh_terms: D001499:Bayes Theorem; D003198:Computer Simulation; D008962:Models, Theoretical; D009415:Nerve Net; D016571:Neural Networks, Computer; D046709:Pattern Recognition, Physiological; D049250:Speech Recognition Software; D013816:Thermodynamics
references.citation: Neuron. 2006 Aug 17;51(4):467-82
references.pmid: 16908412
references.citation: Neural Netw. 2003 Jan;16(1):11-23
references.pmid: 12576102
references.citation: Chaos. 2002 Sep;12(3):672-677
references.pmid: 12779595
references.citation: J Cogn Neurosci. 2005 Nov;17(11):1785-802
references.pmid: 16269114
references.citation: Trends Cogn Sci. 2002 Feb 1;6(2):78-84
references.pmid: 15866191
references.citation: Nature. 2008 Nov 13;456(7219):189-94
references.pmid: 19005546
references.citation: Neuroimage. 2008 Aug 15;42(2):936-44
references.pmid: 18602841
references.citation: PLoS Biol. 2008 May 20;6(5):e126
references.pmid: 18494561
references.citation: Hear Res. 2007 Jul;229(1-2):132-47
references.pmid: 17317056
references.citation: Brain Lang. 2006 Jun;97(3):279-93
references.pmid: 16343606
references.citation: Nat Rev Neurosci. 2008 Dec;9(12):920-33
references.pmid: 19020511
references.citation: J Neurosci. 1999 Nov 1;19(21):9497-507
references.pmid: 10531452
references.citation: J Neurophysiol. 2000 Sep;84(3):1588-98
references.pmid: 10980029
references.citation: Phys Rev Lett. 2001 Aug 6;87(6):068102
references.pmid: 11497865
references.citation: J Neurosci. 2008 Apr 30;28(18):4679-89
references.pmid: 18448645
references.citation: PLoS Comput Biol. 2008 Nov;4(11):e1000209
references.pmid: 19008936
references.citation: J Cogn Neurosci. 2004 May;16(4):577-83
references.pmid: 15185677
references.citation: Learn Mem. 1996 Sep-Oct;3(2-3):264-78
references.pmid: 10456096
references.citation: Science. 2008 Jul 4;321(5885):48-50
references.pmid: 18599763
references.citation: J Theor Biol. 2008 Aug 7;253(3):452-61
references.pmid: 18514740
references.citation: Pain. 2006 Dec 15;126(1-3):309-18
references.pmid: 17088019
references.citation: Chaos. 2004 Dec;14(4):1123-9
references.pmid: 15568926
references.citation: J Cogn Neurosci. 1998 Jan;10(1):108-21
references.pmid: 9526086
references.citation: PLoS Comput Biol. 2008 May 02;4(5):e1000072
references.pmid: 18452000
references.citation: Neuroimage. 1997 Feb;5(2):164-71
references.pmid: 9345546
references.citation: Cogn Psychol. 1986 Jan;18(1):1-86
references.pmid: 3753912
references.citation: Brain Res. 2006 Jun 22;1096(1):163-72
references.pmid: 16769041
references.citation: PLoS Comput Biol. 2008 Nov;4(11):e1000220
references.pmid: 18989398
references.citation: Trends Cogn Sci. 2002 Jan 1;6(1):37-46
references.pmid: 11849614
references.citation: Neurosci Biobehav Rev. 2008;32(1):123-42
references.pmid: 17706781
references.citation: Neuron. 2006 Aug 3;51(3):359-68
references.pmid: 16880130
references.citation: Trends Cogn Sci. 2007 Jun;11(6):229-35
references.pmid: 17475536
references.citation: J Neurosci. 2003 Apr 15;23(8):3423-31
references.pmid: 12716950
references.citation: Trends Cogn Sci. 2006 Jul;10(7):301-8
references.pmid: 16784882
references.citation: PLoS Comput Biol. 2008 Nov;4(11):e1000211
references.pmid: 18989391
references.citation: Science. 1995 Sep 29;269(5232):1880-2
references.pmid: 7569931
references.citation: Proc Biol Sci. 1999 Oct 22;266(1433):2131-6
references.pmid: 10902547
references.citation: Neural Comput. 1997 Nov 15;9(8):1735-80
references.pmid: 9377276
references.citation: Nat Neurosci. 2005 Mar;8(3):389-95
references.pmid: 15723061
references.citation: Philos Trans R Soc Lond B Biol Sci. 2005 Apr 29;360(1456):815-36
references.pmid: 15937014
references.citation: Nat Neurosci. 2008 Dec;11(12):1454-61
references.pmid: 19011624
references.citation: Psychol Rev. 2008 Apr;115(2):357-95
references.pmid: 18426294
references.citation: J Physiol Paris. 2006 Jul-Sep;100(1-3):70-87
references.pmid: 17097864
references.citation: Neuroimage. 2008 Jul 1;41(3):849-85
references.pmid: 18434205
references.citation: Neural Netw. 2008 Dec;21(10):1466-75
references.pmid: 18938059
references.citation: Ann N Y Acad Sci. 2004 Jun;1016:153-70
references.pmid: 15313774
references.citation: J Exp Psychol Gen. 1991 Sep;120(3):235-53
references.pmid: 1836490
references.citation: J Robot Syst. 2005 Nov;22(11):691-710
references.pmid: 17710121
references.citation: J Neurosci. 2007 Aug 8;27(32):8517-24
references.pmid: 17687029
references.citation: Front Neurorobot. 2007 Nov 02;1:2
references.pmid: 18958273
references.citation: Annu Rev Psychol. 2004;55:271-304
references.pmid: 14744217
references.citation: Network. 2003 Nov;14(4):703-32
references.pmid: 14653499
references.citation: Trends Cogn Sci. 2008 May;12(5):193-200
references.pmid: 18403252
references.citation: Nature. 2004 Jan 15;427(6971):244-7
references.pmid: 14724638
references.citation: J Physiol Paris. 2006 Jul-Sep;100(1-3):154-70
references.pmid: 17084600
references.citation: J Neurosci. 2008 Dec 3;28(49):13268-73
references.pmid: 19052218
references.citation: J Cogn Neurosci. 2000 Jul;12(4):635-47
references.pmid: 10936916
references.citation: Speech Commun. 1993 Oct;13(1-2):109-125
references.pmid: 21461185
references.citation: PLoS Comput Biol. 2007 Jun;3(6):e100
references.pmid: 17542641
references.citation: Exp Brain Res. 1980;39(1):87-104
references.pmid: 6247179
references.citation: Nat Rev Neurosci. 2009 Feb;10(2):113-25
references.pmid: 19145235
references.citation: Psychol Rev. 2006 Apr;113(2):201-33
references.pmid: 16637760
references.citation: Neurosci Biobehav Rev. 2001 Jun;25(4):355-73
references.pmid: 11445140
references.citation: PLoS Biol. 2006 May;4(5):e120
references.pmid: 16605306
references.citation: Neuron. 2006 Jun 15;50(6):963-74
references.pmid: 16772176
references.citation: J Neurophysiol. 2001 Sep;86(3):1445-58
references.pmid: 11535690
references.citation: Neuroimage. 2007 Sep 1;37(3):966-73
references.pmid: 17616403
references.citation: J Opt Soc Am A Opt Image Sci Vis. 2003 Jul;20(7):1434-48
references.pmid: 12868647
references.citation: Neuroscience. 2008 Jun 12;154(1):294-303
references.pmid: 18555164
references.citation: Curr Biol. 2008 Dec 9;18(23):1855-9
references.pmid: 19062286
references.citation: Trends Cogn Sci. 2008 May;12(5):201-8
references.pmid: 18420448
references.citation: Eur J Neurosci. 2008 Jan;27(1):217-27
references.pmid: 18093174
references.citation: J Acoust Soc Am. 2002 Jan;111(1 Pt 1):401-8
references.pmid: 11831813
references.citation: Psychol Bull. 1969 Jul;72(1):50-62
references.pmid: 4897155
references.citation: Biol Cybern. 2007 Dec;97(5-6):363-78
references.pmid: 17912544
references.citation: Philos Trans R Soc Lond B Biol Sci. 2008 Mar 12;363(1493):1071-86
references.pmid: 17890189
references.citation: J Am Acad Audiol. 2006 Jul-Aug;17(7):506-18
references.pmid: 16927515
references.citation: Brain Topogr. 2000 Winter;13(2):79-96
references.pmid: 11154104
references.citation: Curr Opin Neurobiol. 2008 Aug;18(4):413-7
references.pmid: 18805485
references.citation: J Neurosci. 2008 Oct 29;28(44):11378-90
references.pmid: 18971480
references.citation: Neural Comput. 1997 Jan 1;9(1):77-97
references.pmid: 9117902
references.citation: J Acoust Soc Am. 2002 May;111(5 Pt 1):2178-88
references.pmid: 12051437