Active inference and robot control: a case study.
Active inference is a general framework for perception and action that is gaining prominence in computational and systems neuroscience but is less known outside these fields. Here, we discuss a proof-of-principle implementation of the active inference scheme for the control or the 7-DoF arm of a (simulated) PR2 robot. By manipulating visual and proprioceptive noise levels, we show under which conditions robot control under the active inference scheme is accurate. Besides accurate control, our analysis of the internal system dynamics (e.g. the dynamics of the hidden states that are inferred during the inference) sheds light on key aspects of the framework such as the quintessentially multimodal nature of control and the differential roles of proprioception and vision. In the discussion, we consider the potential importance of being able to implement active inference in robots. In particular, we briefly review the opportunities for modelling psychophysiological phenomena such as sensory attenuation and related failures of gain control, of the sort seen in Parkinson's disease. We also consider the fundamental difference between active inference and optimal control formulations, showing that in the former the heavy lifting shifts from solving a dynamical inverse problem to creating deep forward or generative models with dynamics, whose attracting sets prescribe desired behaviours.
Pascal Institute, Clermont University, Clermont-Ferrand, France Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy.
Léo
http://orcid.org/0000-0001-8081-1070
L
Pio-Lopez
Pascal Institute, Clermont University, Clermont-Ferrand, France.
Ange
A
Nizard
The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, UK.
Karl
K
Friston
Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy giovanni.pezzulo@istc.cnr.it.
Giovanni
G
Pezzulo
active inference; free energy; robot control
Neurosci Biobehav Rev. 2016 Sep;68:862-79
27375276
J R Soc Interface. 2015 Mar 6;12(104):20141335
25652466
Learn Mem. 2016 Jun 17;23(7):322-38
27317193
Neurosci Lett. 1988 Aug 15;91(1):106-11
3173781
Nat Neurosci. 2002 Nov;5(11):1226-35
12404008
Front Psychol. 2013 Mar 04;4:92
23459512
Nature. 2004 Jan 15;427(6971):244-7
14724638
Cogn Neurosci. 2015;6(4):187-214
25689102
Neuron. 2011 Nov 3;72(3):488-98
22078508
Nat Rev Neurosci. 2010 Feb;11(2):127-38
20068583
J Neurophysiol. 2007 May;97(5):3305-13
17344369
PLoS Comput Biol. 2012 Jan;8(1):e1002327
22241972
J Neurophysiol. 1995 Feb;73(2):820-35
7760137
Front Psychol. 2012 Nov 05;3:478
23133435
PLoS Comput Biol. 2015 Apr 07;11(4):e1004110
25849349
J Gen Psychol. 1947 Oct;37(2):125-8
20270223
Phys Life Rev. 2015 Mar;12:114-7
25659528
Trends Neurosci. 2004 Dec;27(12):712-9
15541511
PLoS One. 2009 Jul 29;4(7):e6421
19641614
Brain Res. 1984 Mar 26;296(1):103-9
6713202
Trends Cogn Sci. 2014 Dec;18(12):647-57
25156191
Trends Cogn Sci. 2012 Oct;16(10):485-8
22940577
PLoS Comput Biol. 2016 Apr 13;12(4):e1004864
27074140
J Cogn Neurosci. 2016 Jan;28(1):140-57
26439267
J Mot Behav. 2009 Nov;41(6):543-52
19592360
Nat Rev Neurosci. 2002 Oct;3(10):781-90
12360322
PLoS Comput Biol. 2009 Aug;5(8):e1000464
19680429
Biol Cybern. 2011 Feb;104(1-2):137-60
21327826
Prog Neurobiol. 2015 Nov;134:17-35
26365173
Philos Trans R Soc Lond B Biol Sci. 2014 Nov 5;369(1655):null
25267825
Nature. 1988 Sep 22;335(6188):311-7
3047584
Adv Exp Med Biol. 2009;629:699-726
19227529
Biol Cybern. 2010 Mar;102(3):227-60
20148260
Proc Natl Acad Sci U S A. 1952 Aug;38(8):716-9
16589166
Front Hum Neurosci. 2013 Sep 25;7:598
24093015
Front Psychol. 2012 May 28;3:151
22654776
Front Neurorobot. 2011 Dec 27;5:4
22207846
Front Neurosci. 2011 Jun 30;5:79
21747755
Neural Comput. 1995 Sep;7(5):889-904
7584891
Biol Cybern. 2014 Dec;108(6):777-801
25128318
Trends Cogn Sci. 2016 Jun;20(6):414-24
27118642
Hum Brain Mapp. 2004 Mar;21(3):165-77
14755836
J Physiol Paris. 2006 Jul-Sep;100(1-3):70-87
17097864
Neural Comput. 2015 Feb;27(2):306-28
25514108
Philos Trans R Soc Lond B Biol Sci. 2009 May 12;364(1521):1211-21
19528002