title: Reward-based learning for virtual neurorobotics through emotional speech processing.
abstract: Reward-based learning can easily be applied to real life with a prevalence in children teaching methods. It also allows machines and software agents to automatically determine the ideal behavior from a simple reward feedback (e.g., encouragement) to maximize their performance. Advancements in affective computing, especially emotional speech processing (ESP) have allowed for more natural interaction between humans and robots. Our research focuses on integrating a novel ESP system in a relevant virtual neurorobotic (VNR) application. We created an emotional speech classifier that successfully distinguished happy and utterances. The accuracy of the system was 95.3 and 98.7% during the offline mode (using an emotional speech database) and the live mode (using live recordings), respectively. It was then integrated in a neurorobotic scenario, where a virtual neurorobot had to learn a simple exercise through reward-based learning. If the correct decision was made the robot received a spoken reward, which in turn stimulated synapses (in our simulated model) undergoing spike-timing dependent plasticity (STDP) and reinforced the corresponding neural pathways. Both our ESP and neurorobotic systems allowed our neurorobot to successfully and consistently learn the exercise. The integration of ESP in real-time computational neuroscience architecture is a first step toward the combination of human emotions and virtual neurorobotics.
authors: Department of Computer Science and Engineering, University of Nevada Reno, NV, USA ; Department of Bioengineering, George Mason University Fairfax, VA, USA.
authors: Laurence C
authors: LC
authors: Jayet Bray
authors: Gareth B
authors: GB
authors: Ferneyhough
authors: Emily R
authors: ER
authors: Barker
authors: Corey M
authors: CM
authors: Thibeault
authors: Frederick C
authors: FC
authors: Harris
keywords: biological computational model; emotional speech processing; reward-based learning; virtual neurorobotics
references: J Acoust Soc Am. 2002 Apr;111(4):1917-30
references: 12002874
references: Front Neuroinform. 2009 May 27;3:16
references: 19506707
references: J Neurosci. 2006 Dec 13;26(50):13067-75
references: 17167096
references: Front Neurorobot. 2007 Nov 02;1:1
references: 18958272
references: Neural Comput. 2007 Jun;19(6):1468-502
references: 17444757
references: PLoS Comput Biol. 2011 Jun;7(6):e1002092
references: 21738460
references: Trends Cogn Sci. 2004 Mar;8(3):129-35
references: 15301753
references: Neuroscientist. 2009 Oct;15(5):419-29
references: 19516047
references: Neural Comput. 2013 Jan;25(1):123-56
references: 23020112
references: Front Neural Circuits. 2010 Nov 18;4:122
references: 21151359
references: Nature. 1998 Sep 3;395(6697):37-44
references: 9738497
references: Nat Neurosci. 2008 Mar;11(3):367-74
references: 18264095
references: J Neurosci. 2010 Oct 6;30(40):13326-37
references: 20926659
references: J Neurosci. 2010 Dec 8;30(49):16417-8
references: 21147980
references: Front Synaptic Neurosci. 2011 Aug 29;3:4
references: 22007168
references: BMC Bioinformatics. 2006 Dec 12;7 Suppl 4:S25
references: 17217518
references: Neuron. 2010 Mar 25;65(6):852-8
references: 20346760
references: Front Neurosci. 2008 Jul 07;2(1):123-9
references: 18982115
references: Biol Cybern. 2007 Jul;97(1):81-97
references: 17530277
references: Neural Netw. 2012 Aug;32:130-7
references: 22386597
references: Nature. 2000 Jan 20;403(6767):309-12
references: 10659849
references: Nat Neurosci. 2000 Sep;3(9):919-26
references: 10966623
references: J Pers Soc Psychol. 1996 Mar;70(3):614-36
references: 8851745
references: Cereb Cortex. 2007 Oct;17(10):2443-52
references: 17220510
references: Annu Rev Neurosci. 2008;31:25-46
references: 18275283
references: Neuron. 2004 Sep 30;44(1):23-30
references: 15450157
references: J Comput Neurosci. 2007 Dec;23(3):349-98
references: 17629781