title: Intrinsically motivated oculomotor exploration guided by uncertainty reduction and conditioned reinforcement in non-human primates.
abstract: Intelligent animals have a high degree of curiosity--the intrinsic desire to know--but the mechanisms of curiosity are poorly understood. A key open question pertains to the internal valuation systems that drive curiosity. What are the cognitive and emotional factors that motivate animals to seek information when this is not reinforced by instrumental rewards? Using a novel oculomotor paradigm, combined with reinforcement learning (RL) simulations, we show that monkeys are intrinsically motivated to search for and look at reward-predictive cues, and that their intrinsic motivation is shaped by a desire to reduce uncertainty, a desire to obtain conditioned reinforcement from positive cues, and individual variations in decision strategy and the cognitive costs of acquiring information. The results suggest that free-viewing oculomotor behavior reveals cognitive and emotional factors underlying the curiosity driven sampling of information.
authors.affiliation: Department of Neuroscience, Columbia University, New York City, NY, United States.
authors.forename: Nabil
authors.initials: N
authors.lastname: Daddaoua
authors.affiliation: INRIA, Bordeaux, France.
authors.forename: Manuel
authors.initials: M
authors.lastname: Lopes
authors.affiliation: Department of Neuroscience, Columbia University, New York City, NY, United States.|The Kavli Institute for Brain Science, Columbia University, New York City, NY, United States.
authors.forename: Jacqueline
authors.initials: J
authors.lastname: Gottlieb
mesh_terms: D000818:Animals; D003463:Cues; D005106:Exploratory Behavior / Q000502:physiology*; D000882:Haplorhini; D010805:Physical Conditioning, Animal; D011597:Psychomotor Performance / Q000502:physiology*; D014785:Vision, Ocular / Q000502:physiology
references.citation: Neuron. 2009 Jul 16;63(1):119-26
references.pmid: 19607797
references.citation: Psychol Sci. 2009 Aug;20(8):963-73
references.pmid: 19619181
references.citation: PLoS Comput Biol. 2010 Sep 09;6(9):
references.pmid: 20838580
references.citation: Learn Behav. 2012 Dec;40(4):465-75
references.pmid: 22367755
references.citation: Cognition. 2012 Jan;122(1):86-90
references.pmid: 21983424
references.citation: Nature. 2011 Jan 6;469(7328):53-7
references.pmid: 21150898
references.citation: J Neurosci. 2010 Aug 18;30(33):11096-103
references.pmid: 20720117
references.citation: Physiol Behav. 2014 Sep;136:22-30
references.pmid: 24874776
references.citation: Neuron. 2012 Oct 18;76(2):281-95
references.pmid: 23083732
references.citation: PLoS One. 2010 Nov 23;5(11):e14087
references.pmid: 21124893
references.citation: Curr Biol. 2011 Dec 6;21(23):R941-5
references.pmid: 22153158
references.citation: Neuron. 2014 Oct 22;84(2):486-96
references.pmid: 25284006
references.citation: J Vis. 2009 May 19;9(5):19.1-15
references.pmid: 19757897
references.citation: Neural Netw. 2006 Oct;19(8):1153-60
references.pmid: 16938432
references.citation: Front Neurosci. 2007 Oct 15;1(1):225-36
references.pmid: 18982131
references.citation: Proc Natl Acad Sci U S A. 2010 Dec 7;107(49):20911-6
references.pmid: 21078974
references.citation: Vision Res. 2015 Dec;117:81-90
references.pmid: 26518743
references.citation: J Neurosci. 2009 Sep 9;29(36):11182-91
references.pmid: 19741125
references.citation: J Vis. 2011 May 27;11(5):5
references.pmid: 21622729
references.citation: Neuron. 2015 Nov 4;88(3):449-60
references.pmid: 26539887
references.citation: Neuron. 2015 Feb 4;85(3):602-14
references.pmid: 25619657
references.citation: Trends Cogn Sci. 2013 Nov;17(11):585-93
references.pmid: 24126129
references.citation: Trends Cogn Sci. 2009 Nov;13(11):456-63
references.pmid: 19819753
references.citation: Behav Res Methods. 2010 Feb;42(1):188-204
references.pmid: 20160299