title: Modulation for emergent networks: serotonin and dopamine.
abstract: In autonomous learning, value-sensitive experiences can improve the efficiency of learning. A learning network needs be motivated so that the limited computational resources and the limited lifetime are devoted to events that are of high value for the agent to compete in its environment. The neuromodulatory system of the brain is mainly responsible for developing such a motivation system. Although reinforcement learning has been extensively studied, many existing models are symbolic whose internal nodes or modules have preset meanings. Neural networks have been used to automatically generate internal emergent representations. However, modeling an emergent motivational system for neural networks is still a great challenge. By emergent, we mean that the internal representations emerge autonomously through interactions with the external environments. This work proposes a generic emergent modulatory system for emergent networks, which includes two subsystems - the serotonin system and the dopamine system. The former signals a large class of stimuli that are intrinsically aversive (e.g., stress or pain). The latter signals a large class of stimuli that are intrinsically appetitive (e.g., pleasure or sweet). We experimented with this motivational system for two settings. The first is a visual recognition setting to investigate how such a system can learn through interactions with a teacher, who does not directly give answers, but only punishments and rewards. The second is a setting for wandering in the presence of a friend and a foe.
authors.affiliation: Michigan State University, East Lansing, MI, USA. weng@cse.msu.edu
authors.forename: Juyang
authors.initials: J
authors.lastname: Weng
authors.forename: Stephen
authors.initials: S
authors.lastname: Paslaski
authors.forename: James
authors.initials: J
authors.lastname: Daly
authors.forename: Courtland
authors.initials: C
authors.lastname: VanDam
authors.forename: Jacob
authors.initials: J
authors.lastname: Brown
mesh_terms: D000818:Animals; D001185:Artificial Intelligence; D001921:Brain / Q000502:physiology; D004298:Dopamine / Q000502:physiology*; D018698:Glutamic Acid / Q000502:physiology; D006801:Humans; D007858:Learning / Q000502:physiology; D008959:Models, Neurological; D009042:Motivation; D016571:Neural Networks, Computer; D012054:Reinforcement, Psychology; D012701:Serotonin / Q000502:physiology*; D013561:Symbolism
chemical_list: D012701:Serotonin; D018698:Glutamic Acid; D004298:Dopamine