Reinforcement active learning in the vibrissae system: optimal object localization.
Rats move their whiskers to acquire information about their environment. It has been observed that they palpate novel objects and objects they are required to localize in space. We analyze whisker-based object localization using two complementary paradigms, namely, active learning and intrinsic-reward reinforcement learning. Active learning algorithms select the next training samples according to the hypothesized solution in order to better discriminate between correct and incorrect labels. Intrinsic-reward reinforcement learning uses prediction errors as the reward to an actor-critic design, such that behavior converges to the one that optimizes the learning process. We show that in the context of object localization, the two paradigms result in palpation whisking as their respective optimal solution. These results suggest that rats may employ principles of active learning and/or intrinsic reward in tactile exploration and can guide future research to seek the underlying neuronal mechanisms that implement them. Furthermore, these paradigms are easily transferable to biomimetic whisker-based artificial sensors and can improve the active exploration of their environment.
Department of Neurobiology, Weizmann Institute of Science, Rehovot 76100, Israel. Electronic address: goren@gorengordon.com.
Goren
G
Gordon
Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel.
Nimrod
N
Dorfman
Department of Neurobiology, Weizmann Institute of Science, Rehovot 76100, Israel. Electronic address: Ehud.Ahissar@weizmann.ac.il.
Ehud
E
Ahissar
D000465:Algorithms; D000818:Animals; D032701:Biomimetics; D004192:Discrimination, Psychological / Q000502:physiology*; D005106:Exploratory Behavior / Q000502:physiology*; D007858:Learning / Q000502:physiology*; D008959:Models, Neurological; D010812:Physical Stimulation / Q000379:methods; D051381:Rats; D012054:Reinforcement, Psychology; D014738:Vibrissae / Q000294:innervation*