title: Path planning versus cue responding: a bio-inspired model of switching between navigation strategies.
abstract: In this article, we describe a new computational model of switching between path-planning and cue-guided navigation strategies. It is based on three main assumptions: (i) the strategies are mediated by separate memory systems that learn independently and in parallel; (ii) the learning algorithms are different in the two memory systems-the cue-guided strategy uses a temporal-difference (TD) learning rule to approach a visible goal, whereas the path-planning strategy relies on a place-cell-based graph-search algorithm to learn the location of a hidden goal; (iii) a strategy selection mechanism uses TD-learning rule to choose the most successful strategy based on past experience. We propose a novel criterion for strategy selection based on the directions of goal-oriented movements suggested by the different strategies. We show that the selection criterion based on this "common currency" is capable of choosing the best among TD-learning and planning strategies and can be used to solve navigational tasks in continuous state and action spaces. The model has been successfully applied to reproduce rat behavior in two water-maze tasks in which the two strategies were shown to interact. The model was used to analyze competitive and cooperative interactions between different strategies during these tasks as well as relative influence of different types of sensory cues.
authors.affiliation: Institut des Systèmes Intelligents et de Robotique, UPMC CNRS UMR 7222, 4 Place Jussieu, 75252, Paris Cedex 05, France. laurent.dolle@upmc.fr
authors.forename: Laurent
authors.initials: L
authors.lastname: Dollé
authors.forename: Denis
authors.initials: D
authors.lastname: Sheynikhovich
authors.forename: Benoît
authors.initials: B
authors.lastname: Girard
authors.forename: Ricardo
authors.initials: R
authors.lastname: Chavarriaga
authors.forename: Agnès
authors.initials: A
authors.lastname: Guillot
mesh_terms: D000465:Algorithms; D000818:Animals; D001288:Attention / Q000502:physiology*; D003198:Computer Simulation; D003463:Cues; D006801:Humans; D007858:Learning / Q000502:physiology; D008959:Models, Neurological; D013028:Space Perception / Q000502:physiology*; D013997:Time Factors