title: The application of temporal difference learning in optimal diet models.
abstract: An experience-based aversive learning model of foraging behaviour in uncertain environments is presented. We use Q-learning as a model-free implementation of Temporal difference learning motivated by growing evidence for neural correlates in natural reinforcement settings. The predator has the choice of including an aposematic prey in its diet or to forage on alternative food sources. We show how the predator's foraging behaviour and energy intake depend on toxicity of the defended prey and the presence of Batesian mimics. We introduce the precondition of exploration of the action space for successful aversion formation and show how it predicts foraging behaviour in the presence of conflicting rewards which is conditionally suboptimal in a fixed environment but allows better adaptation in changing environments.
authors.affiliation: Department of Mathematical Science, City University London, Northampton Square, London EC1V0HB, United Kingdom. Electronic address: Jan.Teichmann.1@city.ac.uk.
authors.forename: Jan
authors.initials: J
authors.lastname: Teichmann
authors.forename: Mark
authors.initials: M
authors.lastname: Broom
authors.forename: Eduardo
authors.initials: E
authors.lastname: Alonso
mesh_terms: D000222:Adaptation, Physiological; D000465:Algorithms; D000818:Animals; D004032:Diet; D005247:Feeding Behavior; D007858:Learning; D008954:Models, Biological; D015233:Models, Statistical; D009415:Nerve Net; D011235:Predatory Behavior; D011336:Probability; D012054:Reinforcement, Psychology; D012201:Reward; D013997:Time Factors
keywords: Batesian mimicry; Optimal diet; Predator–prey; Taste sampling; Temporal difference learning