Context, learning, and extinction.
A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of "state classification" to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes.
Gershman
Samuel J
SJ
Psychology Department, Princeton University, Princeton, NJ 08540, USA. sjgershm@princeton.edu
Blei
David M
DM
Niv
Yael
Y
D001499:Bayes Theorem; D003214:Conditioning, Classical; D005108:Extinction, Psychological; D006624:Hippocampus / Q000502:physiology; D006801:Humans; D007858:Learning; D008960:Models, Psychological; D012660:Semantics