title: Neural computations underlying arbitration between model-based and model-free learning.
abstract: There is accumulating neural evidence to support the existence of two distinct systems for guiding action selection, a deliberative "model-based" and a reflexive "model-free" system. However, little is known about how the brain determines which of these systems controls behavior at one moment in time. We provide evidence for an arbitration mechanism that allocates the degree of control over behavior by model-based and model-free systems as a function of the reliability of their respective predictions. We show that the inferior lateral prefrontal and frontopolar cortex encode both reliability signals and the output of a comparison between those signals, implicating these regions in the arbitration process. Moreover, connectivity between these regions and model-free valuation areas is negatively modulated by the degree of model-based control in the arbitrator, suggesting that arbitration may work through modulation of the model-free valuation system when the arbitrator deems that the model-based system should drive behavior.
authors: Computation & Neural Systems, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA; Behavioral & Social Neuroscience, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA; Division of Humanities and Social Sciences, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA. Electronic address: swlee@caltech.edu.
authors: Sang Wan
authors: SW
authors: Lee
authors: Computation & Neural Systems, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA; Behavioral & Social Neuroscience, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA; Division of Biology, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA.
authors: Shinsuke
authors: S
authors: Shimojo
authors: Computation & Neural Systems, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA; Behavioral & Social Neuroscience, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA; Division of Humanities and Social Sciences, MC228-77, California Institute of Technology, Pasadena, CA 91125, USA.
authors: John P
authors: JP
authors: O'Doherty
mesh_terms: D000328:Adult; D001921:Brain / Q000098:blood supply / Q000502:physiology*; D001931:Brain Mapping; D003198:Computer Simulation; D003657:Decision Making; D005260:Female; D006040:Goals; D006801:Humans; D007091:Image Processing, Computer-Assisted; D007858:Learning / Q000502:physiology*; D008279:Magnetic Resonance Imaging; D008297:Male; D008959:Models, Neurological; D010100:Oxygen / Q000097:blood; D011601:Psychophysics; D055815:Young Adult
chemical_list: D010100:Oxygen