title: Neural evidence for adaptive strategy selection in value-based decision-making.
abstract: In everyday life, humans often encounter complex environments in which multiple sources of information can influence their decisions. We propose that in such situations, people select and apply different strategies representing different cognitive models of the decision problem. Learning advances by evaluating the success of using a strategy and eventually by switching between strategies. To test our strategy selection model, we investigated how humans solve a dynamic learning task with complex auditory and visual information, and assessed the underlying neural mechanisms with functional magnetic resonance imaging. Using the model, we were able to capture participants' choices and to successfully attribute expected values and reward prediction errors to activations in the dopaminoceptive system (e.g., ventral striatum [VS]) as well as decision conflict to signals in the anterior cingulate cortex. The model outperformed an alternative approach that did not update decision strategies, but the relevance of information itself. Activation of sensory areas depended on whether the selected strategy made use of the respective source of information. Selection of a strategy also determined how value-related information influenced effective connectivity between sensory systems and the VS. Our results suggest that humans can structure their search for and use of relevant information by adaptively selecting between decision strategies.
authors.affiliation: Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg D-20246, Germany and.
authors.forename: Sebastian
authors.initials: S
authors.lastname: Gluth
authors.affiliation: Department of Psychology, University of Basel, Basel CH-4055, Switzerland.
authors.forename: Jörg
authors.initials: J
authors.lastname: Rieskamp
authors.affiliation: Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg D-20246, Germany and.
authors.forename: Christian
authors.initials: C
authors.lastname: Büchel
mesh_terms: D000161:Acoustic Stimulation; D000328:Adult; D059031:Anticipation, Psychological / Q000502:physiology; D001307:Auditory Perception / Q000502:physiology; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D003220:Conflict, Psychological; D003657:Decision Making / Q000502:physiology*; D005260:Female; D006801:Humans; D007858:Learning / Q000502:physiology; D008279:Magnetic Resonance Imaging; D008297:Male; D008959:Models, Neurological; D009483:Neuropsychological Tests; D010775:Photic Stimulation; D012201:Reward; D014796:Visual Perception / Q000502:physiology; D055815:Young Adult
keywords: model-based fMRI; reinforcement learning; reward; ventral striatum