title: Processing of action- but not stimulus-related prediction errors differs between active and observational feedback learning.
abstract: Learning of stimulus-response-outcome associations is driven by outcome prediction errors (PEs). Previous studies have shown larger PE-dependent activity in the striatum for learning from own as compared to observed actions and the following outcomes despite comparable learning rates. We hypothesised that this finding relates primarily to a stronger integration of action and outcome information in active learners. Using functional magnetic resonance imaging, we investigated brain activations related to action-dependent PEs, reflecting the deviation between action values and obtained outcomes, and action-independent PEs, reflecting the deviation between subjective values of response-preceding cues and obtained outcomes. To this end, 16 active and 15 observational learners engaged in a probabilistic learning card-guessing paradigm. On each trial, active learners saw one out of five cues and pressed either a left or right response button to receive feedback (monetary win or loss). Each observational learner observed exactly those cues, responses and outcomes of one active learner. Learning performance was assessed in active test trials without feedback and did not differ between groups. For both types of PEs, activations were found in the globus pallidus, putamen, cerebellum, and insula in active learners. However, only for action-dependent PEs, activations in these structures and the anterior cingulate were increased in active relative to observational learners. Thus, PE-related activity in the reward system is not generally enhanced in active relative to observational learning but only for action-dependent PEs. For the cerebellum, additional activations were found across groups for cue-related uncertainty, thereby emphasising the cerebellum's role in stimulus-outcome learning.
authors.affiliation: Institute of Cognitive Neuroscience, Department of Neuropsychology, Faculty of Psychology, Ruhr University Bochum, Universitätsstraße 150, 44780 Bochum, Germany. Electronic address: stefan.kobza@ruhr-uni-bochum.de.
authors.forename: Stefan
authors.initials: S
authors.lastname: Kobza
authors.affiliation: Institute for Experimental Psychology, Heinrich Heine University Düsseldorf, Universitätsstraße 1, 40225 Düsseldorf, Germany. Electronic address: christian.bellebaum@hhu.de.
authors.forename: Christian
authors.initials: C
authors.lastname: Bellebaum
mesh_terms: D000328:Adult; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D002531:Cerebellum / Q000502:physiology; D003342:Corpus Striatum / Q000502:physiology; D003463:Cues; D030141:Feedback, Psychological / Q000502:physiology*; D005260:Female; D006801:Humans; D007858:Learning / Q000502:physiology*; D008279:Magnetic Resonance Imaging; D008297:Male; D008960:Models, Psychological; D010775:Photic Stimulation; D012054:Reinforcement, Psychology; D012201:Reward; D014796:Visual Perception / Q000502:physiology*; D055815:Young Adult
keywords: Cerebellum; Learning; Observation; Prediction error; Reward; Striatum