Real and fictive outcomes are processed differently but converge on a common adaptive mechanism.
The ability to learn not only from experienced but also from merely fictive outcomes without direct rewarding or punishing consequences should improve learning and resulting value-guided choice. Using an instrumental learning task in combination with multiple single-trial regression of predictions derived from a computational reinforcement-learning model on human EEG, we found an early temporospatial double dissociation in the processing of fictive and real feedback. Thereafter, real and fictive feedback processing converged at a common final path, reflected in parietal EEG activity that was predictive of future choices. In the choice phase, similar parietal EEG activity related to certainty of the impending response was predictive for the decision on the next trial as well. These parietal EEG effects may reflect a common adaptive cortical mechanism of updating or strengthening of stimulus values by integrating outcomes, learning rate, and certainty, which is active during both decision making and evaluation. Neuronal processing of real (rewarding, punishing) and fictive action outcomes (which would have happened had one acted differently) differs for 400 ms and then converges on a common adaptive mechanism driving future decision making and learning.
Otto-von-Guericke University, Institute for Neuropsychology, 39106 Magdeburg, Germany; Max Planck Institute for Neurological Research, 50931 Cologne, Germany. Electronic address: adrian.fischer@ovgu.de.
Adrian G
AG
Fischer
Markus
M
Ullsperger
D000328:Adult; D000465:Algorithms; D000704:Analysis of Variance; D001921:Brain / Q000502:physiology*; D001931:Brain Mapping; D003198:Computer Simulation; D003216:Conditioning, Operant / Q000502:physiology*; D003657:Decision Making / Q000502:physiology*; D004569:Electroencephalography; D018913:Event-Related Potentials, P300; D030141:Feedback, Psychological / Q000502:physiology*; D005260:Female; D006801:Humans; D016015:Logistic Models; D008297:Male; D008954:Models, Biological; D011930:Reaction Time; D011936:Reality Testing; D055815:Young Adult