Trend detection via temporal difference model predicts inferior prefrontal cortex activation during acquisition of advantageous action selection.
The process of accurately predicting which actions are associated with advantageous versus disadvantageous outcomes is an important function of daily life. An integral part of this process is being able to detect when the association between an action and an outcome changes. This investigation examined the hypothesis that the inferior prefrontal cortex is critical for the detection of trends and that a trend process derived from the temporal difference model accomplishes this detection. Nineteen normal right-handed volunteers completed 120 4-s trials of a Rock Paper Scissors (RPS) task during functional magnetic resonance imaging. Subjects acquired the selection of advantageous actions during the RPS task. Activations in the medial frontal gyrus (BA 10), left ventrolateral frontal gyrus (BA 11/47), and left pallidum were significantly higher during trials in which subjects acquired the advantageous action. The time course of individually derived trend detection functions was found to be time-locked to the hemodynamic changes in the inferior frontal gyrus. These findings are consistent with the hypothesis that the inferior prefrontal cortex computes a trend from previously experienced action-outcome sequences based on a value function derived from the temporal difference model.
Paulus
Martin P
MP
Laboratory of Biological Dynamics and Theoretical Medicine, and Department of Psychiatry, University of California San Diego, and Veterans Affairs San Diego Healthcare System, 92093-0603, USA. martin@mag.ucsd.edu
Feinstein
Justin S
JS
Tapert
Susan F
SF
Liu
Thomas T
TT
D001245:Association Learning / Q000502:physiology; D001288:Attention / Q000502:physiology*; D001931:Brain Mapping; D003657:Decision Making / Q000502:physiology*; D004292:Dominance, Cerebral / Q000502:physiology; D005625:Frontal Lobe / Q000502:physiology; D005917:Globus Pallidus / Q000502:physiology; D006801:Humans; D007089:Image Enhancement; D007091:Image Processing, Computer-Assisted; D008279:Magnetic Resonance Imaging; D008432:Mathematical Computing; D015233:Models, Statistical; D009042:Motivation; D009415:Nerve Net / Q000502:physiology; D010101:Oxygen Consumption / Q000502:physiology; D010296:Parietal Lobe / Q000502:physiology; D017397:Prefrontal Cortex / Q000502:physiology*; D011340:Problem Solving / Q000502:physiology*; D011597:Psychomotor Performance / Q000502:physiology*; D011930:Reaction Time / Q000502:physiology*; D013702:Temporal Lobe / Q000502:physiology