Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.
Instrumental behaviour is controlled by two systems: a stimulus-response habit mechanism and a goal-directed process that involves two forms of learning. The first is learning about the instrumental contingency between the response and reward, whereas the second consists of the acquisition of incentive value by the reward. Evidence for contingency learning comes from studies of reward devaluation and from demonstrations that instrumental performance is sensitive not only the probability of contiguous reward but also to the probability of unpaired rewards. The process of incentive learning is evident in the acquisition of control over performance by primary motivational states. Preliminary lesion studies of the rat suggest that the prelimbic area of prefrontal cortex plays a role in the contingency learning, whereas the incentive learning for food rewards involves the insular cortex.
Balleine
B W
BW
Department of Psychology, UCLA, Los Angeles, CA 90095-1563, USA.
Dickinson
A
A
D000223:Adaptation, Psychological; D000818:Animals; D001522:Behavior, Animal / Q000502:physiology; D002540:Cerebral Cortex / Q000502:physiology*; D003216:Conditioning, Operant / Q000502:physiology*; D006040:Goals; D006801:Humans; D009042:Motivation