title: A spiking neuron model of the cortico-basal ganglia circuits for goal-directed and habitual action learning.
abstract: Dual-system theories postulate that actions are supported either by a goal-directed or by a habit-driven response system. Neuroimaging and anatomo-functional studies have provided evidence that the prefrontal cortex plays a fundamental role in the first type of action control, while internal brain areas such as the basal ganglia are more active during habitual and overtrained responses. Additionally, it has been shown that areas of the cortex and the basal ganglia are connected through multiple parallel "channels", which are thought to function as an action selection mechanism resolving competitions between alternative options available in a given context. In this paper we propose a multi-layer network of spiking neurons that implements in detail the thalamo-cortical circuits that are believed to be involved in action learning and execution. A key feature of this model is that neurons are organized in small pools in the motor cortex and form independent loops with specific pools of the basal ganglia where inhibitory circuits implement a multistep selection mechanism. The described model has been validated utilizing it to control the actions of a virtual monkey that has to learn to turn on briefly flashing lights by pressing corresponding buttons on a board. When the animal is able to fluently execute the task the button-light associations are remapped so that it has to suppress its habitual behavior in order to execute goal-directed actions. The model nicely shows how sensory-motor associations for action sequences are formed at the cortico-basal ganglia level and how goal-directed decisions may override automatic motor responses.
authors.affiliation: Institute of Cognitive Sciences and Technologies, National Research Council. Via San Martino della Battaglia 44, 00185 Roma, Italy. fabian.chersi@istc.cnr.it
authors.forename: Fabian
authors.initials: F
authors.lastname: Chersi
authors.forename: Marco
authors.initials: M
authors.lastname: Mirolli
authors.forename: Giovanni
authors.initials: G
authors.lastname: Pezzulo
authors.forename: Gianluca
authors.initials: G
authors.lastname: Baldassarre
mesh_terms: D000200:Action Potentials / Q000502:physiology*; D000818:Animals; D001479:Basal Ganglia / Q000166:cytology / Q000502:physiology*; D002540:Cerebral Cortex / Q000166:cytology / Q000502:physiology*; D006040:Goals; D006184:Habits; D000882:Haplorhini; D008959:Models, Neurological; D009044:Motor Cortex / Q000166:cytology / Q000502:physiology; D009433:Neural Inhibition / Q000502:physiology; D009434:Neural Pathways; D009474:Neurons / Q000502:physiology*; D018377:Neurotransmitter Agents / Q000502:physiology; D011340:Problem Solving / Q000502:physiology; D011597:Psychomotor Performance / Q000502:physiology*; D018091:Receptors, AMPA / Q000502:physiology; D016194:Receptors, N-Methyl-D-Aspartate / Q000502:physiology; D013003:Somatosensory Cortex / Q000166:cytology / Q000502:physiology; D013788:Thalamus / Q000166:cytology / Q000502:physiology; D014793:Visual Cortex / Q000166:cytology / Q000502:physiology
chemical_list: D018377:Neurotransmitter Agents; D018091:Receptors, AMPA; D016194:Receptors, N-Methyl-D-Aspartate