Cross-modal and scale-free action representations through enaction.
Embodied action representation and action understanding are the first steps to understand what it means to communicate. We present a biologically plausible mechanism to the representation and the recognition of actions in a neural network with spiking neurons based on the learning mechanism of spike-timing-dependent plasticity (STDP). We show how grasping is represented through the multi-modal integration between the vision and tactile maps across multiple temporal scales. The network evolves into a small-world organization with scale-free dynamics promoting efficient inter-modal binding of the neural assemblies with accurate timing. Finally, it acquires the qualitative properties of the mirror neuron system to trigger an observed action performed by someone else.
Pitti
Alex
A
ERATO Synergistic Intelligence Project, JST, The University of Tokyo, 113-8656 Tokyo, Japan. alex@jeap.org
Alirezaei
Hassan
H
Kuniyoshi
Yasuo
Y
D000465:Algorithms; D016000:Cluster Analysis; D003142:Communication; D032882:Comprehension / Q000502:physiology; D003199:Computer Systems; D018737:Hand Strength / Q000502:physiology; D007858:Learning / Q000502:physiology; D008959:Models, Neurological; D015233:Models, Statistical; D016571:Neural Networks, Computer; D009473:Neuronal Plasticity; D011597:Psychomotor Performance / Q000502:physiology; D021641:Recognition, Psychology / Q000502:physiology*; D012160:Retina / Q000502:physiology; D014110:Touch / Q000502:physiology