title: Cross-modal and scale-free action representations through enaction.
abstract: Embodied action representation and action understanding are the first steps to understand what it means to communicate. We present a biologically plausible mechanism to the representation and the recognition of actions in a neural network with spiking neurons based on the learning mechanism of spike-timing-dependent plasticity (STDP). We show how grasping is represented through the multi-modal integration between the vision and tactile maps across multiple temporal scales. The network evolves into a small-world organization with scale-free dynamics promoting efficient inter-modal binding of the neural assemblies with accurate timing. Finally, it acquires the qualitative properties of the mirror neuron system to trigger an observed action performed by someone else.
authors.affiliation: ERATO Synergistic Intelligence Project, JST, The University of Tokyo, 113-8656 Tokyo, Japan. alex@jeap.org
authors.forename: Alex
authors.initials: A
authors.lastname: Pitti
authors.forename: Hassan
authors.initials: H
authors.lastname: Alirezaei
authors.forename: Yasuo
authors.initials: Y
authors.lastname: Kuniyoshi
mesh_terms: D000465:Algorithms; D016000:Cluster Analysis; D003142:Communication; D032882:Comprehension / Q000502:physiology; D003199:Computer Systems; D018737:Hand Strength / Q000502:physiology; D007858:Learning / Q000502:physiology; D008959:Models, Neurological; D015233:Models, Statistical; D016571:Neural Networks, Computer; D009473:Neuronal Plasticity; D011597:Psychomotor Performance / Q000502:physiology; D021641:Recognition, Psychology / Q000502:physiology*; D012160:Retina / Q000502:physiology; D014110:Touch / Q000502:physiology