title: Efficient feedforward categorization of objects and human postures with address-event image sensors.
abstract: This paper proposes an algorithm for feedforward categorization of objects and, in particular, human postures in real-time video sequences from address-event temporal-difference image sensors. The system employs an innovative combination of event based hardware and bio-inspired software architecture. An event-based temporal difference image sensor is used to provide input video sequences, while a software module extracts size and position invariant line features inspired by models of the primate visual cortex. The detected line features are organized into vectorial segments. After feature extraction, a modified line segment Hausdorff distance classifier combined with on-the-fly cluster-based size and position invariant categorization. The system can achieve about 90 percent average success rate in the categorization of human postures, while using only a small number of training samples. Compared to state-of-the-art bio-inspired categorization methods, the proposed algorithm requires less hardware resource, reduces the computation complexity by at least five times, and is an ideal candidate for hardware implementation with event-based circuits.
authors.affiliation: School of Electrical and Electronic Engineering (EEE), Nanyang Technological University, Singapore. eechenss@ntu.edu.sg
authors.forename: Shoushun
authors.initials: S
authors.lastname: Chen
authors.forename: Polina
authors.initials: P
authors.lastname: Akselrod
authors.forename: Bo
authors.initials: B
authors.lastname: Zhao
authors.forename: Jose Antonio Perez
authors.initials: JA
authors.lastname: Carrasco
authors.forename: Bernabe
authors.initials: B
authors.lastname: Linares-Barranco
authors.forename: Eugenio
authors.initials: E
authors.lastname: Culurciello
mesh_terms: D000465:Algorithms; D006801:Humans; D007091:Image Processing, Computer-Assisted / Q000379:methods*; D008954:Models, Biological; D010363:Pattern Recognition, Automated / Q000379:methods*; D011187:Posture / Q000502:physiology*; D014741:Video Recording; D014793:Visual Cortex