A Saccade Based Framework for Real-Time Motion Segmentation Using Event Based Vision Sensors.
Motion segmentation is a critical pre-processing step for autonomous robotic systems to facilitate tracking of moving objects in cluttered environments. Event based sensors are low power analog devices that represent a scene by means of asynchronous information updates of only the dynamic details at high temporal resolution and, hence, require significantly less calculations. However, motion segmentation using spatiotemporal data is a challenging task due to data asynchrony. Prior approaches for object tracking using neuromorphic sensors perform well while the sensor is static or a known model of the object to be followed is available. To address these limitations, in this paper we develop a technique for generalized motion segmentation based on spatial statistics across time frames. First, we create micromotion on the platform to facilitate the separation of static and dynamic elements of a scene, inspired by human saccadic eye movements. Second, we introduce the concept ofspike-groupsas a methodology to partition spatio-temporal event groups, which facilitates computation of scene statistics and characterize objects in it. Experimental results show that our algorithm is able to classify dynamic objects with a moving camera with maximum accuracy of 92%.
Singapore Institute for Neurotechnology, National University of Singapore Singapore, Singapore.
Abhishek
A
Mishra
Singapore Institute for Neurotechnology, National University of Singapore Singapore, Singapore.
Rohan
R
Ghosh
Department of Electrical and Computer Engineering, University of Florida Gainesville, FL, USA.
Jose C
JC
Principe
Singapore Institute for Neurotechnology, National University of SingaporeSingapore, Singapore; Biomedical Engineering Department, Johns Hopkins UniversityBaltimore, MD, USA.
Nitish V
NV
Thakor
Singapore Institute for Neurotechnology, National University of Singapore Singapore, Singapore.
Sunil L
SL
Kukreja
asynchronous signal processing; dynamic vision sensors; motion segmentation; robotics; temporal information; tracking and following