title: Event-based 3D reconstruction from neuromorphic retinas.
abstract: This paper presents a novel N-ocular 3D reconstruction algorithm for event-based vision data from bio-inspired artificial retina sensors. Artificial retinas capture visual information asynchronously and encode it into streams of asynchronous spike-like pulse signals carrying information on, e.g., temporal contrast events in the scene. The precise time of the occurrence of these visual features are implicitly encoded in the spike timings. Due to the high temporal resolution of the asynchronous visual information acquisition, the output of these sensors is ideally suited for dynamic 3D reconstruction. The presented technique takes full benefit of the event-driven operation, i.e. events are processed individually at the moment they arrive. This strategy allows us to preserve the original dynamics of the scene, hence allowing for more robust 3D reconstructions. As opposed to existing techniques, this algorithm is based on geometric and time constraints alone, making it particularly simple to implement and largely linear.
authors.affiliation: Université de Pierre et Marie Curie - Institut de la Vision, 17 rue Moreau, 75012 Paris, France. joao.carneiro@inserm.fr
authors.forename: João
authors.initials: J
authors.lastname: Carneiro
authors.forename: Sio-Hoi
authors.initials: SH
authors.lastname: Ieng
authors.forename: Christoph
authors.initials: C
authors.lastname: Posch
authors.forename: Ryad
authors.initials: R
authors.lastname: Benosman
mesh_terms: D000465:Algorithms; D003198:Computer Simulation; D006801:Humans; D021621:Imaging, Three-Dimensional; D008959:Models, Neurological; D015233:Models, Statistical; D009474:Neurons / Q000166:cytology* / Q000502:physiology*; D012160:Retina / Q000166:cytology*; D014785:Vision, Ocular / Q000502:physiology*; D014796:Visual Perception
keywords: 3D reconstruction; Asynchronous event-based vision; Neuromorphic vision; Stereovision