Getting to know your neighbors: unsupervised learning of topography from real-world, event-based input.
Biological neural systems must grow their own connections and maintain topological relations between elements that are related to the sensory input surface. Artificial systems have traditionally prewired such maps, but the sensor arrangement is not always known and can be expensive to specify before run time. Here we present a method for learning and updating topographic maps in systems comprising modular, event-based elements. Using an unsupervised neural spike-timing-based learning rule combined with Hebbian learning, our algorithm uses the spatiotemporal coherence of the external world to train its network. It improves on existing algorithms by not assuming a known topography of the target map and includes a novel method for automatically detecting edge elements. We show how, for stimuli that are small relative to the sensor resolution, the temporal learning window parameters can be determined without using any user-specified constants. For stimuli that are larger relative to the sensor resolution, we provide a parameter extraction method that generally outperforms the small-stimulus method but requires one user-specified constant. The algorithm was tested on real data from a 64 x 64-pixel section of an event-based temporal contrast silicon retina and a 360-tile tactile luminous floor. It learned 95.8% of the correct neighborhood relations for the silicon retina within about 400 seconds of real-world input from a driving scene and 98.1% correct for the sensory floor after about 160 minutes of human pedestrian traffic. Residual errors occurred in regions receiving little or ambiguous input, and the learned topological representations were able to update automatically in response to simulated damage. Our algorithm has applications in the design of modular autonomous systems in which the interfaces between components are learned during operation rather than at design time.
Boerlin
Martin
M
Institute of Neuroinformatics, University of Zurich and ETH Zurich, CH-8057 Zurich, Switzerland. martin_boerlin@bluewin.ch
Delbruck
Tobi
T
Eng
Kynan
K
D000465:Algorithms; D003198:Computer Simulation; D006801:Humans; D007858:Learning / Q000502:physiology*; D016571:Neural Networks, Computer; D009474:Neurons / Q000502:physiology; D017711:Nonlinear Dynamics; D010775:Photic Stimulation / Q000379:methods; D012160:Retina / Q000166:cytology / Q000502:physiology; D012815:Signal Processing, Computer-Assisted; D013997:Time Factors; D014795:Visual Pathways / Q000502:physiology; D014796:Visual Perception / Q000502:physiology