Invariant template matching in systems with spatiotemporal coding: A matter of instability.
We consider the design principles of algorithms that match templates to images subject to spatiotemporal encoding. Both templates and images are encoded as temporal sequences of samplings from spatial patterns. Matching is required to be tolerant to various combinations of image perturbations. These include ones that can be modeled as parameterized uncertainties such as image blur, luminance, and, as special cases, invariant transformation groups such as translation and rotations, as well as unmodeled uncertainties (noise). For a system to deal with such perturbations in an efficient way, they are to be handled through a minimal number of channels and by simple adaptation mechanisms. These normative requirements can be met within the mathematical framework of weakly attracting sets. We discuss explicit implementation of this principle in neural systems and show that it naturally explains a range of phenomena in biological vision, such as mental rotation, visual search, and the presence of multiple time scales in adaptation. We illustrate our results with an application to a realistic pattern recognition problem.
Tyukin
Ivan
I
Laboratory for Perceptual Dynamics, RIKEN (Institute for Physical and Chemical Research) Brain Science Institute, 2-1 Hirosawa, Wako-shi, Saitama 351-0198, Japan. tyukinivan@brain.riken.jp
Tyukina
Tatiana
T
van Leeuwen
Cees
C
D000222:Adaptation, Physiological / Q000502:physiology; D000465:Algorithms; D001185:Artificial Intelligence; D001921:Brain / Q000502:physiology; D003198:Computer Simulation; D005133:Eye Movements / Q000502:physiology; D019044:Image Cytometry / Q000379:methods; D007092:Imagination / Q000502:physiology; D016571:Neural Networks, Computer; D009949:Orientation / Q000502:physiology; D010363:Pattern Recognition, Automated; D010364:Pattern Recognition, Visual / Q000502:physiology; D011597:Psychomotor Performance / Q000502:physiology