title: Online learning of correspondences between images.
abstract: We propose a novel method for iterative learning of point correspondences between image sequences. Points moving on surfaces in 3D space are projected into two images. Given a point in either view, the considered problem is to determine the corresponding location in the other view. The geometry and distortions of the projections are unknown, as is the shape of the surface. Given several pairs of point sets but no access to the 3D scene, correspondence mappings can be found by excessive global optimization or by the fundamental matrix if a perspective projective model is assumed. However, an iterative solution on sequences of point-set pairs with general imaging geometry is preferable. We derive such a method that optimizes the mapping based on Neyman's chi-square divergence between the densities representing the uncertainties of the estimated and the actual locations. The densities are represented as channel vectors computed with a basis function approach. The mapping between these vectors is updated with each new pair of images such that fast convergence and high accuracy are achieved. The resulting algorithm runs in real time and is superior to state-of-the-art methods in terms of convergence and accuracy in a number of experiments.
authors.affiliation: Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Linköping SE-581 83, Sweden. michael.felsberg@liu.se
authors.forename: Michael
authors.initials: M
authors.lastname: Felsberg
authors.forename: Fredrik
authors.initials: F
authors.lastname: Larsson
authors.forename: Johan
authors.initials: J
authors.lastname: Wiklund
authors.forename: Niclas
authors.initials: N
authors.lastname: Wadströmer
authors.forename: Jörgen
authors.initials: J
authors.lastname: Ahlberg
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D009862:Online Systems; D010363:Pattern Recognition, Automated / Q000379:methods*; D013382:Subtraction Technique