title: Direct estimation of nonrigid registrations with image-based self-occlusion reasoning.
abstract: The registration problem for images of a deforming surface has been well studied. External occlusions are usually well handled. In 2D image-based registration, self-occlusions are more challenging. Consequently, the surface is usually assumed to be only slightly self-occluding. This paper is about image-based nonrigid registration with self-occlusion reasoning. A specific framework explicitly modeling self-occlusions is proposed. It is combined with an intensity-based, "direct" data term for registration. Self-occlusions are detected as shrinkage areas in the 2D warp. Experimental results on several challenging data sets show that our approach successfully registers images with self-occlusions while effectively detecting the self-occluded regions.
authors.affiliation: CEA Saclay and LASMEA, UMR, CNRS/UBP, France. vincentgaybellile@hotmail.fr
authors.forename: Vincent
authors.initials: V
authors.lastname: Gay-Bellile
authors.forename: Adrien
authors.initials: A
authors.lastname: Bartoli
authors.forename: Patrick
authors.initials: P
authors.lastname: Sayd