title: User-Perspective AR Magic Lens from Gradient-Based IBR and Semi-Dense Stereo.
abstract: We present a new approach to rendering a geometrically-correct user-perspective view for a magic lens interface, based on leveraging the gradients in the real world scene. Our approach couples a recent gradient-domain image-based rendering method with a novel semi-dense stereo matching algorithm. Our stereo algorithm borrows ideas from PatchMatch, and adapts them to semi-dense stereo. This approach is implemented in a prototype device build from off-the-shelf hardware, with no active depth sensing. Despite the limited depth data, we achieve high-quality rendering for the user-perspective magic lens.
authors.forename: Domagoj
authors.initials: D
authors.lastname: Baricevic
authors.forename: Tobias
authors.initials: T
authors.lastname: Hollerer
authors.forename: Pradeep
authors.initials: P
authors.lastname: Sen
authors.forename: Matthew
authors.initials: M
authors.lastname: Turk