title: Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering.
abstract: We propose a wavelet-based codec for the static depth-image-based representation, which allows viewers to freely choose the viewpoint. The proposed codec jointly estimates and encodes the unknown depth map from multiple views using a novel rate-distortion (RD) optimization scheme. The rate constraint reduces the ambiguity of depth estimation by favoring piecewise-smooth depth maps. The optimization is efficiently solved by a novel dynamic programming along trees of integer wavelet coefficients. The codec encodes the image and the depth map jointly to decrease their redundancy and to provide a RD-optimized bitrate allocation between the two. The codec also offers scalability both in resolution and in quality. Experiments on real data show the effectiveness of the proposed codec.
authors.affiliation: Windows Experience Group, Microsoft, Redmont, WA 98052, USA. mmaitre@microsoft.com
authors.forename: Matthieu
authors.initials: M
authors.lastname: Maitre
authors.forename: Yoshihisa
authors.initials: Y
authors.lastname: Shinagawa
authors.forename: Minh N
authors.initials: MN
authors.lastname: Do
mesh_terms: D000465:Algorithms; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D012815:Signal Processing, Computer-Assisted