title: 3D high-efficiency video coding for multi-view video and depth data.
abstract: This paper describes an extension of the high efficiency video coding (HEVC) standard for coding of multi-view video and depth data. In addition to the known concept of disparity-compensated prediction, inter-view motion parameter, and inter-view residual prediction for coding of the dependent video views are developed and integrated. Furthermore, for depth coding, new intra coding modes, a modified motion compensation and motion vector coding as well as the concept of motion parameter inheritance are part of the HEVC extension. A novel encoder control uses view synthesis optimization, which guarantees that high quality intermediate views can be generated based on the decoded data. The bitstream format supports the extraction of partial bitstreams, so that conventional 2D video, stereo video, and the full multi-view video plus depth format can be decoded from a single bitstream. Objective and subjective results are presented, demonstrating that the proposed approach provides 50% bit rate savings in comparison with HEVC simulcast and 20% in comparison with a straightforward multi-view extension of HEVC without the newly developed coding tools.
authors.affiliation: Image Processing Department, Fraunhofer Institute for Telecommunications-Heinrich-Hertz-Institut, Berlin 10587, Germany. karsten.mueller@hhi.fraunhofer.de
authors.forename: Karsten
authors.initials: K
authors.lastname: Muller
authors.forename: Heiko
authors.initials: H
authors.lastname: Schwarz
authors.forename: Detlev
authors.initials: D
authors.lastname: Marpe
authors.forename: Christian
authors.initials: C
authors.lastname: Bartnik
authors.forename: Sebastian
authors.initials: S
authors.lastname: Bosse
authors.forename: Heribert
authors.initials: H
authors.lastname: Brust
authors.forename: Tobias
authors.initials: T
authors.lastname: Hinz
authors.forename: Haricharan
authors.initials: H
authors.lastname: Lakshman
authors.forename: Philipp
authors.initials: P
authors.lastname: Merkle
authors.forename: Franz Hunn
authors.initials: FH
authors.lastname: Rhee
authors.forename: Gerhard
authors.initials: G
authors.lastname: Tech
authors.forename: Martin
authors.initials: M
authors.lastname: Winken
authors.forename: Thomas
authors.initials: T
authors.lastname: Wiegand