Stereo matching with linear superposition of layers.
In this paper, we address stereo matching in the presence of a class of non-Lambertian effects, where image formation can be modeled as the additive superposition of layers at different depths. The presence of such effects makes it impossible for traditional stereo vision algorithms to recover depths using direct color matching-based methods. We develop several techniques to estimate both depths and colors of the component layers. Depth hypotheses are enumerated in pairs, one from each layer, in a nested plane sweep. For each pair of depth hypotheses, matching is accomplished using spatial-temporal differencing. We then use graph cut optimization to solve for the depths of both layers. This is followed by an iterative color update algorithm which we proved to be convergent. Our algorithm recovers depth and color estimates for both synthetic and real image sequences.
Siemens Corporate Research, 755 College Road East, Princeton, NJ 08540, USA. yanghai.tsin@siemens.com
Yanghai
Y
Tsin
Sing Bing
SB
Kang
Richard
R
Szeliski
D000465:Algorithms; D001185:Artificial Intelligence; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D016247:Information Storage and Retrieval / Q000379:methods; D010363:Pattern Recognition, Automated / Q000379:methods*; D010780:Photogrammetry / Q000379:methods*; D013382:Subtraction Technique