Arbitrary viewpoint video synthesis from multiple uncalibrated cameras.
We propose a method for arbitrary view synthesis from uncalibrated multiple camera system, targeting large spaces such as soccer stadiums. In Projective Grid Space (PGS), which is a three-dimensional space defined by epipolar geometry between two basis cameras in the camera system, we reconstruct three-dimensional shape models from silhouette images. Using the three-dimensional shape models reconstructed in the PGS, we obtain a dense map of the point correspondence between reference images. The obtained correspondence can synthesize the image of arbitrary view between the reference images. We also propose a method for merging the synthesized images with the virtual background scene in the PGS. We apply the proposed methods to image sequences taken by a multiple camera system, which installed in a large concert hall. The synthesized image sequences of virtual camera have enough quality to demonstrate effectiveness of the proposed method.
Yaguchi
Satoshi
S
Department of Information and Computer Science, Keio University, Yokohama 223-8522, Japan. yagu@ozawa.ics.keio.ac.jp
Saito
Hideo
H
D000465:Algorithms; D002138:Calibration; D003196:Computer Graphics; D003198:Computer Simulation; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D010363:Pattern Recognition, Automated; D010780:Photogrammetry / Q000379:methods*; D013382:Subtraction Technique; D014584:User-Computer Interface; D014741:Video Recording / Q000295:instrumentation / Q000379:methods*