title: Multiview stereo via volumetric Graph-Cuts and occlusion robust photo-consistency.
abstract: This paper presents a volumetric formulation for the multi-view stereo problem which is amenable to a computationally tractable global optimisation using Graph-cuts. Our approach is to seek the optimal partitioning of 3D space into two regions labelled as "object" and "empty" under a cost functional consisting of the following two terms: (1) A term that forces the boundary between the two regions to pass through photo-consistent locations and (2) a ballooning term that inflates the "object" region. To take account of the effect of occlusion on the first term we use an occlusion robust photo-consistency metric based on Normalised Cross Correlation, which does not assume any geometric knowledge about the reconstructed object. The globally optimal 3D partitioning can be obtained as the minimum cut solution of a weighted graph.
authors.affiliation: Toshiba Research Europe Ltd., Cambridge, UK. george.vogiatzis@crl.toshiba.co.uk
authors.forename: George
authors.initials: G
authors.lastname: Vogiatzis
authors.forename: Carlos
authors.initials: C
authors.lastname: Hernández Esteban
authors.forename: Philip H S
authors.initials: PH
authors.lastname: Torr
authors.forename: Roberto
authors.initials: R
authors.lastname: Cipolla
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D010780:Photogrammetry / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity