title: Stages as models of scene geometry.
abstract: Reconstruction of 3D scene geometry is an important element for scene understanding, autonomous vehicle and robot navigation, image retrieval, and 3D television. We propose accounting for the inherent structure of the visual world when trying to solve the scene reconstruction problem. Consequently, we identify geometric scene categorization as the first step toward robust and efficient depth estimation from single images. We introduce 15 typical 3D scene geometries called stages, each with a unique depth profile, which roughly correspond to a large majority of broadcast video frames. Stage information serves as a first approximation of global depth, narrowing down the search space in depth estimation and object localization. We propose different sets of low-level features for depth estimation, and perform stage classification on two diverse data sets of television broadcasts. Classification results demonstrate that stages can often be efficiently learned from low-dimensional image representations.
authors.affiliation: Intelligent Systems Lab Amsterdam (ISLA), University of Amsterdam, Science Park 107, 1098 XG Amsterdam, The Netherlands. vnedovic@science.uva.nl
authors.forename: Vladimir
authors.initials: V
authors.lastname: Nedović
authors.forename: Arnold W M
authors.initials: AW
authors.lastname: Smeulders
authors.forename: André
authors.initials: A
authors.lastname: Redert
authors.forename: Jan-Mark
authors.initials: JM
authors.lastname: Geusebroek
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D003198:Computer Simulation; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008962:Models, Theoretical; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity