Recovering three-dimensional structure from motion with surface reconstruction.
This paper addresses the computational role that the construction of a complete surface representation may play in the recovery of 3-D structure from motion. We first discuss the need to integrate surface reconstruction with the structure-from-motion process, both on computational and perceptual grounds. We then present a model that combines a feature-based structure-from-motion algorithm with a smooth surface interpolation mechanism. This model allows multiple surfaces to be represented in a given viewing direction, incorporates constraints on surface structure from object boundaries, and segregates image features onto multiple surfaces on the basis of their 2-D image motion. We present the results of computer simulations that relate the qualitative behavior of this model to psychophysical observations. In a companion paper, we discuss further perceptual observations regarding the possible role of surface reconstruction in the human recovery of 3-D structure from motion.
Hildreth
E C
EC
Department of Computer Science, Wellesley College, MA 02181.
Ando
H
H
Andersen
R A
RA
Treue
S
S
D000465:Algorithms; D003198:Computer Simulation; D003867:Depth Perception / Q000502:physiology*; D006801:Humans; D008954:Models, Biological; D009039:Motion Perception / Q000502:physiology*; D010364:Pattern Recognition, Visual / Q000502:physiology*; D011601:Psychophysics; D013997:Time Factors