title: Seeing people in different light--joint shape, motion, and reflectance capture.
abstract: By means of passive optical motion capture, real people can be authentically animated and photo-realistically textured. To import real-world characters into virtual environments, however, surface reflectance properties must also be known. We describe a video-based modeling approach that captures human shape and motion as well as reflectance characteristics from a handful of synchronized video recordings. The presented method is able to recover spatially varying surface reflectance properties of clothes from multiview video footage. The resulting model description enables us to realistically reproduce the appearance of animated virtual actors under different lighting conditions, as well as to interchange surface attributes among different people, e.g., for virtual dressing. Our contribution can be used to create 3D renditions of real-world people under arbitrary novel lighting conditions on standard graphics hardware.
authors.affiliation: MPI Informatic, Saarbuecken, Germany. theobalt@mpi-inf.mpg.de
authors.forename: Christian
authors.initials: C
authors.lastname: Theobalt
authors.forename: Naveed
authors.initials: N
authors.lastname: Ahmed
authors.forename: Hendrik
authors.initials: H
authors.lastname: Lensch
authors.forename: Marcus
authors.initials: M
authors.lastname: Magnor
authors.forename: Hans-Peter
authors.initials: HP
authors.lastname: Seidel
mesh_terms: D003196:Computer Graphics; D003198:Computer Simulation; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods; D007596:Joints / Q000033:anatomy & histology* / Q000502:physiology*; D008029:Lighting / Q000379:methods*; D008954:Models, Biological; D009068:Movement / Q000502:physiology*; D014584:User-Computer Interface