title: Dynamic Human Body Modeling Using a Single RGB Camera.
abstract: In this paper, we present a novel automatic pipeline to build personalized parametric models of dynamic people using a single RGB camera. Compared to previous approaches that use monocular RGB images, our system can model a 3D human body automatically and incrementally, taking advantage of human motion. Based on coarse 2D and 3D poses estimated from image sequences, we first perform a kinematic classification of human body parts to refine the poses and obtain reconstructed body parts. Next, a personalized parametric human model is generated by driving a general template to fit the body parts and calculating the non-rigid deformation. Experimental results show that our shape estimation method achieves comparable accuracy with reconstructed models using depth cameras, yet requires neither user interaction nor any dedicated devices, leading to the feasibility of using this method on widely available smart phones.
authors.affiliation: School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. MF1423044@smail.nju.edu.cn.
authors.forename: Haiyu
authors.initials: H
authors.lastname: Zhu
authors.affiliation: School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. allanyu@nju.edu.cn.
authors.forename: Yao
authors.initials: Y
authors.lastname: Yu
authors.affiliation: School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. nackzhou@nju.edu.cn.
authors.forename: Yu
authors.initials: Y
authors.lastname: Zhou
authors.affiliation: School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, China. coff128@nju.edu.cn.
authors.forename: Sidan
authors.initials: S
authors.lastname: Du
mesh_terms: D000465:Algorithms; D001696:Biomechanical Phenomena; D018594:Human Body; D006801:Humans; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008962:Models, Theoretical; D008991:Monitoring, Physiologic; D011187:Posture / Q000502:physiology*
keywords: SCAPE; motion classification; non-rigid reconstruction; pose estimation; single RGB camera; structure from motion