title: Geometry-driven photorealistic facial expression synthesis.
abstract: Expression mapping (also called performance driven animation) has been a popular method for generating facial animations. A shortcoming of this method is that it does not generate expression details such as the wrinkles due to skin deformations. In this paper, we provide a solution to this problem. We have developed a geometry-driven facial expression synthesis system. Given feature point positions (the geometry) of a facial expression, our system automatically synthesizes a corresponding expression image that includes photorealistic and natural looking expression details. Due to the difficulty of point tracking, the number of feature points required by the synthesis system is, in general, more than what is directly available from a performance sequence. We have developed a technique to infer the missing feature point motions from the tracked subset by using an example-based approach. Another application of our system is expression editing where the user drags feature points while the system interactively generates facial expressions with skin deformation details.
authors.affiliation: Research and Innovation Center, Alcatel Shanghai Bell Ltd, Pudong, Shanghai. Qingshan.ZHANG@alcatel-sbell.co.cn
authors.forename: Qingshan
authors.initials: Q
authors.lastname: Zhang
authors.forename: Zicheng
authors.initials: Z
authors.lastname: Liu
authors.forename: Baining
authors.initials: B
authors.lastname: Guo
authors.forename: Demetri
authors.initials: D
authors.lastname: Terzopoulos
authors.forename: Heung-Yeung
authors.initials: HY
authors.lastname: Shum
mesh_terms: D000465:Algorithms; D003196:Computer Graphics; D005145:Face / Q000033:anatomy & histology*; D005149:Facial Expression; D006801:Humans; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods; D010363:Pattern Recognition, Automated / Q000379:methods; D010781:Photography / Q000379:methods*; D014584:User-Computer Interface; D014741:Video Recording / Q000379:methods