Geometry-driven photorealistic facial expression synthesis.
Expression mapping (also called performance driven animation) has been a popular method for generating facial animations. A shortcoming of this method is that it does not generate expression details such as the wrinkles due to skin deformations. In this paper, we provide a solution to this problem. We have developed a geometry-driven facial expression synthesis system. Given feature point positions (the geometry) of a facial expression, our system automatically synthesizes a corresponding expression image that includes photorealistic and natural looking expression details. Due to the difficulty of point tracking, the number of feature points required by the synthesis system is, in general, more than what is directly available from a performance sequence. We have developed a technique to infer the missing feature point motions from the tracked subset by using an example-based approach. Another application of our system is expression editing where the user drags feature points while the system interactively generates facial expressions with skin deformation details.
Zhang
Qingshan
Q
Research and Innovation Center, Alcatel Shanghai Bell Ltd, Pudong, Shanghai. Qingshan.ZHANG@alcatel-sbell.co.cn
Liu
Zicheng
Z
Guo
Baining
B
Terzopoulos
Demetri
D
Shum
Heung-Yeung
HY
D000465:Algorithms; D003196:Computer Graphics; D005145:Face / Q000033:anatomy & histology*; D005149:Facial Expression; D006801:Humans; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods; D010363:Pattern Recognition, Automated / Q000379:methods; D010781:Photography / Q000379:methods*; D014584:User-Computer Interface; D014741:Video Recording / Q000379:methods