Emotional facial expression model building

被引:18
作者
Du, YZ [1 ]
Lin, XY [1 ]
机构
[1] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
emotional expression; realistic face animation; expression ratio images; emotional function; flexible models;
D O I
10.1016/S0167-8655(03)00153-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human face plays a crucial role in interpersonal communication. If we synthesize vivid expressional face in cyberspace, we could make the interaction between computer and human more natural and friendly. In this paper, we present a simple methodology for mimicking realistic face by manipulating emotional states. Compared with traditional methods of facial expression synthesis, our approach takes three advantages at the same time. They are (1) generating facial expressions under quantitative control of emotional states, (2) rendering shape and illumination changes on face simultaneously and (3) synthesizing expressional face for any new person by only utilizing a neutral face image. We have discussed the implementation method in the paper and demonstrated the effects of our approach by using a series of interesting experiments, such as predicting unseen expressions for an unfamiliar person, simulating one's facial expressions with someone else's style, extracting pure emotional expressions from the admixtures. (C) 2003 Elsevier B.V. All rights reserved.
引用
收藏
页码:2923 / 2934
页数:12
相关论文
共 18 条
[1]   MPEG-4 facial animation technology: Survey, implementation, and results [J].
Abrantes, GA ;
Pereira, F .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1999, 9 (02) :290-305
[2]  
Aizawa K., 1989, Signal Processing: Image Communication, V1, P139, DOI 10.1016/0923-5965(89)90006-4
[3]  
[Anonymous], 1998, P 25 ANN C COMP GRAP
[4]   Real-time MPEG-4 facial animation with 3D scalable meshes [J].
Bonamico, C ;
Costa, M ;
Lavagetto, F ;
Pockaj, R .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2002, 17 (09) :743-757
[5]   ACTIVE SHAPE MODELS - THEIR TRAINING AND APPLICATION [J].
COOTES, TF ;
TAYLOR, CJ ;
COOPER, DH ;
GRAHAM, J .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1995, 61 (01) :38-59
[6]   Sample-based synthesis of photo-realistic talking heads [J].
Cosatto, E ;
Graf, HP .
COMPUTER ANIMATION 98 - PROCEEDINGS, 1998, :103-110
[7]  
Du YZ, 2002, INT C PATT RECOG, P524, DOI 10.1109/ICPR.2002.1048355
[8]   Facial analysis and synthesis using image-based models [J].
Ezzat, T ;
Poggio, T .
PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, 1996, :116-121
[9]   Real-time speech-driven face animation with expressions using neural networks [J].
Hong, PY ;
Wen, Z ;
Huang, TS .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (04) :916-927
[10]   Automatic interpretation and coding of face images using flexible models [J].
Lanitis, A ;
Taylor, CJ ;
Cootes, TF .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :743-756