Measuring facial expressions by computer image analysis

被引:231
作者
Bartlett, MS
Hager, JC
Ekman, P
Sejnowski, TJ
机构
[1] Salk Inst Biol Studies, CNL, La Jolla, CA 92037 USA
[2] Univ Calif San Diego, Dept Cognit Sci, San Diego, CA 92103 USA
[3] Univ Calif San Diego, Dept Psychol, San Diego, CA 92103 USA
[4] Network Informat Res Corp, Salt Lake City, UT USA
[5] Univ Calif San Francisco, Dept Psychiat, San Francisco, CA 94143 USA
[6] Univ Calif San Diego, Dept Biol, San Diego, CA 92103 USA
[7] Salk Inst Biol Studies, Howard Hughes Med Inst, Computat Neurobiol Lab, La Jolla, CA 92037 USA
关键词
facial expression; Facial Action Coding System (FACS); emotion; computer image analysis;
D O I
10.1017/S0048577299971664
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Facial expressions provide an important behavioral measure for the study of emotion, cognitive processes, and social interaction. The Facial Action Coding System (Ekman & Friesen, 1978) is an objective method for quantifying facial movement in terms of component actions. We applied computer image analysis to the problem of automatically detecting facial actions in sequences of images. Three approaches were compared: holistic spatial analysis, explicit measurement of features such as wrinkles, and estimation of motion flow fields. The three methods were combined in a hybrid system that classified six upper facial actions with 91% accuracy. The hybrid system outperformed human nonexperts on this task and performed as well as highly trained experts. An automated system would make facial expression measurement more widely accessible as a research tool in behavioral science and investigations of the neural substrates of emotion.
引用
收藏
页码:253 / 263
页数:11
相关论文
共 56 条
[1]  
Adolphs R, 1996, J NEUROSCI, V16, P7678
[2]  
ADOLPHS R, 1995, J NEUROSCI, V15, P5879
[3]  
[Anonymous], ADV NEURAL INFORM PR
[4]  
[Anonymous], J PSYCHOPHYSIOLOGY
[5]  
Bartlett MS, 1996, ADV NEUR IN, V8, P823
[7]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[8]  
BEYMER D, 1993, 1431 AI
[9]  
BEYMER DJ, 1994, 1994 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, P756, DOI 10.1109/CVPR.1994.323893
[10]   Response and habituation of the human amygdala during visual processing of facial expression [J].
Breiter, HC ;
Etcoff, NL ;
Whalen, PJ ;
Kennedy, WA ;
Rauch, SL ;
Buckner, RL ;
Strauss, MM ;
Hyman, SE ;
Rosen, BR .
NEURON, 1996, 17 (05) :875-887