Facial Expression Recognition via Deep Learning

被引:60
作者
Zhao, Xiaoming [1 ]
Shi, Xugan [1 ,2 ]
Zhang, Shiqing [1 ]
机构
[1] Taizhou Univ, Inst Image Proc & Pattern Recognit, Taizhou 318000, Zhejiang, Peoples R China
[2] Zhejiang Sci Tech Univ, Sch Automat Control Mech, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep belief networks; Deep learning; Facial expression recognition; Feature learning; Multi-layer perceptron; Unsupervised; FACE RECOGNITION; PATTERN; REPRESENTATION;
D O I
10.1080/02564602.2015.1017542
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep learning is a newly-emerged machine learning theory, and has received extensive attentions in pattern recognition, signal processing, computer vision, etc. Deep belief networks (DBNs) is a representative method of deep learning and has a strong ability of unsupervised feature learning. In this paper, by combining DBNs with multi-layer perceptron (MLP), a new method of facial expression recognition based on deep learning is proposed. The proposed method integrates the DBNs's advantage of unsupervised feature learning with the MLP's classification advantage. Experimental results on two benchmarking facial expression databases, i.e., the JAFFE database and the Cohn-Kanade database, demonstrate the promising performance of the proposed method for facial expression recognition, outperforming the other state-of-the-art classification methods such as the nearest neighbour, MLP, support vector machine, the nearest subspace, as well as sparse representation-based classification.
引用
收藏
页码:347 / 355
页数:9
相关论文
共 37 条
[21]   PCA-based dictionary building for accurate facial expression recognition via sparse representation [J].
Mohammadi, M. R. ;
Fatemizadeh, E. ;
Mahoor, M. H. .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (05) :1082-1092
[22]   Multiresolution gray-scale and rotation invariant texture classification with local binary patterns [J].
Ojala, T ;
Pietikäinen, M ;
Mäenpää, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (07) :971-987
[23]  
Pearl J., 1988, PROBABILISTIC REASON
[24]   Application of Deep Belief Networks for Natural Language Understanding [J].
Sarikaya, Ruhi ;
Hinton, Geoffrey E. ;
Deoras, Anoop .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (04) :778-784
[25]  
Schuster-Bockler Benjamin, 2007, Curr Protoc Bioinformatics, VAppendix 3, p3A, DOI [10.1109/MASSP.1986.1165342, 10.1002/0471250953.bia03as18]
[26]   A quantitative theory of immediate visual recognition [J].
Serre, Thomas ;
Kreiman, Gabriel ;
Kouh, Minjoon ;
Cadieu, Charles ;
Knoblich, Ulf ;
Poggio, Tomaso .
COMPUTATIONAL NEUROSCIENCE: THEORETICAL INSIGHTS INTO BRAIN FUNCTION, 2007, 165 :33-56
[27]   Facial expression recognition based on Local Binary Patterns: A comprehensive study [J].
Shan, Caifeng ;
Gong, Shaogang ;
McOwan, Peter W. .
IMAGE AND VISION COMPUTING, 2009, 27 (06) :803-816
[28]   Depth Camera-Based Facial Expression Recognition System Using Multilayer Scheme [J].
Siddiqi, Muhammad Hameed ;
Ali, Rahman ;
Sattar, Abdul ;
Khan, Adil Mehmood ;
Lee, Sungyoung .
IETE TECHNICAL REVIEW, 2014, 31 (04) :277-286
[29]  
Tian Y., 2011, HDB FACE RECOGNITION, P487, DOI DOI 10.1007/978-0-85729-932-1_19
[30]   Sparse Representation for Computer Vision and Pattern Recognition [J].
Wright, John ;
Ma, Yi ;
Mairal, Julien ;
Sapiro, Guillermo ;
Huang, Thomas S. ;
Yan, Shuicheng .
PROCEEDINGS OF THE IEEE, 2010, 98 (06) :1031-1044