Depth Camera-Based Facial Expression Recognition System Using Multilayer Scheme

被引:31
作者
Siddiqi, Muhammad Hameed [1 ]
Ali, Rahman [1 ]
Sattar, Abdul [2 ]
Khan, Adil Mehmood [3 ]
Lee, Sungyoung [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Engn, Suwon 446701, South Korea
[2] Kyung Hee Univ, Dept Biomed Engn, Suwon 446701, South Korea
[3] Ajou Univ, Div Informat & Comp Engn, Suwon 443749, South Korea
基金
新加坡国家研究基金会;
关键词
Facial expressions; Depth camera; Principal component analysis; Independent component analysis; Linear discriminant analysis; Hidden Markov model; PATTERN;
D O I
10.1080/02564602.2014.944588
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The analysis of a facial expression in telemedicine and healthcare plays a significant role in providing sufficient information about patients such as stroke and cardiac in monitoring their expressions for better management of their diseases. Facial expression recognition (FER) improves the level of interaction between human-to-human communications. The human face has a major contribution for such types of communications, which consists of lips, eyes and forehead that are considered the most informative features for FER. There are some parameters that make FER a challenging task that includes high similarity among different expressions that makes it difficult to distinguish these expressions with a high accuracy. Moreover, most of the previous works used existing available standard datasets and all the datasets were pose-based datasets, and they have some privacy issues because of utilizing video (RGB) cameras. Accordingly, this work presents a multilayer scheme for FER to handle these issues. In the proposed FER system, we utilized a depth camera in order to solve the privacy concerns, and the accuracy of this camera is not affected by any kind of environmental parameters. Similarly, the depth camera automatically detects and extracts the faces based on the distance between the camera and subject. For global and local feature extraction, principal component analysis (PCA) and independent component analysis (ICA) were used. A hierarchical classifier was used, where the expression category was recognized at the first level, followed by the actual expression recognition at the second level. For the entire experiments, an n-fold cross-validation scheme (based on subjects) was employed. The proposed FER system achieved a significant improvement in accuracy (98.0%) against the existing methods.
引用
收藏
页码:277 / 286
页数:10
相关论文
共 43 条
[41]  
Xianxing Wu, 2010, Proceedings 2010 Sixth International Conference on Natural Computation (ICNC 2010), P1212, DOI 10.1109/ICNC.2010.5583642
[42]   Recognition of facial expressions and measurement of levels of interest from video [J].
Yeasin, Mohammed ;
Bullot, Baptiste ;
Sharma, Rajeev .
IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (03) :500-508
[43]  
Zhu Z., 2006, IEEE Conf. Comput. Vision and Pattern Recogn, P681