基于Kinect的实时面部情感识别(英文)

被引:4
作者
Qi-rong MAO
Xin-yu PAN
Yong-zhao ZHAN
Xiang-jun SHEN
机构
[1] DepartmentofComputerScienceandCommunicationEngineering,JiangsuUniversity
关键词
Kinect; 情感识别; 面部表情; 实时分类; 融合算法; 支持向量机;
D O I
暂无
中图分类号
TP391.41 [];
学科分类号
080203 ;
摘要
目的:基于Kinect提取面部表情特征,实现对视频中面部情感实时识别。创新点:基于Kinect提出一种新颖的面部情感识别方法,充分发挥出Kinect高速易用的优势,可实时对视频序列最新连续帧中表现出的情感进行综合判定。识别方法涉及两种不同形式的表情特征,对此我们也针对性地提出基于最大置信的融合算法。方法:首先,运用Kinect中Face Tracking SDK从实时视频数据中追踪人脸、提取面部运动单元信息和特征点坐标(图3、4)。然后,将这两类特征信息并行处理,在它们各自特征通道中,特征数据经7元1-vs-1分类器组进行预识别,将得到的预识别结果存入缓存用于情感置信统计,置信度最高的即为此通道中的情感识别结果(图2)。最后,融合这两个特征通道的结果即可得到最终情感识别结果(图1)。结论:基于Kinect提取到的两种面部表情特征(面部运动单元信息和特征点坐标),提出一种新颖高效的面部情感识别方法,实现对视频中面部情感实时识别。
引用
收藏
页码:272 / 283
页数:12
相关论文
共 21 条
  • [1] Real-timeperformance-driven facial animation with 3ds Max andKinect. Li,D.X,Sun,C,Hu,F.Q.et al. Proc.3rd Int.Conf.on Consumer Electronics,Communications and Networks . 2013
  • [2] Speaker-independent speech emotion recognition by fusion of functional and accompanying paralanguage features[J]. Qi-rong MAO,Xiao-lei ZHAO,Zheng-wei HUANG,Yong-zhao ZHAN.  Journal of Zhejiang University-Science C(Computers & Electronics). 2013(07)
  • [3] Statistical learning based facial animation[J]. Shibiao XU,Guanghui MA,Weiliang MENG,Xiaopeng ZHANG.  Journal of Zhejiang University-Science C(Computers & Electronics). 2013(07)
  • [4] A fast classification scheme and its application to face recognition[J]. Xiao-hu MA,Yan-qi TAN,Gang-min ZHENG.  Journal of Zhejiang University-Science C(Computers & Electronics). 2013(07)
  • [5] LIBSVM[J] . Chih-Chung Chang,Chih-Jen Lin. &nbspACM Transactions on Intelligent Systems and Technology (TIST) . 2011 (3)
  • [6] Automatic facial expression analysis: a survey[J] . B. Fasel,Juergen Luettin. &nbspPattern Recognition . 2002 (1)
  • [7] An RGB-Ddatabase using Microsoft’’s Kinect for windows for facedetection. Hg,R.I,Jasek P,Rofidal,C.et al. Proc.8th Int.Conf.on Signal Image Technology and Internet Based Systems . 2012
  • [8] A FACS Valid 3D Dynamic Action Unit Database with Applications to 3D Dynamic Morphable Facial Modeling. D.Cosker,E.Krumhuber,A.Hilton. Proceedings of IEEE International Conference on Computer Vision (ICCV) . 2011
  • [9] Robust Semantic Analysis by Synthesis of 3d Facial Motion. M Breidt,H Biilthoff H,C Curio. Proceedings of IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) . 2011
  • [10] Using Kinectfor face recognition under varying poses,expressions,illumination and disguise. Li,B.Y,Mian,A.S,Liu,W.Q.et al. Proc.IEEE Workshopon Applications of Computer Vision . 2013