Identifying Stable Patterns over Time for Emotion Recognition from EEG

被引:650
作者
Zheng, Wei-Long [1 ,2 ]
Zhu, Jia-Yi [1 ,2 ]
Lu, Bao-Liang [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Ctr Brain Comp & Machine Intelligence, Dept Comp Sci & Engn,Key Lab, Shanghai Educ Commiss Intelligent Interact & Cog, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Brain Sci & Technol Res Ctr, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Affective computing; affective brain-computer interaction; emotion recognition; EEG; stable EEG patterns; machine learning; extreme learning machine; EXTREME LEARNING-MACHINE; TEST-RETEST RELIABILITY; MUSIC; RESPONSES; OSCILLATIONS; ASYMMETRY; SELECTION; STIMULI;
D O I
10.1109/TAFFC.2017.2712143
中图分类号
TP18 [人工智能理论];
学科分类号
140502 [人工智能];
摘要
In this paper, we investigate stable patterns of electroencephalogram (EEG) over time for emotion recognition using a machine learning approach. Up to now, various findings of activated patterns associated with different emotions have been reported. However, their stability over time has not been fully investigated yet. In this paper, we focus on identifying EEG stability in emotion recognition. We systematically evaluate the performance of various popular feature extraction, feature selection, feature smoothing and pattern classification methods with the DEAP dataset and a newly developed dataset called SEED for this study. Discriminative Graph regularized Extreme Learning Machine with differential entropy features achieves the best average accuracies of 69.67 and 91.07 percent on the DEAP and SEED datasets, respectively. The experimental results indicate that stable patterns exhibit consistency across sessions; the lateral temporal areas activate more for positive emotions than negative emotions in beta and gamma bands; the neural patterns of neutral emotions have higher alpha responses at parietal and occipital sites; and for negative emotions, the neural patterns have significant higher delta responses at parietal and occipital sites and higher gamma responses at prefrontal sites. The performance of our emotion recognition models shows that the neural patterns are relatively stable within and between sessions.
引用
收藏
页码:417 / 429
页数:13
相关论文
共 66 条
[1]
The stability of resting frontal electroencephalographic asymmetry in depression [J].
Allen, JJB ;
Urry, HL ;
Hitt, SK ;
Coan, JA .
PSYCHOPHYSIOLOGY, 2004, 41 (02) :269-280
[2]
[Anonymous], 2013, HDB EMOTION REGULATI
[3]
Consciousness and arousal effects on emotional face processing as revealed by brain oscillations. A gamma band analysis [J].
Balconi, Michela ;
Lucchiari, Claudio .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2008, 67 (01) :41-46
[4]
Appetitive vs. defensive responses to emotional cues. Autonomic measures and brain oscillation modulation [J].
Balconi, Michela ;
Brambilla, Emma ;
Falbo, Luciana .
BRAIN RESEARCH, 2009, 1296 :72-84
[5]
Bos D.O., 2006, EEG-based emotion recognition. The Influence of Visual and Auditory Stimuli, P1
[6]
Brown L, 2011, IEEE ENG MED BIO, P2188, DOI 10.1109/IEMBS.2011.6090412
[7]
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications [J].
Calvo, Rafael A. ;
D'Mello, Sidney .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2010, 1 (01) :18-37
[8]
Chung SY, 2012, 2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), P1768
[9]
A Review and Meta-Analysis of Multimodal Affect Detection Systems [J].
D'Mello, Sidney K. ;
Kory, Jacqueline .
ACM COMPUTING SURVEYS, 2015, 47 (03)
[10]
Neural correlates of emotional responses to music: An EEG study [J].
Daly, Ian ;
Malik, Asad ;
Hwang, Faustina ;
Roesch, Etienne ;
Weaver, James ;
Kirke, Alexis ;
Williams, Duncan ;
Miranda, Eduardo ;
Nasuto, Slawomir J. .
NEUROSCIENCE LETTERS, 2014, 573 :52-57