Identifying Stable Patterns over Time for Emotion Recognition from EEG

被引:650
作者
Zheng, Wei-Long [1 ,2 ]
Zhu, Jia-Yi [1 ,2 ]
Lu, Bao-Liang [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Ctr Brain Comp & Machine Intelligence, Dept Comp Sci & Engn,Key Lab, Shanghai Educ Commiss Intelligent Interact & Cog, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Brain Sci & Technol Res Ctr, 800 Dong Chuan Rd, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Affective computing; affective brain-computer interaction; emotion recognition; EEG; stable EEG patterns; machine learning; extreme learning machine; EXTREME LEARNING-MACHINE; TEST-RETEST RELIABILITY; MUSIC; RESPONSES; OSCILLATIONS; ASYMMETRY; SELECTION; STIMULI;
D O I
10.1109/TAFFC.2017.2712143
中图分类号
TP18 [人工智能理论];
学科分类号
140502 [人工智能];
摘要
In this paper, we investigate stable patterns of electroencephalogram (EEG) over time for emotion recognition using a machine learning approach. Up to now, various findings of activated patterns associated with different emotions have been reported. However, their stability over time has not been fully investigated yet. In this paper, we focus on identifying EEG stability in emotion recognition. We systematically evaluate the performance of various popular feature extraction, feature selection, feature smoothing and pattern classification methods with the DEAP dataset and a newly developed dataset called SEED for this study. Discriminative Graph regularized Extreme Learning Machine with differential entropy features achieves the best average accuracies of 69.67 and 91.07 percent on the DEAP and SEED datasets, respectively. The experimental results indicate that stable patterns exhibit consistency across sessions; the lateral temporal areas activate more for positive emotions than negative emotions in beta and gamma bands; the neural patterns of neutral emotions have higher alpha responses at parietal and occipital sites; and for negative emotions, the neural patterns have significant higher delta responses at parietal and occipital sites and higher gamma responses at prefrontal sites. The performance of our emotion recognition models shows that the neural patterns are relatively stable within and between sessions.
引用
收藏
页码:417 / 429
页数:13
相关论文
共 66 条
[21]
Heraz A, 2007, PROC WRLD ACAD SCI E, V25, P323
[22]
Extreme learning machine: Theory and applications [J].
Huang, Guang-Bin ;
Zhu, Qin-Yu ;
Siew, Chee-Kheong .
NEUROCOMPUTING, 2006, 70 (1-3) :489-501
[23]
Statistical pattern recognition: A review [J].
Jain, AK ;
Duin, RPW ;
Mao, JC .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (01) :4-37
[24]
Feature Extraction and Selection for Emotion Recognition from EEG [J].
Jenke, Robert ;
Peer, Angelika ;
Buss, Martin .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2014, 5 (03) :327-339
[25]
Identifying Emotions on the Basis of Neural Activation [J].
Kassam, Karim S. ;
Markey, Amanda R. ;
Cherkassky, Vladimir L. ;
Loewenstein, George ;
Just, Marcel Adam .
PLOS ONE, 2013, 8 (06)
[26]
Emotion Recognition Based on Physiological Changes in Music Listening [J].
Kim, Jonghwa ;
Andre, Elisabeth .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (12) :2067-2083
[27]
A Review on the Computational Methods for Emotional State Estimation from the Human EEG [J].
Kim, Min-Ki ;
Kim, Miyoung ;
Oh, Eunmi ;
Kim, Sung-Phil .
COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2013, 2013
[28]
Induced alpha band power changes in the human EEG and attention [J].
Klimesch, W ;
Doppelmayr, M ;
Russegger, H ;
Pachinger, T ;
Schwaiger, J .
NEUROSCIENCE LETTERS, 1998, 244 (02) :73-76
[29]
DEAP: A Database for Emotion Analysis Using Physiological Signals [J].
Koelstra, Sander ;
Muhl, Christian ;
Soleymani, Mohammad ;
Lee, Jong-Seok ;
Yazdani, Ashkan ;
Ebrahimi, Touradj ;
Pun, Thierry ;
Nijholt, Anton ;
Patras, Ioannis .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :18-31
[30]
Stability of Features in Real-time EEG-based Emotion Recognition Algorithm [J].
Lan, Zirui ;
Sourina, Olga ;
Wang, Lipo ;
Liu, Yisi .
2014 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2014, :137-144