Deep Learning Classification of Neuro-Emotional Phase Domain Complexity Levels Induced by Affective Video Film Clips

被引:79
作者
Aydin, Serap [1 ]
机构
[1] Hacettepe Univ, Dept Biophys, Fac Med, TR-06100 Ankara, Turkey
关键词
Electroencephalography; Complexity theory; Principal component analysis; Emotion recognition; Informatics; Trajectory; Brain biophysics; emotion recognition; affective neuroscience; deep learning; PARKINSONS-DISEASE; FEATURE-EXTRACTION; OCULAR ARTIFACTS; EEG SIGNALS; FEATURES; RECOGNITION; PERFORMANCE; POTENTIALS; RECURRENT; REDUCTION;
D O I
10.1109/JBHI.2019.2959843
中图分类号
TP [自动化技术、计算机技术];
学科分类号
080201 [机械制造及其自动化];
摘要
In the present article, a novel emotional complexity marker is proposed for classification of discrete emotions induced by affective video film clips. Principal Component Analysis (PCA) is applied to full-band specific phase space trajectory matrix (PSTM) extracted from short emotional EEG segment of 6 s, then the first principal component is used to measure the level of local neuronal complexity. As well, Phase Locking Value (PLV) between right and left hemispheres is estimated for in order to observe the superiority of local neuronal complexity estimation to regional neuro-cortical connectivity measurements in clustering nine discrete emotions (fear, anger, happiness, sadness, amusement, surprise, excitement, calmness, disgust) by using Long-Short-Term-Memory Networks as deep learning applications. In tests, two groups (healthy females and males aged between 22 and 33 years old) are classified with the accuracy levels of 68.52% and 79.36% through the proposed emotional complexity markers and and connectivity levels in terms of PLV in amusement. The groups are found to be statistically different (p << 0.5) in amusement with respect to both metrics, even if gender difference does not lead to different neuro-cortical functions in any of the other discrete emotional states. The high deep learning classification accuracy of 98.00% is commonly obtained for discrimination of positive emotions from negative emotions through the proposed new complexity markers. Besides, considerable useful classification performance is obtained in discriminating mixed emotions from each other through full-band connectivity features. The results reveal that emotion formation is mostly influenced by individual experiences rather than gender. In detail, local neuronal complexity is mostly sensitive to the affective valance rating, while regional neuro-cortical connectivity levels are mostly sensitive to the affective arousal ratings.
引用
收藏
页码:1695 / 1702
页数:8
相关论文
共 105 条
[1]
Absa AHA, 2018, INT MULTICONF SYST, P1241, DOI 10.1109/SSD.2018.8570407
[2]
Facial affect recognition: A mediator between cognitive and social functioning in psychosis? [J].
Addington, Jean ;
Saeedi, Huma ;
Addington, Donald .
SCHIZOPHRENIA RESEARCH, 2006, 85 (1-3) :142-150
[3]
Non-linear analysis of emotion EEG: Calculation of Kolmogorov entropy and the principal Lyapunov exponent [J].
Aftanas, LI ;
Lotova, NV ;
Koshkarov, VI ;
Pokrovskaja, VL ;
Popov, SA ;
Makhnev, VP .
NEUROSCIENCE LETTERS, 1997, 226 (01) :13-16
[4]
Facial Emotion Recognition and Eye Gaze in Attention-Deficit/Hyperactivity Disorder With and Without Comorbid Conduct Disorder [J].
Airdrie, Jac N. ;
Langley, Kate ;
Thapar, Anita ;
van Goozen, Stephanie N. M. .
JOURNAL OF THE AMERICAN ACADEMY OF CHILD AND ADOLESCENT PSYCHIATRY, 2018, 57 (08) :561-570
[5]
Classification of EEG Signals Based on Pattern Recognition Approach [J].
Amin, Hafeez Ullah ;
Mumtaz, Wajid ;
Subhani, Ahmad Rauf ;
Saad, Mohamad Naufal Mohamad ;
Malik, Aamir Saeed .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2017, 11
[6]
[Anonymous], 2002, PRINCIPAL COMPONENT
[7]
[Anonymous], 1990, STAT PATTERN RECOGNI
[8]
[Anonymous], 2011, Statistical Pattern RecognitionWiley
[9]
[Anonymous], 2013, 31 INT C MACH LEARN
[10]
[Anonymous], 2005, International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual