Randomly dividing homologous samples leads to overinflated accuracies for emotion recognition

被引:16
作者
Liu, Shuang [1 ]
Zhang, Di [1 ]
Xu, Minpeng [1 ]
Qi, Hongzhi [1 ]
He, Feng [1 ]
Zhao, Xin [1 ]
Zhou, Peng [1 ]
Zhang, Lixin [1 ]
Ming, Dong [1 ]
机构
[1] Tianjin Univ, Coll Precis Instruments & Optoelect Engn, Neural Engn & Rehabil Lab, Dept Biomed Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Emotion recognition; Electroencephalography (EEG); Overinflated accuracies; Affective computing; Feature selection; Valence; EEG; SELECTION; SYNCHRONIZATION; CLASSIFICATION; STIMULI; STATE;
D O I
10.1016/j.ijpsycho.2015.02.023
中图分类号
B84 [心理学];
学科分类号
010107 [宗教学];
摘要
There are numerous studies measuring the brain emotional status by analyzing EEGs under the emotional stimuli that have occurred. However, they often randomly divide the homologous samples into training and testing groups, known as randomly dividing homologous samples (RDHS), despite considering the impact of the non-emotional information among them, which would inflate the recognition accuracy. This work proposed a modified method, the integrating homologous samples (IHS), where the homologous samples were either used to build a classifier, or to be tested. The results showed that the classification accuracy was much lower for the IHS than for the RDHS. Furthermore, a positive correlation was found between the accuracy and the overlapping rate of the homologous samples. These findings implied that the overinflated accuracy did exist in those previous studies where the RDHS method was employed for emotion recognition. Moreover, this study performed a feature selection for the IHS condition based on the support vector machine-recursive feature elimination, after which the average accuracies were greatly improved to 85.71% and 77.18% in the picture-induced and video-induced tasks, respectively. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:29 / 37
页数:9
相关论文
共 44 条
[1]
[Anonymous], 1998, Statistical learning theory wiley
[2]
[Anonymous], ENG MED BIOL SOC EMB
[3]
[Anonymous], CYB CW 2010 INT C
[4]
EEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis [J].
Balconi, M ;
Lucchiari, C .
NEUROSCIENCE LETTERS, 2006, 392 (1-2) :118-123
[5]
Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues. ERS/ERD and coherence measures of alpha band [J].
Balconi, Michela ;
Mazza, Guido .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2009, 74 (02) :158-165
[6]
Bradley M. M., 2007, Bradley, M. M. , Lang, P. J. (2007). The International Affective Digitized Sounds (IADS-2): Affective ratings of sounds and instruction manual (Tech. Rep. B-3). Gainesville, FL: University of Florida.
[7]
Bradley MM, 2000, PSYCHOPHYSIOLOGY, V37, P204, DOI 10.1111/1469-8986.3720204
[8]
Short-term emotion assessment in a recall paradigm [J].
Chanel, Guillaume ;
Kierkels, Joep J. M. ;
Soleymani, Mohammad ;
Pun, Thierry .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2009, 67 (08) :607-627
[9]
LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[10]
On the learnability and design of output codes for multiclass problems [J].
Crammer, K ;
Singer, Y .
MACHINE LEARNING, 2002, 47 (2-3) :201-233