Toward a Direct Measure of Video Quality Perception Using EEG

被引:100
作者
Scholler, Simon [1 ]
Bosse, Sebastian
Treder, Matthias Sebastian [1 ]
Blankertz, Benjamin [1 ]
Curio, Gabriel [4 ]
Mueller, Klaus-Robert [1 ,2 ]
Wiegand, Thomas [3 ,5 ]
机构
[1] Berlin Inst Technol, Machine Learning Lab, D-10587 Berlin, Germany
[2] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
[3] Fraunhofer HHI, Dept Image Proc, D-10587 Berlin, Germany
[4] Charite, Dept Neurol & Clin Neurophysiol, D-10117 Berlin, Germany
[5] Berlin Inst Technol, Image Commun Lab, D-10587 Berlin, Germany
基金
新加坡国家研究基金会;
关键词
Electroencephalography (EEG); perception; video coding; video quality; BRAIN-COMPUTER INTERFACE; TASK-DIFFICULTY; P300; CLASSIFICATION; P3A;
D O I
10.1109/TIP.2012.2187672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An approach to the direct measurement of perception of video quality change using electroencephalography (EEG) is presented. Subjects viewed 8-s video clips while their brain activity was registered using EEG. The video signal was either uncompressed at full length or changed from uncompressed to a lower quality level at a random time point. The distortions were introduced by a hybrid video codec. Subjects had to indicate whether they had perceived a quality change. In response to a quality change, a positive voltage change in EEG (the so-called P3 component) was observed at latency of about 400-600 ms for all subjects. The voltage change positively correlated with the magnitude of the video quality change, substantiating the P3 component as a graded neural index of the perception of video quality change within the presented paradigm. By applying machine learning techniques, we could classify on a single-trial basis whether a subject perceived a quality change. Interestingly, some video clips wherein changes were missed (i.e., not reported) by the subject were classified as quality changes, suggesting that the brain detected a change, although the subject did not press a button. In conclusion, abrupt changes of video quality give rise to specific components in the EEG that can be detected on a single-trial basis. Potentially, a neurotechnological approach to video assessment could lead to a more objective quantification of quality change detection, overcoming the limitations of subjective approaches (such as subjective bias and the requirement of an overt response). Furthermore, it allows for real-time applications wherein the brain response to a video clip is monitored while it is being viewed.
引用
收藏
页码:2619 / 2629
页数:11
相关论文
共 38 条
[1]  
[Anonymous], 2007, BRAIN COMPUTER INTER
[2]  
[Anonymous], 1996, SIGNAL DETECTION THE
[3]  
[Anonymous], 2020, INT TELECOMMUNICATIO
[4]  
[Anonymous], 2000, Pattern Classification
[5]  
[Anonymous], 2008, Subjective video quality assessment methods for multimedia applications. Recommendation P.910
[6]   Optimizing spatial filters for robust EEG single-trial analysis [J].
Blankertz, Benjamin ;
Tomioka, Ryota ;
Lemm, Steven ;
Kawanabe, Motoaki ;
Mueller, Klaus-Robert .
IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) :41-56
[7]   The non-invasive Berlin Brain-Computer Interface:: Fast acquisition of effective performance in untrained subjects [J].
Blankertz, Benjamin ;
Dornhege, Guido ;
Krauledat, Matthias ;
Mueller, Klaus-Robert ;
Curio, Gabriel .
NEUROIMAGE, 2007, 37 (02) :539-550
[8]   Single-trial analysis and classification of ERP components - A tutorial [J].
Blankertz, Benjamin ;
Lemm, Steven ;
Treder, Matthias ;
Haufe, Stefan ;
Mueller, Klaus-Robert .
NEUROIMAGE, 2011, 56 (02) :814-825
[9]   Neurophysiological predictor of SMR-based BCI performance [J].
Blankertz, Benjamin ;
Sannelli, Claudia ;
Haider, Sebastian ;
Hammer, Eva M. ;
Kuebler, Andrea ;
Mueller, Klaus-Robert ;
Curio, Gabriel ;
Dickhaus, Thorsten .
NEUROIMAGE, 2010, 51 (04) :1303-1309
[10]   TALKING OFF THE TOP OF YOUR HEAD - TOWARD A MENTAL PROSTHESIS UTILIZING EVENT-RELATED BRAIN POTENTIALS [J].
FARWELL, LA ;
DONCHIN, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1988, 70 (06) :510-523