Learning a blind quality evaluation engine of screen content images

被引:89
作者
Gu, Ke [1 ]
Zhai, Guangtao [2 ]
Lin, Weisi [1 ]
Yang, Xiaokang [2 ]
Zhang, Wenjun [2 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Shanghai Jiao Tong Univ, Inst Image Commun & Informat Proc, Shanghai Key Lab Digital Media Proc & Transmiss, Shanghai 200030, Peoples R China
基金
美国国家科学基金会;
关键词
Screen content images (SCIs); Image quality assessment (IQA); Blind/no-reference (NR); Statistical model; Machine learning; FREE-ENERGY PRINCIPLE; STATISTICS; ARTIFACTS;
D O I
10.1016/j.neucom.2015.11.101
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We in this paper investigate how to blindly predict the visual quality of a screen content image (SO). With the popularity of multi-client and remote-controlling systems, SCIs and the relevant applications have been a hot research topic. In general, SCIs contain texts or graphics in cartoons, ebooks or captures of computer screens. As for blind quality assessment (QA) of natural scene images (NSIs), it has been well established since NSIs possess certain statistical properties. SCIs however do not have reliable statistic models so far and thus the associated blind QA task is hard to be addressed. Aiming at solving this problem, we first extract 13 perceptual-inspired features with the free energy based brain theory and structural degradation model. In order to avoid the overfitting and guarantee the independence of training and testing samples, we then collect 100,000 images and use their objective quality scores computed via a high-accuracy full-reference QA method for SCIs as labels, before learning a new blind quality measure from aforementioned 13 features to the objective quality score. Experimental results performed on a large-scale screen image quality assessment database (SIQAD) demonstrate that the proposed blind quality metric has a good correlation with human perception of quality, even superior to state-of-the-art full-, reduced- and no-reference QA algorithms. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 149
页数:10
相关论文
共 40 条
[1]  
[Anonymous], FIN REP VID QUAL EXP
[2]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[3]   Perceptual image quality assessment by independent feature detector [J].
Chang, Hua-wen ;
Zhang, Qiu-wen ;
Wu, Qing-gang ;
Gan, Yong .
NEUROCOMPUTING, 2015, 151 :1142-1152
[4]   The free-energy principle: a unified brain theory? [J].
Friston, Karl J. .
NATURE REVIEWS NEUROSCIENCE, 2010, 11 (02) :127-138
[5]   Wavelet-based contourlet in quality evaluation of digital images [J].
Gao, Xinbo ;
Lu, Wen ;
Li, Xuelong ;
Tao, Dacheng .
NEUROCOMPUTING, 2008, 72 (1-3) :378-385
[6]   No-reference quality assessment of JPEG images via a quality relevance map [J].
Golestaneh, S. Alireza ;
Chandler, Damon M. .
IEEE Signal Processing Letters, 2014, 21 (02) :155-158
[7]  
Gu K, 2015, IEEE INT SYMP CIRC S, P125, DOI 10.1109/ISCAS.2015.7168586
[8]   No-Reference Image Sharpness Assessment in Autoregressive Parameter Space [J].
Gu, Ke ;
Zhai, Guangtao ;
Lin, Weisi ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (10) :3218-3231
[9]   Visual Saliency Detection With Free Energy Theory [J].
Gu, Ke ;
Zhai, Guangtao ;
Lin, Weisi ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (10) :1552-1555
[10]   Using Free Energy Principle For Blind Image Quality Assessment [J].
Gu, Ke ;
Zhai, Guangtao ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (01) :50-63