No-Reference Quality Assessment for Screen Content Images Based on Hybrid Region Features Fusion

被引:40
作者
Zheng, Linru [1 ]
Shen, Liquan [2 ]
Chen, Jianan [1 ]
An, Ping [1 ]
Luo, Jun [3 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Joint Int Res Lab Specialty Fiber Opt & Adv Commu, Key Lab Specialty Fiber Opt & Opt Access Networks, Shanghai 200444, Peoples R China
[3] Shanghai Univ, Sch Mechatron Engn & Automat, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Screen content image; image quality assessment; no-reference; image segmentation; hybrid-region-based features; GRADIENT MAGNITUDE; STATISTICS; INFORMATION; SIMILARITY; SEGMENTATION; PHASE;
D O I
10.1109/TMM.2019.2894939
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Research on screen content images (SCIs) attracts more attention as they are highly applied to image-and video-centric applications on mobile and other devices. It is important to develop an efficient image-quality assessment (IQA) method for SCIs because IQA can guide and optimize various image-processing methods for SCIs and improve user experience. In this paper, we propose a no-reference objective assessment model for SCIs including SCIs segmentation and the analysis of local and global perceptual feature representations. Since the human visual system is highly sensitive to sharp edges that are commonly encountered in SCIs, we utilize the variance of local standard deviation, which is a noise robust index to distinguish the sharp edge patches (SEPes) and non-SEPes of SCIs. For SEPes, we perform two kinds of feature extractions. First, the entropy and contrast features are extracted with a gray-level co-occurrence matrix, which are highly perceptive of microstructural change. Second, the local phase coherence is utilized to capture the loss in sharpness. Then, average pooling is adopted to fuse features obtained from all of the SEPes to represent the local features. We further combine local features with global features that are derived using the BRISQUE method as the hybrid region (HR)-based features. Finally, a regression module is learned using support vector regression to train the mapping function that maps HR-based features to subjective quality scores. Experimental results on the screen image-quality assessment database show that the proposed method can achieve better performance in visual-quality prediction for SCIs than the performance achieved by state-of-the-art methods.
引用
收藏
页码:2057 / 2070
页数:14
相关论文
共 65 条
[1]  
[Anonymous], P 33 AAAI C ART INT
[2]  
[Anonymous], 2012, BT50011 ITUR
[3]  
[Anonymous], 2017, COMMUN ACM, DOI DOI 10.1145/3065386
[4]  
[Anonymous], IEEE T MULTIMED
[5]   AN INVESTIGATION OF THE TEXTURAL CHARACTERISTICS ASSOCIATED WITH GRAY-LEVEL COOCCURRENCE MATRIX STATISTICAL PARAMETERS [J].
BARALDI, A ;
PARMIGGIANI, F .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1995, 33 (02) :293-304
[6]   Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].
Bosse, Sebastian ;
Maniry, Dominique ;
Mueller, Klaus-Robert ;
Wiegand, Thomas ;
Samek, Wojciech .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :206-219
[7]  
Chang C. C., 2011, ACM T INTEL SYST TEC, V2, P1, DOI DOI 10.1145/1961189.1961199
[8]   No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation [J].
Fang, Yuming ;
Yan, Jiebin ;
Li, Leida ;
Wu, Jinjian ;
Lin, Weisi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :1600-1610
[9]   Objective Quality Assessment of Screen Content Images by Uncertainty Weighting [J].
Fang, Yuming ;
Yan, Jiebin ;
Liu, Jiaying ;
Wang, Shiqi ;
Li, Qiaohong ;
Guo, Zongming .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) :2016-2027
[10]   No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics [J].
Fang, Yuming ;
Ma, Kede ;
Wang, Zhou ;
Lin, Weisi ;
Fang, Zhijun ;
Zhai, Guangtao .
IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (07) :838-842