Blind Image Quality Assessment via Vector Regression and Object Oriented Pooling

被引:38
作者
Gu, Jie [1 ,2 ]
Meng, Gaofeng [1 ]
Redi, Judith A. [3 ]
Xiang, Shiming [1 ,2 ]
Pan, Chunhong [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Delft Univ Technol, Dept Intelligent Syst, NL-2628 CD Delft, Netherlands
基金
中国国家自然科学基金;
关键词
Convolutional neural network; image quality assessment; perceptual image quality; object oriented pooling; vector regression; PERCEPTUAL IMAGE; NEURAL-NETWORKS; FRAMEWORK; DATABASE; SCORES;
D O I
10.1109/TMM.2017.2761993
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents an effective method based on vector regression and object oriented pooling for blind image quality assessment. Unlike previous models that map the extracted features directly to a quality score, the proposed vector regression framework yields a vector of belief scores for the input image. We explore the uncertainty factors in quality assessment and design the belief scores to measure the confidences of an image to be assigned to the corresponding quality grades. Moreover, we propose an object oriented pooling strategy to further improve the performance by incorporating semantic information of image contents. According to this strategy, regions occupied by objects will be assigned more weights in the pooling phase, leading to a more accurate quality assessment. Extensive experiments on benchmark datasets demonstrate that our approach achieves state-of-the-art performance and shows a great generalization ability.
引用
收藏
页码:1140 / 1153
页数:14
相关论文
共 66 条
[1]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[2]  
[Anonymous], 2009, Advances of Modern Radioelectronics
[3]  
[Anonymous], 2015, P 3 INT C LEARN REPR
[4]  
[Anonymous], 2000, Psychometric scaling, a toolkit for imaging systems development
[5]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[6]   Multiscale Combinatorial Grouping [J].
Arbelaez, Pablo ;
Pont-Tuset, Jordi ;
Barron, Jonathan T. ;
Marques, Ferran ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :328-335
[7]   Automatic Prediction of Perceptual Image and Video Quality [J].
Bovik, Alan Conrad .
PROCEEDINGS OF THE IEEE, 2013, 101 (09) :2008-2024
[8]   BING: Binarized Normed Gradients for Objectness Estimation at 300fps [J].
Cheng, Ming-Ming ;
Zhang, Ziming ;
Lin, Wen-Yan ;
Torr, Philip .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3286-3293
[9]   Visual Attention in Quality Assessment [J].
Engelke, Ulrich ;
Kaprykowsky, Hagen ;
Zepernick, Hans-Jurgen ;
Ndjiki-Nya, Patrick .
IEEE SIGNAL PROCESSING MAGAZINE, 2011, 28 (06) :50-59
[10]   Supporting visual quality assessment with machine learning [J].
Gastaldo, Paolo ;
Zunino, Rodolfo ;
Redi, Judith .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2013,