Objective image quality assessment of 3D synthesized views

被引:129
作者
Battisti, Federica [1 ]
Bosc, Emilie [2 ]
Carli, Marco [1 ]
Le Callet, Patrick [2 ]
Perugia, Simone [1 ]
机构
[1] Univ Roma TRE, Dept Engn, Rome, Italy
[2] Polytech Nantes, Nantes, France
关键词
Objective image quality; 3D synthesized views; DIBR; Skin detection;
D O I
10.1016/j.image.2014.10.005
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Depth-Image-Based-Rendering (DIBR) techniques are essential for three-dimensional (3D) video applications such as 3D Television (3DTV) and Free-Viewpoint Video. However, this process is based on 3D warping and can induce serious distortions whose impact on the perceived quality is far different from the one experienced in the 2D imaging processes. Since quality evaluation of DIBR-synthesized views is fundamental for the design of perceptually friendly 3D video systems, an appropriate objective quality metric targeting the assessment of DIBR-synthesized views is momentous. Most of the 2D objective quality metrics fail in assessing the visual quality of DIBR-synthesized views because they have not been conceived for addressing the specificities of DIBR-related distortions. In this paper, a new full-reference objective quality metric, 3DSwIM (3D Synthesized view Image Quality Metric), dedicated to artifacts detection in DIBR-synthesized view-points is presented. The proposed scheme relies on a comparison of statistical features of wavelet subbands of two input images: the original image and the DIBR-based synthesized image. A registration step is included before the comparison step so that best matching blocks are always compared to ensure "shifting-resilience". In addition, a skin detection step weights the final quality score in order to penalize distorted blocks containing "skin-pixels" based on the assumption that a human observer is most sensitive to impairments affecting human subjects. Experimental tests show that the proposed method outperforms the conventional 2D and DIBR-dedicated quality metrics under test. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:78 / 88
页数:11
相关论文
共 37 条
  • [1] [Anonymous], ISOIECJTC1SC29WG11
  • [2] [Anonymous], P ACM MULT 2010 MOVI
  • [3] [Anonymous], INT C STER 3D MED EN
  • [4] [Anonymous], 2000, FIN REP VID QUAL EXP
  • [5] [Anonymous], P 17 INT C DIG SIGN
  • [6] [Anonymous], SPIE C SERIES
  • [7] [Anonymous], 2013, 2013 VISUAL COMMUNIC
  • [8] [Anonymous], P 2 INT C US CENTR M
  • [9] [Anonymous], 2009, 4 INT WORKSH VID PRO
  • [10] [Anonymous], 500 IBT