Estimating just-noticeable distortion for video

被引:114
作者
Jia, Yuting [1 ]
Lin, Weisi
Kassim, Ashraf A.
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore
[2] Inst Infocomm Res, Agcy Sci Technol & Res, Singapore 119613, Singapore
关键词
contrast sensitivity function (CSF); discrete cosine transform (DCT); eye movement; just-noticeable distortion (JND);
D O I
10.1109/TCSVT.2006.877397
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Just-noticeable distortion (JND), which refers to the maximum distortion that the human visual system (HVS) cannot perceive, plays an important role in perceptual image and video processing. In comparison with JND estimation for images, estimation of the JND profile for video needs to take into account the temporal HVS properties in addition to the spatial properties. In this paper, we develop a spatio-ternporal model estimating JND in the discrete cosine tranform domain. The proposed model incorporates the spatio-temporal contrast sensitivity function, the influence of eye movements, luminance adaptation, and contrast masking to be more consistent with human perception. It is capable of yielding JNDs for both still images and video with significant motion. The experiments conducted in this study have demonstrated that the JND values estimated for video sequences with moving objects by the model are in line with the HVS perception. The accurate JND estimation of the video towards the actual visibility bounds can be translated into resource savings (e.g., for bandwidth/storage or computation) and performance improvement in video coding and other visual processing tasks (such as perceptual quality evaluation, visual signal restoration/enhancement, watermarking, authentication, and error protection).
引用
收藏
页码:820 / 829
页数:10
相关论文
共 31 条
[1]  
Ahumada A. J. Jr., 1992, Proceedings of the SPIE - The International Society for Optical Engineering, V1666, P365, DOI 10.1117/12.135982
[2]  
BARTEN PGJ, 1999, CONTRST SENSITIVITY
[3]   The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields [J].
Black, MJ ;
Anandan, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1996, 63 (01) :75-104
[4]  
CHIN YJ, 1999, IEEE T CIRCUITS SYST, V9, P438
[5]   A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile [J].
Chou, CH ;
Li, YC .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1995, 5 (06) :467-476
[6]   A perceptually optimized 3-D subband codec for video communication over wireless channels [J].
Chou, CH ;
Chen, CW .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1996, 6 (02) :143-156
[7]  
DALY S, 2001, VISION MODELS APPL I, pCH9
[8]  
DITCHBURN RW, 1973, EYE MOVEMENTS PERCEP
[9]  
Eckert Michael P., 1993, P89
[10]  
HALLETT PE, 1986, HDB PERCEPTION HUMAN, pCH10