Foveated analysis of image features at fixations

被引:26
作者
Rajashekar, Umesh [1 ]
Van der Linde, Ian [1 ,2 ]
Bovik, Alan C. [1 ]
Cormack, Lawrence K. [1 ]
机构
[1] Univ Texas Austin, Ctr Perceptual Syst, Austin, TX 78712 USA
[2] Anglia Ruskin Univ, Dept Comp, Chelmsford CM1 1SQ, Essex, England
基金
美国国家科学基金会;
关键词
eye tracking; foveation; natural image statistics; contrast; point-of-gaze statistics;
D O I
10.1016/j.visres.2007.07.015
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Analysis of the statistics of image features at observers' gaze can provide insights into the mechanisms of fixation selection in humans. Using a foveated analysis framework, in which image patches were analyzed at the resolution corresponding to their eccentricity from the prior fixation, we studied the statistics of four low-level local image features: luminance, RMS contrast, and bandpass outputs of both luminance and contrast, and discovered that the image patches around human fixations had, on average, higher values of each of these features at all eccentricities than the image patches selected at random. Bandpass contrast showed the greatest difference between human and random fixations, followed by bandpass luminance, RMS contrast, and luminance. An eccentricity-based analysis showed that shorter saccades were more likely to land on patches with higher values of these features. Compared to a full-resolution analysis, foveation produced an increased difference between human and random patch ensembles for contrast and its higher-order statistics. (c) 2007 Elsevier Ltd. All rights reserved.
引用
收藏
页码:3160 / 3172
页数:13
相关论文
共 29 条
[21]   Natural scene statistics at the centre of gaze [J].
Reinagel, P ;
Zador, AM .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1999, 10 (04) :341-350
[22]   Real-time foveation techniques for low bit rate video coding [J].
Sheikh, HR ;
Evans, BL ;
Bovik, AC .
REAL-TIME IMAGING, 2003, 9 (01) :27-40
[23]   The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task [J].
Tatler, Benjamin W. ;
Baddeley, Roland J. ;
Vincent, Benjamin T. .
VISION RESEARCH, 2006, 46 (12) :1857-1862
[24]   Visual correlates of fixation selection: effects of scale and time [J].
Tatler, BW ;
Baddeley, RJ ;
Gilchrist, ID .
VISION RESEARCH, 2005, 45 (05) :643-659
[25]   Modeling global scene factors in attention [J].
Torralba, A .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2003, 20 (07) :1407-1418
[26]   Independent component filters of natural images compared with simple cells in primary visual cortex [J].
van Hateren, JH ;
van der Schaaf, A .
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 1998, 265 (1394) :359-366
[27]  
Wandell B., 1995, Foundations of vision
[28]   Foveation scalable video coding with automatic fixation selection [J].
Wang, Z ;
Lu, LG ;
Bovik, AC .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (02) :243-254
[29]  
Yarbus I.A., 1967, EYE MOVEMENTS VISION