Image Signature: Highlighting Sparse Salient Regions

被引:667
作者
Hou, Xiaodi [1 ]
Harel, Jonathan [2 ]
Koch, Christof [3 ,4 ]
机构
[1] CALTECH, Dept Computat & Neural Syst, Pasadena, CA 91125 USA
[2] CALTECH, Dept Elect Engn, Pasadena, CA 91125 USA
[3] CALTECH, Dept Biol & Computat & Neural Syst, Pasadena, CA 91125 USA
[4] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
基金
新加坡国家研究基金会;
关键词
Saliency; visual attention; change blindness; sign function; sparse signal analysis; ATTENTION; SCENE; RECONSTRUCTION; PHASE;
D O I
10.1109/TPAMI.2011.146
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce a simple image descriptor referred to as the image signature. We show, within the theoretical framework of sparse signal mixing, that this quantity spatially approximates the foreground of an image. We experimentally investigate whether this approximate foreground overlaps with visually conspicuous image locations by developing a saliency algorithm based on the image signature. This saliency algorithm predicts human fixation points best among competitors on the Bruce and Tsotsos [1] benchmark data set and does so in much shorter running time. In a related experiment, we demonstrate with a change blindness data set that the distance between images induced by the image signature is closer to human perceptual distance than can be achieved using other saliency algorithms, pixel-wise, or GIST [2] descriptor methods.
引用
收藏
页码:194 / 201
页数:8
相关论文
共 21 条
[1]  
[Anonymous], 2009, ARXIV09123599
[2]  
[Anonymous], 2008, NIPS
[3]  
[Anonymous], 2007, P IEEE C COMP VIS PA
[4]  
[Anonymous], 2008, P IEEE C COMP VIS PA
[5]  
[Anonymous], 2006, Advances in Neural Information Processing Systems
[6]   Saliency, attention, and visual search: An information theoretic approach [J].
Bruce, Neil D. B. ;
Tsotsos, John K. .
JOURNAL OF VISION, 2009, 9 (03)
[7]   Near-optimal signal recovery from random projections: Universal encoding strategies? [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) :5406-5425
[8]   Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming [J].
Goemans, MX ;
Williamson, DP .
JOURNAL OF THE ACM, 1995, 42 (06) :1115-1145
[9]  
Harel J., 2007, P ADV NEUR INF PROC, P681
[10]   SIGNAL RECONSTRUCTION FROM PHASE OR MAGNITUDE [J].
HAYES, MH ;
LIM, JS ;
OPPENHEIM, AV .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1980, 28 (06) :672-680