Dynamic visual attention on the sphere

被引:18
作者
Bogdanova, Iva [1 ]
Bur, Alexandre [1 ]
Huegli, Heinz [2 ]
Farine, Pierre-Andre [1 ]
机构
[1] EPFL, Inst Microengn IMT, Pattern Recognit Lab, CH-2000 Neuchatel, Switzerland
[2] Univ Neuchatel, CH-2000 Neuchatel, Switzerland
基金
瑞士国家科学基金会;
关键词
Dynamic visual attention; Motion estimation on the sphere; Spherical (omnidirectional) image processing;
D O I
10.1016/j.cviu.2009.09.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we present a computational model of dynamic visual attention on the sphere which combines static (intensity,chromaticity, orientation) and motion features in order to detect salient locations in omnidirectional image sequences while working directly in spherical coordinates. We build the motion pyramid on the sphere by applying block matching and varying the block size. The spherical motion conspicuity map is obtained by fusing together the spherical motion magnitude and phase conspicuities. Furthermore, we combine this map with the static spherical saliency map in order to obtain the dynamic saliency map on the sphere. Detection of the spots of attention based on the dynamic saliency map on the sphere is applied on a sequence of real spherical images. The effect of using only the spherical motion magnitude or phase for defining the spots of attention on the sphere is examined as well. Finally, we test the spherical versus Euclidean spots detection on the omnidirectional image sequence. (C) 2009 Elsevier Inc. All rights reserved.
引用
收藏
页码:100 / 110
页数:11
相关论文
共 10 条
[1]   Visual Attention on the Sphere [J].
Bogdanova, Iva ;
Bur, Alexandre ;
Huegli, Heinz .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (11) :2000-2014
[2]   Motion integration in visual attention models for predicting simple dynamic scenes [J].
Bur, A. ;
Wurtz, P. ;
Mueri, R. M. ;
Huegli, H. .
HUMAN VISION AND ELECTRONIC IMAGING XII, 2007, 6492
[3]  
DEMANET L, 2003, P SPIE WAV 10 C SAN
[4]   Catadioptric projective geometry [J].
Geyer, C ;
Daniilidis, K .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2001, 45 (03) :223-243
[5]   Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes [J].
Itti, L .
VISUAL COGNITION, 2005, 12 (06) :1093-1123
[6]  
KOCH C, 1985, HUM NEUROBIOL, V4, P219
[7]   Predicting visual fixations on video based on low-level visual features [J].
Le Meur, Olivier ;
Le Callet, Patrick ;
Barba, Dominique .
VISION RESEARCH, 2007, 47 (19) :2483-2498
[8]  
TOSIC I, 2005, P EUSIPCO
[9]   Attending to visual motion [J].
Tsotsos, JK ;
Liu, YJ ;
Martinez-Trujillo, JC ;
Pomplun, M ;
Simine, E ;
Zhou, KH .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2005, 100 (1-2) :3-40
[10]   Attention-regulated activity in human primary visual cortex [J].
Watanabe, T ;
Sasaki, Y ;
Miyauchi, S ;
Putz, B ;
Fujimaki, N ;
Nielsen, M ;
Takino, R ;
Miyakawa, S .
JOURNAL OF NEUROPHYSIOLOGY, 1998, 79 (04) :2218-2221