Dynamic visual attention model in image sequences

被引:26
作者
Lopez, Maria T.
Fernandez, Miguel A.
Fernandez-Caballero, Antonio [1 ]
Mira, Jose
Delgado, Ana E.
机构
[1] Univ Castilla La Mancha, Escuela Politecn Super Albacete, Dept Sistemas Informat, Albacete 02071, Spain
[2] Univ Castilla La Mancha, Inst Invest Informat Albacete, Albacete 02071, Spain
[3] Univ Nacl Educ Distancia, ETSI Informat, Dept Inteligencia Artificial, Madrid 28040, Spain
关键词
dynamic visual attention; motion; segmentation; feature extraction; feature integration;
D O I
10.1016/j.imavis.2006.05.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new computational architecture of dynamic visual attention is introduced in this paper. Our approach defines a model for the generation of an active attention focus on a dynamic scene captured from a still or moving camera. The aim is to obtain the objects that keep the observer's attention in accordance with a set of predefined features, including color, motion and shape. The solution proposed to the selective visual attention problem consists in decomposing the input images of an indefinite sequence of images into its moving objects, by defining which of these elements are of the user's interest, and by keeping attention on those elements through time. Thus, the three tasks involved in the attention model are introduced. The Feature-Extraction task obtains those features (color, motion and shape features) necessary to perform object segmentation. The Attention-Capture task applies the criteria established by the user (values provided through parameters) to the extracted features and obtains the different parts of the objects of potential interest. Lastly, the Attention-Reinforcement task maintains attention on certain elements (or objects) of the image sequence that are of real interest. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:597 / 613
页数:17
相关论文
共 44 条
  • [21] Modelling visual search experiments: the selective attention for identification model (SAIM)
    Heinke, D
    Humphreys, GW
    di Virgilio, G
    [J]. NEUROCOMPUTING, 2002, 44 : 817 - 822
  • [22] SAVI: an actively controlled teleconferencing system
    Herpers, R
    Derpanis, K
    MacLean, WJ
    Verghese, G
    Jenkin, M
    Milios, E
    Jepson, A
    Tsotsos, JK
    [J]. IMAGE AND VISION COMPUTING, 2001, 19 (11) : 793 - 804
  • [23] A model of saliency-based visual attention for rapid scene analysis
    Itti, L
    Koch, C
    Niebur, E
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1998, 20 (11) : 1254 - 1259
  • [24] Jain AK., 1989, Fundamentals of Digital Image Processing
  • [25] KOCH C, 1985, HUM NEUROBIOL, V4, P219
  • [26] López MT, 2003, LECT NOTES COMPUT SC, V2686, P694
  • [27] Attentional scene segmentation: Integrating depth and motion
    Maki, A
    Nordlund, P
    Eklundh, JO
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2000, 78 (03) : 351 - 373
  • [28] Mertsching B., 1998, Proceedings of NC 1998. International ICSC/IFAC Symposium on Neural Computation, P469
  • [29] Minato T, 2001, IROS 2001: PROCEEDINGS OF THE 2001 IEEE/RJS INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, P1422, DOI 10.1109/IROS.2001.977180
  • [30] A survey of computer vision-based human motion capture
    Moeslund, TB
    Granum, E
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2001, 81 (03) : 231 - 268