Tightly integrated sensor fusion for robust visual tracking

被引:32
作者
Klein, GSW [1 ]
Drummond, TW [1 ]
机构
[1] Univ Cambridge, Dept Engn, Cambridge CB1 2PZ, England
关键词
visual tracking; real-time vision; sensor fusion;
D O I
10.1016/j.imavis.2004.02.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel method for increasing the robustness of visual tracking systems by incorporating information from inertial sensors. We show that more can be achieved than simply combining the sensor data within a statistical filter: besides using inertial data to provide predictions for the visual sensor, this data can be used to dynamically tune the parameters of each feature detector in the visual sensor. This allows the visual sensor to provide useful information even in the presence of substantial motion blur. Finally, the visual sensor can be used to calibrate the parameters of the inertial sensor to eliminate drift. (C) 2004 Elsevier B.V. All rights reserved.
引用
收藏
页码:769 / 776
页数:8
相关论文
共 18 条
[1]  
ARMSTRONG M, 1995, P AS C COMP VIS, V1, P58
[2]  
CHAI L, 1999, P IEEE ACM IWAR 99 O, P20
[3]  
DRUMMOND T, 1999, P BMVC, P574
[4]  
Ferrari V, 2001, IEEE AND ACM INTERNATIONAL SYMPOSIUM ON AUGMENTED REALITY, PROCEEDINGS, P87, DOI 10.1109/ISAR.2001.970518
[5]  
FURHMANN A, 2001, P IEEE INSTR MEAS TE
[6]  
HARRIS C, 1992, ACTIVE VISION, P59
[7]   Computer vision-based registration techniques for augmented reality [J].
Hoff, WA ;
Nguyen, K ;
Lyon, T .
INTELLIGENT ROBOTS AND COMPUTER VISION XV: ALGORITHMS, TECHNIQUES, ACTIVE VISION, AND MATERIALS HANDLING, 1996, 2904 :538-548
[8]   CONDENSATION - Conditional density propagation for visual tracking [J].
Isard, M ;
Blake, A .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1998, 29 (01) :5-28
[9]   Extendible tracking by line auto-calibration [J].
Jiang, BL ;
Neumann, U .
IEEE AND ACM INTERNATIONAL SYMPOSIUM ON AUGMENTED REALITY, PROCEEDINGS, 2001, :97-103
[10]   Robust visual tracking for non-instrumented augmented reality [J].
Klein, G ;
Drummond, T .
SECOND IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, 2003, :113-122