Minimal aspect distortion (MAD) mosaicing of long scenes

被引:65
作者
Rav-Acha, Alex [1 ]
Engel, Giora [1 ]
Peleg, Shmuel [1 ]
机构
[1] Hebrew Univ Jerusalem, Sch Engn & Comp Sci, IL-91904 Jerusalem, Israel
基金
以色列科学基金会;
关键词
video mosaicing; ego motion; stereo; panorama; X-Slits; multi-perspective;
D O I
10.1007/s11263-007-0101-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 [模式识别与智能系统]; 0812 [计算机科学与技术]; 0835 [软件工程]; 1405 [智能科学与技术];
摘要
Long scenes can be imaged by mosaicing multiple images from cameras scanning the scene. We address the case of a video camera scanning a scene while moving in a long path, e.g. scanning a city street from a driving car, or scanning a terrain from a low flying aircraft. A robust approach to this task is presented, which is applied successfully to sequences having thousands of frames even when using a hand-held camera. Examples are given on a few challenging sequences. The proposed system consists of two components: (i) Motion and depth computation. (ii) Mosaic rendering. In the first part a "direct" method is presented for computing motion and dense depth. Robustness of motion computation has been increased by limiting the motion model for the scanning camera. An iterative graph-cuts approach, with planar labels and a flexible similarity measure, allows the computation of a dense depth for the entire sequence. In the second part a new minimal aspect distortion (MAD) mosaicing uses depth to minimize the geometrical distortions of long panoramic images. In addition to MAD mosaicing, interactive visualization using X-Slits is also demonstrated.
引用
收藏
页码:187 / 206
页数:20
相关论文
共 37 条
[1]
Interactive digital photomontage [J].
Agarwala, A ;
Dontcheva, M ;
Agrawala, M ;
Drucker, S ;
Colburn, A ;
Curless, B ;
Salesin, D ;
Cohen, M .
ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03) :294-302
[2]
AGARWALA A, 2006, SIGGRAPH 2006 JUL, P853
[3]
Photographing long scenes with multi-viewpoint panoramas [J].
Agarwala, Aseem ;
Agrawala, Maneesh ;
Cohen, Michael ;
Salesin, David ;
Szeliski, Richard .
ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03) :853-861
[4]
[Anonymous], ECCV 92
[5]
[Anonymous], BRIT MACH VIS C
[6]
BIRCHFIELD, 1999, ICCV, V1, P489
[7]
A pixel dissimilarity measure that is insensitive to image sampling [J].
Birchfield, S ;
Tomasi, C .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1998, 20 (04) :401-406
[8]
Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239
[9]
Deng Y, 2005, IEEE I CONF COMP VIS, P1316
[10]
FELDMAN D, 2004, P IEEE COMP SOC C CO, V11, P163