Segmenting, modeling, and matching video clips containing multiple moving objects

被引:28
作者
Rothganger, Fred
Lazebnik, Svetlana
Schmid, Cordelia
Ponce, Jean
机构
[1] Sandia Natl Labs, Albuquerque, NM 87123 USA
[2] Beckman Inst, Urbana, IL 61801 USA
[3] INRIA Rhone Alpes, F-38330 Montbonnot St Martin, France
[4] Ecole Normale Super, Dept Informat, F-75230 Paris 05, France
[5] Univ Illinois, Dept Comp Sci, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
affine-covariant patches; structure from motion; motion segmentation; shot matching; video retrieval;
D O I
10.1109/TPAMI.2007.57
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel representation for dynamic scenes composed of multiple rigid objects that may undergo different motions and are observed by a moving camera. Multiview constraints associated with groups of affine-covariant scene patches and a normalized description of their appearance are used to segment a scene into its rigid components, construct three-dimensional models of these components, and match instances of models recovered from different image sequences. The proposed approach has been applied to the detection and matching of moving objects in video sequences and to shot matching, i.e., the identification of shots that depict the same scene in a video clip.
引用
收藏
页码:477 / 491
页数:15
相关论文
共 63 条
[1]  
Aner A, 2002, LECT NOTES COMPUT SC, V2353, P388
[2]  
[Anonymous], P INT C COMP VIS
[3]  
[Anonymous], INT J IMAGES GRAPH
[4]  
[Anonymous], 2001, P C OPT 3 D MEAS TEC
[5]   Video segmentation using 3-D hints contained in 2-D images [J].
Ardebilian, M ;
Tu, XW ;
Chen, LM ;
Faudemay, P .
MULTIMEDIA STORAGE AND ARCHIVING SYSTEMS, 1996, 2916 :236-242
[6]  
Baumberg A, 2000, PROC CVPR IEEE, P774, DOI 10.1109/CVPR.2000.855899
[7]  
BEARDSLEY P, 1996, P EUR C COMP VIS
[8]  
BENAYOUN S, 1998, P COMPRESSION RESENT
[9]  
Birchfield S., 1998, KLT IMPLEMENTATION K
[10]  
Boult T. E., 1991, Proceedings of the IEEE Workshop on Visual Motion (Cat. No.91TH0390-5), P179, DOI 10.1109/WVM.1991.212809