Probabilistic detection and tracking of motion boundaries

被引:88
作者
Black, MJ
Fleet, DJ
机构
[1] Xerox Corp, Palo Alto Res Ctr, Palo Alto, CA 94304 USA
[2] Brown Univ, Dept Comp Sci, Providence, RI 02912 USA
[3] Queens Univ, Dept Comp Sci, Kingston, ON K7L 3N6, Canada
关键词
motion discontinuities; occlusion; optical flow; Bayesian methods; particle filtering;
D O I
10.1023/A:1008195307933
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a Bayesian framework for representing and recognizing local image motion in terms of two basic models: translational motion and motion boundaries. Motion boundaries are represented using a non-linear generative model that explicitly encodes the orientation of the boundary, the velocities on either side, the motion of the occluding edge over time, and the appearance/disappearance of pixels at the boundary. We represent the posterior probability distribution over the model parameters given the image data using discrete samples. This distribution is propagated over time using a particle filtering algorithm. To efficiently represent such a high-dimensional space we initialize samples using the responses of a low-level motion discontinuity detector. The formulation and computational model provide a general probabilistic framework for motion estimation with multiple, non-linear, models.
引用
收藏
页码:231 / 245
页数:15
相关论文
共 34 条
[21]  
KONRAD J, 1988, P 2 IEEE INT C COMP, P354
[22]   Sequential Monte Carlo methods for dynamic systems [J].
Liu, JS ;
Chen, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1998, 93 (443) :1032-1044
[23]   SCENE SEGMENTATION FROM VISUAL-MOTION USING GLOBAL OPTIMIZATION [J].
MURRAY, DW ;
BUXTON, BF .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1987, 9 (02) :220-228
[24]   ANALYSIS OF ACCRETION AND DELETION AT BOUNDARIES IN DYNAMIC SCENES [J].
MUTCH, KM ;
THOMPSON, WB .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1985, 7 (02) :133-138
[25]   AN INVESTIGATION OF SMOOTHNESS CONSTRAINTS FOR THE ESTIMATION OF DISPLACEMENT VECTOR-FIELDS FROM IMAGE SEQUENCES [J].
NAGEL, HH ;
ENKELMANN, W .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1986, 8 (05) :565-593
[26]  
NIYOGI SA, 1995, FIFTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, PROCEEDINGS, P1044, DOI 10.1109/ICCV.1995.466819
[27]  
OTTE M, 1994, LECTURE NOTES COMPUT, V800, P51
[28]  
POTTER JL, 1980, IEEE T SMC, V5, P390
[29]   Compact representations of videos through dominant and multiple motion estimation [J].
Sawhney, HS ;
Ayer, S .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (08) :814-830