Accurate and efficient stereo processing by semi-global matching and mutual information

被引:1114
作者
Hirschmüller, H [1 ]
机构
[1] DLR, German Aerosp Ctr, Inst Robot & Mechatron Oberpfafenhofen, D-82230 Wessling, Germany
来源
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS | 2005年
关键词
D O I
10.1109/cvpr.2005.56
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper considers the objectives of accurate stereo matching, especially at object boundaries, robustness against recording or illumination changes and efficiency of the calculation. These objectives lead to the proposed Semi-Global Matching method that performs pixelwise matching based on Mutual Information and the approximation of a global smoothness constraint. Occlusions are detected and disparities determined with sub-pixel accuracy. Additionally, an extension for multi-baseline stereo images is presented. There are two novel contributions. Firstly, a hierarchical calculation of Mutual Information based matching is shown, which is almost as fast as intensity based matching. Secondly, an approximation of a global cost calculation is proposed that can be performed in a time that is linear to the number of pixels and disparities. The implementation requires just l second on typical images.
引用
收藏
页码:807 / 814
页数:8
相关论文
共 13 条
[1]   Depth discontinuities by pixel-to-pixel stereo [J].
Birchfield, S ;
Tomasi, C .
SIXTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, 1998, :1073-1080
[2]   Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239
[3]  
EGNAL G, 2000, MSCIS0020 U PENNS CO
[4]  
FELZENSZWALB PF, 2004, IEEE C COMP VIS PATT
[5]   Real-time correlation-based stereo vision with reduced border errors [J].
Hirschmüller, H ;
Innocent, PR ;
Garibaldi, J .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2002, 47 (1-3) :229-246
[6]  
Kim J., 2003, INT C COMP VIS
[7]  
Kolmogorov V, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P508, DOI 10.1109/ICCV.2001.937668
[8]   A taxonomy and evaluation of dense two-frame stereo correspondence algorithms [J].
Scharstein, D ;
Szeliski, R .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2002, 47 (1-3) :7-42
[9]  
Scharstein D, 2003, PROC CVPR IEEE, P195
[10]   Stereo matching using belief propagation [J].
Sun, J ;
Zheng, NN ;
Shum, HY .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (07) :787-800