Quasi-Homography Warps in Image Stitching

被引:84
作者
Li, Nan [1 ]
Xu, Yifang [2 ]
Wang, Chao [3 ]
机构
[1] Tianjin Univ, Ctr Appl Math, Tianjin 300072, Peoples R China
[2] Nankai Univ, Ctr Combinator, Tianjin 300071, Peoples R China
[3] Nankai Univ, Dept Software, Tianjin 300071, Peoples R China
关键词
Image stitching; image warping; natural-looking; projective distortion; perspective distortion; PANORAMAS; ALIGNMENT; REGION; SYSTEM; SCENES;
D O I
10.1109/TMM.2017.2771566
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The naturalness of warps is gaining extensive attention in image stitching. Recent warps, such as SPHP and AANAP, use global similarity warps to mitigate projective distortion (which enlarges regions); however, they necessarily bring in perspective distortion (which generates inconsistencies). In this paper, we propose a novel quasi-homography warp, which effectively balances the perspective distortion against the projective distortion in the non-overlapping region to create a more natural-looking panorama. Our approach formulates the warp as the solution of a bivariate system, where perspective distortion and projective distortion are characterized as slope preservation and scale linearization, respectively. Because our proposed warp only relies on a global homography, it is thus totally parameter free. A comprehensive experiment shows that a quasi-homography warp outperforms some state-of-the-art warps in urban scenes, including homography, AutoStitch and SPHP. A user study demonstrates that it wins most users' favor, compared to homography and SPHP.
引用
收藏
页码:1365 / 1375
页数:11
相关论文
共 43 条
[1]   Interactive digital photomontage [J].
Agarwala, A ;
Dontcheva, M ;
Agrawala, M ;
Drucker, S ;
Colburn, A ;
Curless, B ;
Salesin, D ;
Cohen, M .
ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03) :294-302
[2]  
[Anonymous], 2003, Multiple view geometry in computer vision
[3]   Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239
[4]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[5]   A MULTIRESOLUTION SPLINE WITH APPLICATION TO IMAGE MOSAICS [J].
BURT, PJ ;
ADELSON, EH .
ACM TRANSACTIONS ON GRAPHICS, 1983, 2 (04) :217-236
[6]   Shape-Preserving Half-Projective Warps for Image Stitching [J].
Chang, Che-Han ;
Sato, Yoichi ;
Chuang, Yung-Yu .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3254-3261
[7]   VideoPuzzle: Descriptive One-Shot Video Composition [J].
Chen, Qiang ;
Wang, Meng ;
Huang, Zhongyang ;
Hua, Yang ;
Song, Zheng ;
Yan, Shuicheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (03) :521-534
[8]   Natural Image Stitching with the Global Similarity Prior [J].
Chen, Yu-Sheng ;
Chuang, Yung-Yu .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :186-201
[9]   Mosaics of scenes with moving objects [J].
Davis, J .
1998 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1998, :354-360
[10]   Building large image mosaics with invisible seam-lines [J].
Duplaquet, ML .
VISUAL INFORMATION PROCESSING VII, 1998, 3387 :369-377