Quasi-Homography Warps in Image Stitching

被引:84
作者
Li, Nan [1 ]
Xu, Yifang [2 ]
Wang, Chao [3 ]
机构
[1] Tianjin Univ, Ctr Appl Math, Tianjin 300072, Peoples R China
[2] Nankai Univ, Ctr Combinator, Tianjin 300071, Peoples R China
[3] Nankai Univ, Dept Software, Tianjin 300071, Peoples R China
关键词
Image stitching; image warping; natural-looking; projective distortion; perspective distortion; PANORAMAS; ALIGNMENT; REGION; SYSTEM; SCENES;
D O I
10.1109/TMM.2017.2771566
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The naturalness of warps is gaining extensive attention in image stitching. Recent warps, such as SPHP and AANAP, use global similarity warps to mitigate projective distortion (which enlarges regions); however, they necessarily bring in perspective distortion (which generates inconsistencies). In this paper, we propose a novel quasi-homography warp, which effectively balances the perspective distortion against the projective distortion in the non-overlapping region to create a more natural-looking panorama. Our approach formulates the warp as the solution of a bivariate system, where perspective distortion and projective distortion are characterized as slope preservation and scale linearization, respectively. Because our proposed warp only relies on a global homography, it is thus totally parameter free. A comprehensive experiment shows that a quasi-homography warp outperforms some state-of-the-art warps in urban scenes, including homography, AutoStitch and SPHP. A user study demonstrates that it wins most users' favor, compared to homography and SPHP.
引用
收藏
页码:1365 / 1375
页数:11
相关论文
共 43 条
[11]  
Eden A., 2006, 2006 IEEE COMP SOC C, P2498, DOI 10.1109/CVPR.2006.268
[12]  
Efros AA, 2001, COMP GRAPH, P341, DOI 10.1145/383259.383296
[13]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395
[14]   Tiling in Interactive Panoramic Video: Approaches and Evaluation [J].
Gaddam, Vamsidhar Reddy ;
Riegler, Michael ;
Eg, Ragnhild ;
Griwodz, Carsten ;
Halvorsen, Pal .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (09) :1819-1831
[15]  
Gao J., 2013, EUROGRAPHICS SHORT P, P45
[16]  
Gao JH, 2011, PROC CVPR IEEE, P49, DOI 10.1109/CVPR.2011.5995433
[17]   Epipolar Geometry Estimation for Urban Scenes with Repetitive Structures [J].
Kushnir, Maria ;
Shimshoni, Ilan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (12) :2381-2395
[18]   Graphicut textures:: Image and video synthesis using graph cuts [J].
Kwatra, V ;
Schödl, A ;
Essa, I ;
Turk, G ;
Bobick, A .
ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03) :277-286
[19]  
Levin A, 2004, LECT NOTES COMPUT SC, V2034, P377
[20]   Investigating image stitching for action recognition [J].
Li, Yufeng ;
Li, Ping'an ;
Lei, Daozhong ;
Shi, Yingchun ;
Tan, Lixin .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (03) :3279-3286