A Comprehensive Framework for Image Inpainting

被引:185
作者
Bugeau, Aurelie [1 ]
Bertalmio, Marcelo [2 ]
Caselles, Vicent [2 ]
Sapiro, Guillermo [3 ]
机构
[1] Barcelona Media Ctr Innovacio, Barcelona 08018, Spain
[2] Univ Pompeu Fabra, Dept Tecnol Informacio & Comunicac, Barcelona 08002, Spain
[3] Univ Minnesota, Dept Elect & Comp Engn, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
Image inpainting; partial differential equations (PDEs); texture synthesis; variational models; REGULARIZATION;
D O I
10.1109/TIP.2010.2049240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Inpainting is the art of modifying an image in a form that is not detectable by an ordinary observer. There are numerous and very different approaches to tackle the inpainting problem, though as explained in this paper, the most successful algorithms are based upon one or two of the following three basic techniques: copy-and-paste texture synthesis, geometric partial differential equations (PDEs), and coherence among neighboring pixels. We combine these three building blocks in a variational model, and provide a working algorithm for image inpainting trying to approximate the minimum of the proposed energy functional. Our experiments show that the combination of all three terms of the proposed energy works better than taking each term separately, and the results obtained are within the state-of-the-art.
引用
收藏
页码:2634 / 2645
页数:12
相关论文
共 32 条
[1]  
[Anonymous], 2001, Schooling for Tomorrow
[2]  
Aujol J., 2008, EXEMPLAR BASED INPAI
[3]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[4]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[5]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[6]   Strong-continuation, contrast-invariant inpainting with a third-order optimal PDE [J].
Bertalmio, Marcelo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (07) :1934-1938
[7]   Fast image inpainting based on coherence transport [J].
Bornemann, Folkmar ;
Maerz, Tom .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2007, 28 (03) :259-278
[8]  
Bugeau A, 2009, VISAPP 2009: PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 1, P26
[9]  
CHO TS, 2008, P IEEE C COMP VIS PA, P1, DOI DOI 10.1109/CVPR.2008.4587642
[10]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212