Generalizing the Nonlocal-Means to Super-Resolution Reconstruction

被引:547
作者
Protter, Matan [1 ]
Elad, Michael [1 ]
Takeda, Hiroyuki [2 ]
Milanfar, Peyman [2 ]
机构
[1] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
[2] Univ Calif Santa Cruz, Dept Elect Engn, Santa Cruz, CA 95064 USA
关键词
Nonlocal-means; probabilistic motion estimation; super-resolution; HIGH-RESOLUTION IMAGE; VIDEO; ALGORITHMS; REGRESSION; MOTION; LIMITS; NOISY;
D O I
10.1109/TIP.2008.2008067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super-resolution reconstruction proposes a fusion of several low-quality images into one higher quality result with better optical resolution. Classic super-resolution techniques strongly rely on the availability of accurate motion estimation for this fusion task. When the motion is estimated inaccurately, as often happens for nonglobal motion fields, annoying artifacts appear in the super-resolved outcome. Encouraged by recent developments on the video denoising problem, where state-of-the-art algorithms are formed with no explicit motion estimation, we seek a super-resolution algorithm of similar nature that will allow processing sequences with general motion patterns. In this paper, we base our solution on the Nonlocal-Means (NLM) algorithm. We show how this denoising method is generalized to become a relatively simple super-resolution algorithm with no explicit motion estimation. Results on several test movies show that the proposed method is very successful in providing super-resolution on general sequences.
引用
收藏
页码:36 / 51
页数:16
相关论文
共 48 条
[1]   Super-resolution still and video reconstruction from MPEG-coded video [J].
Altunbasak, Y ;
Patti, AJ ;
Mersereau, RM .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2002, 12 (04) :217-226
[2]  
[Anonymous], 1992, CVGIP-IMAG UNDERSTAN
[3]  
[Anonymous], GRAPHICS GEMS
[4]   Limits on super-resolution and how to break them [J].
Baker, S ;
Kanade, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (09) :1167-1183
[5]  
Bertsekas D.P., 1999, NONLINEAR PROGRAMMIN
[6]   ITERATIVE METHODS FOR IMAGE DEBLURRING [J].
BIEMOND, J ;
LAGENDIJK, RL ;
MERSEREAU, RM .
PROCEEDINGS OF THE IEEE, 1990, 78 (05) :856-883
[7]   Bayesian wavelet-based image deconvolution: A GEM algorithm exploiting a class of heavy-tailed priors [J].
Bioucas-Dias, JM .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (04) :937-951
[8]   Space-time adaptation for patch-based image sequence restoration [J].
Boulanger, Jerome ;
Kervrann, Charles ;
Bouthemy, Patrick .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (06) :1096-1102
[9]  
Buades A, 2005, AVSS 2005: ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE, PROCEEDINGS, P70
[10]   A review of image denoising algorithms, with a new one [J].
Buades, A ;
Coll, B ;
Morel, JM .
MULTISCALE MODELING & SIMULATION, 2005, 4 (02) :490-530