Invertible Motion Blur in Video

被引:55
作者
Agrawal, Amit [1 ]
Xu, Yi [1 ]
Raskar, Ramesh [2 ]
机构
[1] MERL, Cambridge, MA USA
[2] MIT Media Lab, Cambridge, MA USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2009年 / 28卷 / 03期
关键词
Computational Photography; Motion Deblurring; PSF Invertibility; PSF Estimation; IMAGE; CAMERA; DEPTH;
D O I
10.1145/1531326.1531401
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We show that motion blur in successive video frames is invertible even if the point-spread function (PSF) due to motion smear in a single photo is non-invertible. Blurred photos exhibit nulls (zeros) in the frequency transform of the PSF, leading to an ill-posed deconvolution. Hardware solutions to avoid this require specialized devices such as the coded exposure camera or accelerating sensor motion. We employ ordinary video cameras and introduce the notion of null-filling along with joint-invertibility of multiple blur-functions. The key idea is to record the same object with varying PSFs, so that the nulls in the frequency component of one frame can be filled by other frames. The combined frequency transform becomes null-free, making deblurring well-posed. We achieve jointly-invertible blur simply by changing the exposure time of successive frames. We address the problem of automatic deblurring of objects moving with constant velocity by solving the four critical components: preservation of all spatial frequencies, segmentation of moving parts, motion estimation of moving parts, and non-degradation of the static parts of the scene. We demonstrate several challenging cases of object motion blur including textured backgrounds and partial occluders.
引用
收藏
页数:8
相关论文
共 34 条
[1]  
Agrawal A, 2007, P IEEE C COMP VIS PA, P1
[2]  
[Anonymous], 2008, 2008 IEEE C COMP VIS
[3]  
[Anonymous], ICCV WORKSH COL PHOT
[4]  
[Anonymous], 2007, IEEE C COMPUT VIS PA, DOI DOI 10.1109/CVPR.2007.383029
[5]  
Bascle B., 1996, Proceedings of the European Conference on Comput Vision, V2, P573
[6]  
Ben-Ezra M, 2004, IEEE T PATTERN ANAL, V26, P689, DOI 10.1109/TPAMI.2004.1
[7]   EXACT DECONVOLUTION FOR MULTIPLE CONVOLUTION-OPERATORS - AN OVERVIEW, PLUS PERFORMANCE CHARACTERIZATIONS FOR IMAGING SENSORS [J].
BERENSTEIN, CA ;
PATRICK, EV .
PROCEEDINGS OF THE IEEE, 1990, 78 (04) :723-734
[8]  
Chen J, 2008, LECT NOTES COMPUT SC, V5018, P1, DOI 10.1007/978-3-540-79723-4_1
[9]   Image motion estimation from motion smear - A new computational model [J].
Chen, WG ;
Nandhakumar, N ;
Martin, WN .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (04) :412-425
[10]  
Cho S, 2007, IEEE I CONF COMP VIS, P596