Linear Volumetric Focus for Light Field Cameras

被引:136
作者
Dansereau, Donald G. [1 ]
Pizarro, Oscar [1 ]
Williams, Stefan B. [1 ]
机构
[1] Univ Sydney, Sch Aerosp Mech & Mechtron Engn, Australian Ctr Field Robot, Sydney, NSW 2006, Australia
来源
ACM TRANSACTIONS ON GRAPHICS | 2015年 / 34卷 / 02期
关键词
Algorithms; Theory; Design; Light field filtering; digital refocusing; plenoptic cameras; computational photography; Fourier analysis; DEPTH; SPARSE; SVD;
D O I
10.1145/2665074
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We demonstrate that the redundant information in light field imagery allows volumetric focus, an improvement of signal quality that maintains focus over a controllable range of depths. To do this, we derive the frequency-domain region of support of the light field, finding it to be the 4D hyperfan at the intersection of a dual fan and a hypercone, and design a filter with correspondingly shaped passband. Drawing examples from the Stanford Light Field Archive and images captured using a commercially available lenslet-based plenoptic camera, we demonstrate that the hyperfan outperforms competing methods including planar focus, fan-shaped antialiasing, and nonlinear image and video denoising techniques. We show the hyperfan preserves depth of field, making it a single-step all-in-focus denoising filter suitable for general-purpose light field rendering. We include results for different noise types and levels, through murky water and particulate matter, in real-world scenarios, and evaluated using a variety of metrics. We show that the hyperfan's performance scales with aperture count, and demonstrate the inclusion of aliased components for high-quality rendering.
引用
收藏
页数:20
相关论文
共 61 条
[21]  
Dansereau D. G., 2003, THESIS U CALGARY
[22]  
Dansereau D. G., 2014, THESIS U SYDNEY
[23]   A 4-D dual-fan filter bank for depth filtering in light fields [J].
Dansereau, Don ;
Bruton, Len T. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (02) :542-549
[24]   Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras [J].
Dansereau, Donald G. ;
Pizarro, Oscar ;
Williams, Stefan B. .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1027-1034
[25]  
Dansereau DG, 2011, IEEE INT C INT ROBOT, P4455, DOI 10.1109/IROS.2011.6048841
[26]  
Dansereau DG, 2011, IEEE INT CONF ROBOT, P1634
[27]   A frequency analysis of light transport [J].
Durand, F ;
Holzschuch, N ;
Soler, C ;
Chan, E ;
Sillion, FX .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :1115-1126
[28]   Image denoising via sparse and redundant representations over learned dictionaries [J].
Elad, Michael ;
Aharon, Michal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (12) :3736-3745
[29]  
Freeman W., 2009, MITCSAILTR2009019
[30]   Visual perception and the statistical properties of natural scenes [J].
Geisler, Wilson S. .
ANNUAL REVIEW OF PSYCHOLOGY, 2008, 59 :167-192