Linear Volumetric Focus for Light Field Cameras

被引:136
作者
Dansereau, Donald G. [1 ]
Pizarro, Oscar [1 ]
Williams, Stefan B. [1 ]
机构
[1] Univ Sydney, Sch Aerosp Mech & Mechtron Engn, Australian Ctr Field Robot, Sydney, NSW 2006, Australia
来源
ACM TRANSACTIONS ON GRAPHICS | 2015年 / 34卷 / 02期
关键词
Algorithms; Theory; Design; Light field filtering; digital refocusing; plenoptic cameras; computational photography; Fourier analysis; DEPTH; SPARSE; SVD;
D O I
10.1145/2665074
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We demonstrate that the redundant information in light field imagery allows volumetric focus, an improvement of signal quality that maintains focus over a controllable range of depths. To do this, we derive the frequency-domain region of support of the light field, finding it to be the 4D hyperfan at the intersection of a dual fan and a hypercone, and design a filter with correspondingly shaped passband. Drawing examples from the Stanford Light Field Archive and images captured using a commercially available lenslet-based plenoptic camera, we demonstrate that the hyperfan outperforms competing methods including planar focus, fan-shaped antialiasing, and nonlinear image and video denoising techniques. We show the hyperfan preserves depth of field, making it a single-step all-in-focus denoising filter suitable for general-purpose light field rendering. We include results for different noise types and levels, through murky water and particulate matter, in real-world scenarios, and evaluated using a variety of metrics. We show that the hyperfan's performance scales with aperture count, and demonstrate the inclusion of aliased components for high-quality rendering.
引用
收藏
页数:20
相关论文
共 61 条
[31]   The Variational Structure of Disparity and Regularization of 4D Light Fields [J].
Goldluecke, Bastian ;
Wanner, Sven .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1003-1010
[32]   Weighted averaging for denoising with overcomplete dictionaries [J].
Guleryuz, Onur G. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) :3020-3034
[33]  
Huang Yangcheng., 2007, the proceedings of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks, WoWMoM, P1
[34]  
Isaksen A, 2000, COMP GRAPH, P297, DOI 10.1145/344779.344929
[35]   Reconstructing Gas Flows Using Light-Path Approximation [J].
Ji, Yu ;
Ye, Jinwei ;
Yu, Jingyi .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :2507-2514
[36]  
Lambert J.H., 1760, Photometria sive de mensura et gradibus luminis, colo-rum et umbrae
[37]   Linear View Synthesis Using a Dimensionality Gap Light Field Prior [J].
Levin, Anat ;
Durand, Fredo .
2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, :1831-1838
[38]   4D Frequency Analysis of Computational Cameras for Depth of Field Extension [J].
Levin, Anat ;
Hasinoff, Samuel W. ;
Green, Paul ;
Durand, Fredo ;
Freeman, William T. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[39]   Synthetic aperture confocal imaging [J].
Levoy, M ;
Chen, B ;
Vaish, V ;
Horowitz, M ;
McDowall, I ;
Bolas, M .
ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03) :825-834
[40]  
Levoy M., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P31, DOI 10.1145/237170.237199