NESTA: A Fast and Accurate First-Order Method for Sparse Recovery

被引:729
作者
Becker, Stephen [1 ]
Bobin, Jerome [1 ]
Candes, Emmanuel J. [1 ]
机构
[1] CALTECH, Pasadena, CA 91125 USA
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2011年 / 4卷 / 01期
关键词
Nesterov's method; smooth approximations of nonsmooth functions; l(1) minimization; duality in convex optimization; continuation methods; compressed sensing; total-variation minimization; LINEARIZED BREGMAN ITERATION; TOTAL VARIATION MINIMIZATION; SIGNAL RECOVERY; THRESHOLDING ALGORITHM; SUBSPACE OPTIMIZATION; INVERSE PROBLEMS; LEAST-SQUARES; RECONSTRUCTION; SHRINKAGE; L(1)-MINIMIZATION;
D O I
10.1137/090756855
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate signal recovery or image reconstruction from indirect and possibly undersampled data is a topic of considerable interest; for example, the literature in the recent field of compressed sensing is already quite immense. This paper applies a smoothing technique and an accelerated first-order algorithm, both from Nesterov [Math. Program. Ser. A, 103 (2005), pp. 127-152], and demonstrates that this approach is ideally suited for solving large-scale compressed sensing reconstruction problems as (1) it is computationally efficient, (2) it is accurate and returns solutions with several correct digits, (3) it is flexible and amenable to many kinds of reconstruction problems, and (4) it is robust in the sense that its excellent performance across a wide range of problems does not depend on the fine tuning of several parameters. Comprehensive numerical experiments on realistic signals exhibiting a large dynamic range show that this algorithm compares favorably with recently proposed state-of-the-art methods. We also apply the algorithm to solve other problems for which there are fewer alternatives, such as total-variation minimization and convex programs seeking to minimize the l(1) norm of Wx under constraints, in which W is not diagonal. The code is available online as a free package in the MATLAB language.
引用
收藏
页码:1 / 39
页数:39
相关论文
共 60 条
[1]   Fast Image Recovery Using Variable Splitting and Constrained Optimization [J].
Afonso, Manya V. ;
Bioucas-Dias, Jose M. ;
Figueiredo, Mario A. T. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (09) :2345-2356
[2]  
[Anonymous], 1970, PRINCETON MATH SER
[3]   Some First-Order Algorithms for Total Variation Based Image Restoration [J].
Aujol, Jean-Francois .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2009, 34 (03) :307-327
[4]   2-POINT STEP SIZE GRADIENT METHODS [J].
BARZILAI, J ;
BORWEIN, JM .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1988, 8 (01) :141-148
[5]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[6]   A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration [J].
Bioucas-Dias, Jose M. ;
Figueiredo, Mario A. T. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) :2992-3004
[7]   Nonmonotone spectral projected gradient methods on convex sets [J].
Birgin, EG ;
Martínez, JM ;
Raydan, M .
SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (04) :1196-1211
[8]   A FAST AND ACCURATE FIRST-ORDER ALGORITHM FOR COMPRESSED SENSING [J].
Bobin, J. ;
Candes, E. J. .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :1457-1460
[9]   Compressed Sensing in Astronomy [J].
Bobin, Jerome ;
Starck, Jean-Luc ;
Ottensamer, Roland .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2008, 2 (05) :718-726
[10]   CONVERGENCE OF THE LINEARIZED BREGMAN ITERATION FOR l1-NORM MINIMIZATION [J].
Cai, Jian-Feng ;
Osher, Stanley ;
Shen, Zuowei .
MATHEMATICS OF COMPUTATION, 2009, 78 (268) :2127-2136