Restricted Isometry Constants Where lp Sparse Recovery Can Fail for 0 < p ≤ 1

被引:97
作者
Davies, Michael Evan [1 ]
Gribonval, Remi [2 ]
机构
[1] Univ Edinburgh, Joint Res Inst Signal & Image Proc, Edinburgh EH9 3JL, Midlothian, Scotland
[2] Ctr Inria Rennes Bretagne Atlantique, F-35042 Rennes, France
基金
英国工程与自然科学研究理事会;
关键词
Compressed sensing; convex optimization; inverse problem; iterative reweighted optimization; nonconvex optimization; overcomplete dictionary; restricted isometry property; sparse representation; underdetermined linear system; SIGNAL RECONSTRUCTION; REPRESENTATIONS; MINIMIZATION; PROPERTY; BASES;
D O I
10.1109/TIT.2009.2016030
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates conditions under which the solution of an underdetermined linear system with minimal ℓp norm, 0 < p ≤ 1, is guaranteed to be also the sparsest one. Matrices are constructed with restricted isometry constants (RIC) δ2m arbitrarily close to 1 / √ 2 ≈ 0.707 where sparse recovery with p = 1 fails for at least one m-sparse vector, as well as matrices with δ2m arbitrarily close to one where ℓ1 minimization succeeds for any m-sparse vector. This highlights the pessimism of sparse recovery prediction based on the RIC, and indicates that there is limited room for improving over the best known positive results of Foucart and Lai, which guarantee that ℓ1 minimization recovers all m-sparse vectors for any matrix with δ2m < 2(3-√2)/7 ≈ 0.4531. These constructions are a by-product of tight conditions for ℓp recovery (0 ≤ p ≤ 1) with matrices of unit spectral norm, which are expressed in terms of the minimal singular values of 2m-column submatrices. Compared to ℓ1 minimization, ℓp minimization recovery failure is shown to be only slightly delayed in terms of the RIC values. Furthermore in this case the minimization is nonconvex and it is important to consider the specific minimization algorithm being used. It is shown that when ℓp optimization is attempted using an iterative reweighted ℓ1 scheme, failure can still occur for δ 2m arbitrarily close to 1/√2. © 2009 IEEE.
引用
收藏
页码:2203 / 2214
页数:12
相关论文
共 17 条
[1]   A Simple Proof of the Restricted Isometry Property for Random Matrices [J].
Baraniuk, Richard ;
Davenport, Mark ;
DeVore, Ronald ;
Wakin, Michael .
CONSTRUCTIVE APPROXIMATION, 2008, 28 (03) :253-263
[2]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[3]   The restricted isometry property and its implications for compressed sensing [J].
Candes, Emmanuel J. .
COMPTES RENDUS MATHEMATIQUE, 2008, 346 (9-10) :589-592
[4]   Enhancing Sparsity by Reweighted l1 Minimization [J].
Candes, Emmanuel J. ;
Wakin, Michael B. ;
Boyd, Stephen P. .
JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 2008, 14 (5-6) :877-905
[5]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[6]  
Donoho DL, 2009, J AM MATH SOC, V22, P1
[7]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[8]   Optimally sparse representation in general (nonorthogonal) dictionaries via l1 minimization [J].
Donoho, DL ;
Elad, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2003, 100 (05) :2197-2202
[9]  
FIGUEIREDO M, 2005, P IEEE INT C IM PROC
[10]   Majorization-minimization algorithms for wavelet-based image restoration [J].
Figueiredo, Mario A. T. ;
Bioucas-Dias, Jose M. ;
Nowak, Robert D. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) :2980-2991