On the exponential convergence of matching pursuits in quasi-incoherent dictionaries

被引:88
作者
Gribonval, R
Vandergheynst, P
机构
[1] Inst Natl Rech Informat & Automat, IRISA, F-35042 Rennes, France
[2] Ecole Polytech Fed Lausanne, Swiss Fed Inst Technol, Signal Proc Inst, CH-1015 Lausanne, Switzerland
关键词
dictionary; greedy algorithm; matching pursuit (MP); nonlinear approximation; sparse representation;
D O I
10.1109/TIT.2005.860474
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The purpose of this correspondence is to extend results by Villemoes and Temlyakov about exponential convergence of Matching Pursuit (MP) with some structured dictionaries for "simple" functions in finite or infinite dimension. The results are based on an extension of Tropp's results about Orthogonal Matching Pursuit (OMP) in finite dimension, with the observation that it does not only work for OMP but also for MP The main contribution is a detailed analysis of the approximation and stability properties of MP with quasi-incoherent dictionaries, and a bound on the number of steps sufficient to reach an error no larger than a penalization factor times the best m-term approximation error.
引用
收藏
页码:255 / 261
页数:7
相关论文
共 30 条
[1]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[2]  
Christensen O., 2003, An Introduction to Frames and Riesz Bases, DOI DOI 10.1007/978-0-8176-8224-8
[3]   Adaptive greedy approximations [J].
Davis, G ;
Mallat, S ;
Avellaneda, M .
CONSTRUCTIVE APPROXIMATION, 1997, 13 (01) :57-98
[4]   Some remarks on greedy algorithms [J].
DeVore, RA ;
Temlyakov, VN .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 1996, 5 (2-3) :173-187
[5]  
DONOHO D, 2004, 0406 U S CAR IND MAT
[6]   Optimally sparse representation in general (nonorthogonal) dictionaries via l1 minimization [J].
Donoho, DL ;
Elad, M .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2003, 100 (05) :2197-2202
[7]   Uncertainty principles and ideal atomic decomposition [J].
Donoho, DL ;
Huo, XM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2001, 47 (07) :2845-2862
[8]   A generalized uncertainty principle and sparse representation in pairs of bases [J].
Elad, M ;
Bruckstein, AM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2002, 48 (09) :2558-2567
[9]   On sparse representation in pairs of bases [J].
Feuer, A ;
Nemirovski, A .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2003, 49 (06) :1579-1581
[10]   PROJECTION PURSUIT REGRESSION [J].
FRIEDMAN, JH ;
STUETZLE, W .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1981, 76 (376) :817-823