A frame construction and a universal distortion bound for sparse representations

被引:40
作者
Akcakaya, Mehmet [1 ]
Tarokh, Vahid [1 ]
机构
[1] Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA
关键词
distortion; frames; redundancy; sparse representations; sparsity;
D O I
10.1109/TSP.2007.914344
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We consider approximations of signals by the elements of a frame in a complex vector space of dimension N and formulate both the noiseless and the noisy sparse representation problems. The noiseless representation problem is to find sparse representations of a signal r given that such representations exist. In this case, we explicitly construct a frame, referred to as the Vandermonde frame, for which the noiseless sparse representation problem can be solved uniquely using O(N-2) operations, as long as the number of non-zero coefficients in the sparse representation of r is epsilon N for some 0 <= epsilon <= 0.5. It is known that epsilon <= 0.5 cannot be relaxed without violating uniqueness. The noisy sparse representation problem is to find sparse representations of a signal r satisfying a distortion criterion. In this case, we establish a lower bound on the tradeoff between the sparsity of the representation, the underlying distortion and the redundancy of any given frame.
引用
收藏
页码:2443 / 2450
页数:8
相关论文
共 14 条
[1]   Decoding by linear programming [J].
Candes, EJ ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (12) :4203-4215
[2]  
CANDES EJ, 2005, WAV APPL SIGN IM PRO
[3]   Stable signal recovery from incomplete and inaccurate measurements [J].
Candes, Emmanuel J. ;
Romberg, Justin K. ;
Tao, Terence .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (08) :1207-1223
[4]  
Chen A, 2003, EWEEK, V20, P61
[5]   Stable recovery of sparse overcomplete representations in the presence of noise [J].
Donoho, DL ;
Elad, M ;
Temlyakov, VN .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (01) :6-18
[6]   Denoising by sparse approximation: Error bounds based on rate-distortion theory [J].
Fletcher, Alyson K. ;
Rangan, Sundeep ;
Goyal, Vivek K. ;
Ramchandran, Kannan .
EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2006, 2006 (1)
[7]  
MACWILLIAMS FJ, 1996, THEORY ERROR CORRECT
[8]  
Muirhead R. J., 1982, Aspects of multivariate statistical theory
[9]  
Rudelson M, 2005, INT MATH RES NOTICES, V2005, P4019