Theoretical results on sparse representations of multiple-measurement vectors

被引:602
作者
Chen, Jie [1 ]
Huo, Xiaoming [1 ]
机构
[1] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
基金
美国国家科学基金会;
关键词
basis pursuit; multiple-measurement vector (MMV); orthogonal matching pursuit (OMP); sparse representation;
D O I
10.1109/TSP.2006.881263
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The sparse representation of a multiple-measurement vector (MMV) is a relatively new problem in sparse representation. Efficient methods have been proposed. Although many theoretical results that are available in a simple case-single-measurement vector (SMV)-the theoretical analysis regarding MMV is lacking. In this paper, some known results of SMV are generalized to MMV. Some of these new results take advantages of additional information in the formulation of MMV. We consider the uniqueness under both an l(0)-norm-like criterion and an l(1)-norm-like criterion. The consequent equivalence between the l(0)-norm approach and the l(1)-norm approach indicates a computationally efficient way of finding the sparsest representation in a redundant dictionary. For greedy algorithms, it is proven that under certain conditions, orthogonal matching pursuit (OMP) can find the sparsest representation of an MMV with computational efficiency, just like in SMV. Simulations show that the predictions made by the proved theorems tend to be very conservative; this is consistent with some recent advances in probabilistic analysis based on random matrix theory. The connections will be discussed.
引用
收藏
页码:4634 / 4643
页数:10
相关论文
共 40 条
[1]  
[Anonymous], 1996, MATRIX COMPUTATION
[2]  
[Anonymous], 1997, A Wavelet Tour of Signal Processing
[3]   Robust uncertainty principles:: Exact signal reconstruction from highly incomplete frequency information [J].
Candès, EJ ;
Romberg, J ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (02) :489-509
[4]  
CHEN J, 2004, THEORETICAL RESULTS
[5]  
CHEN J, 2005, INT C AC SPECH SIGN
[6]  
Chen SSB, 2001, SIAM REV, V43, P129, DOI [10.1137/S003614450037906X, 10.1137/S1064827596304010]
[7]   Sparse solutions to linear inverse problems with multiple measurement vectors [J].
Cotter, SF ;
Rao, BD ;
Engan, K ;
Kreutz-Delgado, K .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2005, 53 (07) :2477-2488
[8]   On the optimality of the backward greedy algorithm for the subset selection problem [J].
Couvreur, C ;
Bresler, Y .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2000, 21 (03) :797-808
[9]   ADAPTIVE TIME-FREQUENCY DECOMPOSITIONS [J].
DAVIS, G ;
MALLAT, S ;
ZHANG, ZF .
OPTICAL ENGINEERING, 1994, 33 (07) :2183-2191
[10]  
Donoho D, 2004, MOST LARGE UNDERDETE