Stable Principal Component Pursuit

被引:365
作者
Zhou, Zihan [1 ]
Li, Xiaodong [2 ]
Wright, John [3 ]
Candes, Emmanuel [2 ,4 ]
Ma, Yi [1 ,3 ]
机构
[1] UIUC, Dept Elect & Comp Engn, Urbana, IL 61801 USA
[2] Stanford Univ, Dept Math, Stanford, CA 94305 USA
[3] Microsoft Res AsIA, Beijing, Peoples R China
[4] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
来源
2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY | 2010年
基金
美国国家科学基金会;
关键词
RECOVERY;
D O I
10.1109/ISIT.2010.5513535
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we study the problem of recovering a low-rank matrix (the principal components) from a high-dimensional data matrix despite both small entry-wise noise and gross sparse errors. Recently, it has been shown that a convex program, named Principal Component Pursuit (PCP), can recover the low-rank matrix when the data matrix is corrupted by gross sparse errors. We further prove that the solution to a related convex program (a relaxed PCP) gives an estimate of the low-rank matrix that is simultaneously stable to small entry-wise noise and robust to gross sparse errors. More precisely, our result shows that the proposed convex program recovers the low-rank matrix even though a positive fraction of its entries are arbitrarily corrupted, with an error bound proportional to the noise level. We present simulation results to support our result and demonstrate that the new convex program accurately recovers the principal components (the low-rank matrix) under quite broad conditions. To our knowledge, this is the first result that shows the classical Principal Component Analysis (PCA), optimal for small i.i.d. noise, can be made robust to gross sparse errors; or the first that shows the newly proposed PCP can be made stable to small entry-wise perturbations.
引用
收藏
页码:1518 / 1522
页数:5
相关论文
共 14 条
[1]  
Candes E.J., 2009, P IEEE
[2]  
Candes E. J., 2009, ROBUST PRINCIPAL COM
[3]   Decoding by linear programming [J].
Candes, EJ ;
Tao, T .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2005, 51 (12) :4203-4215
[4]  
CANDES EJ, 2009, TIGHT ORACLE BOUNDS
[5]   Stable signal recovery from incomplete and inaccurate measurements [J].
Candes, Emmanuel J. ;
Romberg, Justin K. ;
Tao, Terence .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (08) :1207-1223
[6]   For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution [J].
Donoho, DL .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (06) :797-829
[7]   Stable recovery of sparse overcomplete representations in the presence of noise [J].
Donoho, DL ;
Elad, M ;
Temlyakov, VN .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (01) :6-18
[8]   THE APPROXIMATION OF ONE MATRIX BY ANOTHER OF LOWER RANK [J].
Eckart, Carl ;
Young, Gale .
PSYCHOMETRIKA, 1936, 1 (03) :211-218
[9]  
Jolliffe I., 2002, PRINCIPAL COMPONENT, DOI [10.1007/978-1-4757-1904-8_7, 10.1016/0169-7439(87)80084-9]
[10]  
Lin Z., 2009, CAMSAP