Non-Negative Matrix Factorization Revisited: Uniqueness and Algorithm for Symmetric Decomposition

被引:198
作者
Huang, Kejun [1 ]
Sidiropoulos, Nicholas D. [1 ]
Swami, Ananthram [2 ]
机构
[1] Univ Minnesota, Dept Elect & Comp Engn, Minneapolis, MN 55455 USA
[2] Army Res Lab, Adelphi, MD 20783 USA
基金
美国国家科学基金会;
关键词
Nonnegative matrix factorization (NMF); symmetric NMF; uniqueness sparsity; Procrustes rotation; COMPLEXITY;
D O I
10.1109/TSP.2013.2285514
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Non-negative matrix factorization (NMF) has found numerous applications, due to its ability to provide interpretable decompositions. Perhaps surprisingly, existing results regarding its uniqueness properties are rather limited, and there is much room for improvement in terms of algorithms as well. Uniqueness aspects of NMF are revisited here from a geometrical point of view. Both symmetric and asymmetric NMF are considered, the former being tantamount to element-wise non-negative square-root factorization of positive semidefinite matrices. New uniqueness results are derived, e. g., it is shown that a sufficient condition for uniqueness is that the conic hull of the latent factors is a superset of a particular second-order cone. Checking this condition is shown to be NP-complete; yet this and other results offer insights on the role of latent sparsity in this context. On the computational side, a new algorithm for symmetric NMF is proposed, which is very different from existing ones. It alternates between Procrustes rotation and projection onto the non-negative orthant to find a non-negative matrix close to the span of the dominant subspace. Simulation results show promising performance with respect to the state-of-art. Finally, the new algorithm is applied to a clustering problem for co-authorship data, yielding meaningful and interpretable results.
引用
收藏
页码:211 / 224
页数:14
相关论文
共 45 条
[1]  
[Anonymous], 1979, NONNEGATIVE MATRICES
[2]  
[Anonymous], 2003, P 26 ANN INT ACM SIG, DOI DOI 10.1145/860435.860485
[3]  
[Anonymous], 2008, IGARSS 2008, DOI DOI 10.1109/IGARSS.2008.4779330
[4]  
Berman A., 2003, Completely positive matrices
[5]  
Bertsekas D. B., 1999, NONLINEAR PROBRAMMIN
[6]  
Boyd S., 2004, CONVEX OPTIMIZATION, VFirst, DOI DOI 10.1017/CBO9780511804441
[7]   COMPUTING NONNEGATIVE RANK FACTORIZATIONS [J].
CAMPBELL, SL ;
POOLE, GD .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1981, 35 (FEB) :175-182
[8]   On reduced rank nonnegative matrix factorization for symmetric nonnegative matrices [J].
Catral, M ;
Han, LX ;
Neumann, M ;
Plemmons, RJ .
LINEAR ALGEBRA AND ITS APPLICATIONS, 2004, 393 :107-126
[9]   MAXIMUM BLOCK IMPROVEMENT AND POLYNOMIAL OPTIMIZATION [J].
Chen, Bilian ;
He, Simai ;
Li, Zhening ;
Zhang, Shuzhong .
SIAM JOURNAL ON OPTIMIZATION, 2012, 22 (01) :87-107
[10]   THE NONNEGATIVE RANK FACTORIZATIONS OF NONNEGATIVE MATRICES [J].
CHEN, JC .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1984, 62 (NOV) :207-217