Graph Regularized Nonnegative Matrix Factorization for Data Representation

被引:1975
作者
Cai, Deng [1 ]
He, Xiaofei [1 ]
Han, Jiawei [2 ]
Huang, Thomas S. [3 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Coll Comp Sci, Hangzhou 310058, Zhejiang, Peoples R China
[2] Univ Illinois, Dept Comp Sci, Siebel Ctr, Urbana, IL 61801 USA
[3] Univ Illinois, Beckman Inst Adv Sci & Technol, Beckman Inst Ctr, Urbana, IL 61801 USA
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Nonnegative matrix factorization; graph Laplacian; manifold regularization; clustering; PARTS; MANIFOLD; OBJECTS;
D O I
10.1109/TPAMI.2010.231
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Matrix factorization techniques have been frequently applied in information retrieval, computer vision, and pattern recognition. Among them, Nonnegative Matrix Factorization (NMF) has received considerable attention due to its psychological and physiological interpretation of naturally occurring data whose representation may be parts based in the human brain. On the other hand, from the geometric perspective, the data is usually sampled from a low-dimensional manifold embedded in a high-dimensional ambient space. One then hopes to find a compact representation, which uncovers the hidden semantics and simultaneously respects the intrinsic geometric structure. In this paper, we propose a novel algorithm, called Graph Regularized Nonnegative Matrix Factorization (GNMF), for this purpose. In GNMF, an affinity graph is constructed to encode the geometrical information and we seek a matrix factorization, which respects the graph structure. Our empirical study shows encouraging results of the proposed algorithm in comparison to the state-of-the-art algorithms on real-world problems.
引用
收藏
页码:1548 / 1560
页数:13
相关论文
共 47 条
  • [1] [Anonymous], 1973, Pattern Classification and Scene Analysis
  • [2] [Anonymous], 2005, ICML
  • [3] [Anonymous], P INT JOINT C ART IN
  • [4] Belkin M, 2002, ADV NEUR IN, V14, P585
  • [5] Belkin M, 2006, J MACH LEARN RES, V7, P2399
  • [6] Metagenes and molecular pattern discovery using matrix factorization
    Brunet, JP
    Tamayo, P
    Golub, TR
    Mesirov, JP
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2004, 101 (12) : 4164 - 4169
  • [7] Document clustering using locality preserving indexing
    Cai, D
    He, XF
    Han, JW
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (12) : 1624 - 1637
  • [8] Cai D., 2009, Proceedings of the 26th Annual International Conference on Machine Learning, P105, DOI [10.1145/1553374.1553388, DOI 10.1145/1553374.1553388]
  • [9] Non-negative Matrix Factorization on Manifold
    Cai, Deng
    He, Xiaofei
    Wu, Xiaoyun
    Han, Jiawei
    [J]. ICDM 2008: EIGHTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2008, : 63 - +
  • [10] On reduced rank nonnegative matrix factorization for symmetric nonnegative matrices
    Catral, M
    Han, LX
    Neumann, M
    Plemmons, RJ
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2004, 393 : 107 - 126