A tutorial on spectral clustering

被引:6865
作者
von Luxburg, Ulrike [1 ]
机构
[1] Max Planck Inst Biol Cybernet, D-72076 Tubingen, Germany
关键词
spectral clustering; graph Laplacian;
D O I
10.1007/s11222-007-9033-z
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In recent years, spectral clustering has become one of the most popular modern clustering algorithms. It is simple to implement, can be solved efficiently by standard linear algebra software, and very often outperforms traditional clustering algorithms such as the k-means algorithm. On the first glance spectral clustering appears slightly mysterious, and it is not obvious to see why it works at all and what it really does. The goal of this tutorial is to give some intuition on those questions. We describe different graph Laplacians and their basic properties, present the most common spectral clustering algorithms, and derive those algorithms from scratch by several different approaches. Advantages and disadvantages of the different spectral clustering algorithms are discussed.
引用
收藏
页码:395 / 416
页数:22
相关论文
共 66 条
  • [1] Alavi Y., 1991, Graph theory, combinatorics, and applications, V2, P871
  • [2] Aldous D., REVERSIBLE MARKOV CH
  • [3] [Anonymous], 2005, Advances in Neural Information Processing Systems (NIPS)
  • [4] Bach FR, 2004, ADV NEUR IN, V16, P305
  • [5] Bapat RB, 2003, Z NATURFORSCH A, V58, P494
  • [6] A SPECTRAL ALGORITHM FOR ENVELOPE REDUCTION OF SPARSE MATRICES
    BARNARD, ST
    POTHEN, A
    SIMON, H
    [J]. NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 1995, 2 (04) : 317 - 334
  • [7] Towards a theoretical foundation for Laplacian-based manifold methods
    Belkin, M
    Niyogi, P
    [J]. LEARNING THEORY, PROCEEDINGS, 2005, 3559 : 486 - 500
  • [8] Laplacian eigenmaps for dimensionality reduction and data representation
    Belkin, M
    Niyogi, P
    [J]. NEURAL COMPUTATION, 2003, 15 (06) : 1373 - 1396
  • [9] Belkin M., 2003, THESIS U CHICAGO
  • [10] A sober look at clustering stability
    Ben-David, Shai
    von Luxburg, Ulrike
    Pal, David
    [J]. LEARNING THEORY, PROCEEDINGS, 2006, 4005 : 5 - 19