Soft clustering using weighted one-class support vector machines

被引:94
作者
Bicego, Manuele [1 ]
Figueiredo, Mario A. T. [2 ]
机构
[1] Univ Sassari, DEIR, I-07100 Sassari, Italy
[2] Inst Super Tecn, Inst Telecomunicacoes, Lisbon, Portugal
关键词
Soft clustering; One-class support vector machines; EM-like algorithms; Kernel methods; Deterministic annealing;
D O I
10.1016/j.patcog.2008.07.004
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes a new soft clustering algorithm in which each cluster is modelled by a one-class support vector machine (OC-SVM). The proposed algorithm extends a previously proposed hard clustering algorithm, also based on OC-SVM representation of clusters. The key building block Of Our method is the weighted OC-SVM (WOC-SVM), a novel tool introduced in this paper, based on which an expectation-maximization-type soft clustering algorithm is defined. A deterministic annealing version of the algorithm is also introduced, and shown to improve the robustness with respect to initialization. Experimental results show that the proposed soft clustering algorithm outperforms its hard clustering counterpart, namely in terms of robustness with respect to initialization, as well as several Other state-of-the-art methods. (C) 2008 Elsevier Ltd. All rights reserved.
引用
收藏
页码:27 / 32
页数:6
相关论文
共 22 条
[1]   Support vector clustering [J].
Ben-Hur, A ;
Horn, D ;
Siegelmann, HT ;
Vapnik, V .
JOURNAL OF MACHINE LEARNING RESEARCH, 2002, 2 (02) :125-137
[2]   A novel kernel method for clustering [J].
Camastra, F ;
Verri, A .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (05) :801-U4
[3]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[4]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[5]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[6]   Unsupervised learning of finite mixture models [J].
Figueiredo, MAT ;
Jain, AK .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :381-396
[7]  
Jain AK., 1988, ALGORITHMS CLUSTERIN
[8]  
Kohonen T., 1997, Self-organizing maps, P448
[9]   An improved cluster labeling method for support vector clustering [J].
Lee, J ;
Lee, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (03) :461-464
[10]   Dynamic characterization of cluster structures for robust and inductive support vector clustering [J].
Lee, Jaewook ;
Lee, Daewon .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (11) :1869-1874