A LEAST BIASED FUZZY CLUSTERING METHOD

被引:54
作者
BENI, G
LIU, XM
机构
[1] College of Engineering, University of California, Riverside, Riverside
关键词
CLUSTERING; FUZZY CLUSTERING; MAXIMUM ENTROPY PRINCIPLE; CLUSTER VALIDITY;
D O I
10.1109/34.310694
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new operational definition of cluster is proposed, and a fuzzy clustering algorithm with minimal biases is formulated by making use of the Maximum Entropy Principle to maximize the entropy of the centroids with respect to the data points (clustering entropy). We make no assumptions on the number of clusters or their initial positions. For each value of an adimensional scale parameter beta', the clustering algorithm makes each data point iterate towards one of the cluster's centroids, so that both hard and fuzzy partitions are obtained. Since the clustering algorithm can make a multiscale analysis of the given data set we can obtain both hierarchy and partitioning type clustering. The relative stability with respect to beta' of each cluster structure is defined as the measurement of cluster validity. We determine the specific value of beta' which corresponds to the optimal positions of cluster centroids by minimizing the entropy of the data points with respect to the centroids (clustered entropy). Examples are given to show how this least-biased method succeeds in getting perceptually correct clustering results.
引用
收藏
页码:954 / 960
页数:7
相关论文
共 16 条
  • [1] [Anonymous], 1988, ALGORITHM CLUSTERING
  • [2] BALL GH, 1965, AD699616
  • [3] BENI G, UNPUB EFFICIENCY COM
  • [4] Bezdek J.C., 1973, THESIS CORNELL U ITH
  • [5] CLUSTERING TECHNIQUES - USERS DILEMMA
    DUBES, R
    JAIN, AK
    [J]. PATTERN RECOGNITION, 1976, 8 (04) : 247 - 260
  • [6] DUDA RO, 1974, PATTERN CLASSIFICATI
  • [7] Everitt B., 1974, CLUSTER ANAL
  • [8] The use of multiple measurements in taxonomic problems
    Fisher, RA
    [J]. ANNALS OF EUGENICS, 1936, 7 : 179 - 188
  • [9] GATH I, 1989, IEEE T PATTERN ANAL, V6, P721
  • [10] STOCHASTIC RELAXATION, GIBBS DISTRIBUTIONS, AND THE BAYESIAN RESTORATION OF IMAGES
    GEMAN, S
    GEMAN, D
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1984, 6 (06) : 721 - 741