Clustering via minimum volume ellipsoids

被引:11
作者
Shioda, Romy [1 ]
Tuncel, Levent [1 ]
机构
[1] Univ Waterloo, Fac Math, Dept Combinator & Optimizat, Waterloo, ON N2L 3G1, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
semidefinite optimization; mixed integer programming; clustering; inscribing ellipsoids; interior-point methods; learning theory;
D O I
10.1007/s10589-007-9024-1
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We propose minimum volume ellipsoids (MVE) clustering as an alternative clustering technique to k-means for data clusters with ellipsoidal shapes and explore its value and practicality. MVE clustering allocates data points into clusters in a way that minimizes the geometric mean of the volumes of each cluster's covering ellipsoids. Motivations for this approach include its scale-invariance, its ability to handle asymmetric and unequal clusters, and our ability to formulate it as a mixed-integer semidefinite programming problem that can be solved to global optimality. We present some preliminary empirical results that illustrate MVE clustering as an appropriate method for clustering data from mixtures of "ellipsoidal" distributions and compare its performance with the k-means clustering algorithm as well as the MCLUST algorithm (which is based on a maximum likelihood EM algorithm) available in the statistical package R.
引用
收藏
页码:247 / 295
页数:49
相关论文
共 18 条
[1]  
[Anonymous], 1987, ROBUST REGRESSION OU
[2]   AN ALGORITHM FOR SEPARATING PATTERNS BY ELLIPSOIDS [J].
BARNES, ER .
IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 1982, 26 (06) :759-764
[3]  
BURKARDT J, RANDOM DATA
[4]  
DUNAGAN J, 2001, ACM S THEOR COMP, P627
[5]  
FRALEY C, 2002, 415R U WASH DEP STAT
[6]  
John F., 2014, STUDIEESSAYPRESE, P197
[7]   ON THE COMPLEXITY OF APPROXIMATING THE MAXIMAL INSCRIBED ELLIPSOID FOR A POLYTOPE [J].
KHACHIYAN, LG ;
TODD, MJ .
MATHEMATICAL PROGRAMMING, 1993, 61 (02) :137-159
[8]   Rounding of polytopes in the real number model of computation [J].
Khachiyan, LG .
MATHEMATICS OF OPERATIONS RESEARCH, 1996, 21 (02) :307-320
[9]  
KUMAR O, 2007, UNPUB SCALE INVARIAN
[10]   Minimum-volume enclosing ellipsoids and core sets [J].
Kumar, P ;
Yildirim, EA .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2005, 126 (01) :1-21