Arbitrary-norm separating plane

被引:114
作者
Mangasarian, OL [1 ]
机构
[1] Univ Wisconsin, Dept Comp Sci, Madison, WI 53706 USA
基金
美国国家科学基金会;
关键词
Separating plane; p-norm separation; p-norm projection;
D O I
10.1016/S0167-6377(98)00049-2
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
A plane separating two point sets in n-dimensional real space is constructed such that it minimizes the sum of arbitrary-norm distances of misclassified points to the plane. In contrast to previous approaches that used surrogates for distance-minimization, the present work is based on a precise norm-dependent explicit closed form for the projection of a point on a plane. This projection is used to formulate the separating-plane problem as a minimization of a convex function on a unit sphere in a norm dual to that of the arbitrary norm used. For the l-norm, the problem can be solved in polynomial time by solving 2n linear programs or by solving a bilinear program. For a general p-norm, the minimization problem can be transformed via an exact penalty formulation to minimizing the sum of a convex function and a bilinear function on a convex set. For the one and infinity norms, a finite successive linearization algorithm can be used for solving the exact penalty formulation. (C) 1999 Elsevier Science B.V. All rights reserved.
引用
收藏
页码:15 / 23
页数:9
相关论文
共 25 条
  • [1] Beckenbach E. F., 2012, Inequalities, V30
  • [2] Bennett K. P., 1993, Computational Optimization and Applications, V2, P207, DOI 10.1007/BF01299449
  • [3] BENNETT KP, 1992, OPTIMIZATION METHODS, V1, P23, DOI DOI 10.1080/10556789208805504
  • [4] Bradley PS, 1997, ADV NEUR IN, V9, P368
  • [5] Solving linear inequalities in a least squares sense
    Bramley, R
    Winnicka, B
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1996, 17 (01) : 275 - 286
  • [6] CHARNES A, 1964, COMPUTER INFORMATION, P67
  • [7] Frank M., 1956, NAV RES LOG, V3, P95, DOI 10.1002/nav.3800030109
  • [8] IMPROVED LINEAR-PROGRAMMING MODELS FOR DISCRIMINANT-ANALYSIS
    GLOVER, F
    [J]. DECISION SCIENCES, 1990, 21 (04) : 771 - 785
  • [9] MATHEMATICAL PROGRAMMING METHODS OF PATTERN CLASSIFICATION
    GRINOLD, RC
    [J]. MANAGEMENT SCIENCE SERIES A-THEORY, 1972, 19 (03): : 272 - 289
  • [10] Hertz J., 1991, Introduction to the Theory of Neural Computation