An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its k-Winners-Take-All Application

被引:152
作者
Hu, Xiaolin [1 ,2 ]
Wang, Jun [3 ]
机构
[1] Tsinghua Univ, TNList, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
[3] Chinese Univ Hong Kong, Dept Mech & Automat Engn, Shatin, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2008年 / 19卷 / 12期
基金
中国国家自然科学基金;
关键词
Global asymptotic stability; k-winners-take-all (k-WTA); optimization; quadratic programming (QP); recurrent neural network;
D O I
10.1109/TNN.2008.2003287
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel recurrent neural network for solving a class of convex quadratic programming (QP) problems, in which the quadratic term in the objective function is the square of the Euclidean norm of the variable. This special structure leads to a set of simple optimality conditions for the problem, based on which the neural network model is formulated. Compared with existing neural networks for general convex QP, the new model is simpler in structure and easier to implement. The new model can be regarded as an improved version of the dual neural network in the literature. Based on the new model, a simple neural network capable of solving the k-winners-take-all (k-WTA) problem is formulated. The stability and global convergence of the proposed neural network is proved rigorously and substantiated by simulation results.
引用
收藏
页码:2022 / 2031
页数:10
相关论文
共 36 条
[1]  
Auslender A, 1976, Optimisation: Methodes numeques
[2]  
Bazaraa M.S., 1993, NONLINEAR PROGRAMMIN
[3]   Another K-winners-take-all analog neural network [J].
Calvert, BD ;
Marinov, CA .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (04) :829-838
[4]   CIRCUIT IMPLEMENTATION OF A PEAK DETECTOR NEURAL-NETWORK [J].
DEMPSEY, GL ;
MCVEY, ES .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 1993, 40 (09) :585-591
[5]   Vision for mobile robot navigation: A survey [J].
DeSouza, GN ;
Kak, AC .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (02) :237-267
[6]   Generalized neural network, for nonsmooth nonlinear programming problems [J].
Forti, M ;
Nistri, P ;
Quincampoix, M .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2004, 51 (09) :1741-1754
[7]   NEW CONDITIONS FOR GLOBAL STABILITY OF NEURAL NETWORKS WITH APPLICATION TO LINEAR AND QUADRATIC-PROGRAMMING PROBLEMS [J].
FORTI, M ;
TESI, A .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1995, 42 (07) :354-366
[8]   A novel neural network for nonlinear convex programming [J].
Gao, XB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (03) :613-621
[9]  
Ham F.M., 2001, PRINCIPLES NEUROCOMP
[10]   FINITE-DIMENSIONAL VARIATIONAL INEQUALITY AND NONLINEAR COMPLEMENTARITY-PROBLEMS - A SURVEY OF THEORY, ALGORITHMS AND APPLICATIONS [J].
HARKER, PT ;
PANG, JS .
MATHEMATICAL PROGRAMMING, 1990, 48 (02) :161-220