A class of nonmonotone conjugate gradient methods for unconstrained optimization

被引:57
作者
Liu, GH [1 ]
Jing, LL
Han, LX
Han, D
机构
[1] Northwestern Univ, Dept Ind Engn & Management Sci, Evanston, IL 60208 USA
[2] Beijing Forestry Univ, Coll Econ & Management, Beijing, Peoples R China
[3] Univ Connecticut, Dept Math, Storrs, CT USA
[4] CUNY City Coll, Dept Comp Sci, New York, NY 10031 USA
关键词
nonmonotone conjugate gradient method; nonmonotone line search; global convergence; unconstrained optimization;
D O I
10.1023/A:1021723128049
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 [运筹学与控制论]; 12 [管理学]; 1201 [管理科学与工程]; 1202 [工商管理学]; 120202 [企业管理];
摘要
In this paper, we introduce a class of nonmonotone conjugate gradient methods, which include the well-known Polak-Ribiere method and Hestenes-Stiefel method as special cases. This class of nonmonotone conjugate gradient methods is proved to be globally convergent when it is applied to solve unconstrained optimization problems with convex objective functions. Numerical experiments show that the nonmonotone Polak-Ribiere method and Hestenes-Stiefel method in this nonmonotone conjugate gradient class are competitive vis-g-vis their monotone counterparts.
引用
收藏
页码:127 / 140
页数:14
相关论文
共 14 条
[1]
DESCENT PROPERTY AND GLOBAL CONVERGENCE OF THE FLETCHER REEVES METHOD WITH INEXACT LINE SEARCH [J].
ALBAALI, M .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1985, 5 (01) :121-124
[2]
FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS [J].
FLETCHER, R ;
REEVES, CM .
COMPUTER JOURNAL, 1964, 7 (02) :149-&
[3]
GLOBAL CONVERGENCE PROPERTIES OF CONJUGATE GRADIENT METHODS FOR OPTIMIZATION [J].
Gilbert, Jean Charles ;
Nocedal, Jorge .
SIAM JOURNAL ON OPTIMIZATION, 1992, 2 (01) :21-42
[4]
A NONMONOTONE LINE SEARCH TECHNIQUE FOR NEWTON METHOD [J].
GRIPPO, L ;
LAMPARIELLO, F ;
LUCIDI, S .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1986, 23 (04) :707-716
[5]
Jorge N., 1992, Acta Numer., V1, P199
[6]
Liu G., 1995, Optimization, V34, P147, DOI 10.1080/02331939508844101
[7]
LUCIDI S, 1995, LECT NOTES CONTROL I
[8]
POLAK E, 1969, REV FR INFORM RECH O, V3, P35
[9]
RESTART PROCEDURES FOR CONJUGATE GRADIENT METHOD [J].
POWELL, MJD .
MATHEMATICAL PROGRAMMING, 1977, 12 (02) :241-254
[10]
POWELL MJD, 1984, LECT NOTES MATH, V1066, P122