A derivative-free line search and DFP method for symmetric equations with global and superlinear convergence

被引:8
作者
Li, DH
Fukushima, M
机构
[1] Hunan Univ, Dept Appl Math, Changsha 410082, Peoples R China
[2] Kyoto Univ, Grad Sch Informat, Dept Appl Math & Phys, Kyoto 6068501, Japan
关键词
symmetric equations; DFP method; global convergence; superlinear convergence;
D O I
10.1080/01630569908816881
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper is concerned with the open problem as to whether DFP method with inexact line search converges globally to the minimum of a uniformly convex function. We study this problem by way of a Gauss-Newton approach rather than an ordinary Newton approach. We also propose a derivative-free line search that can be implemented conveniently by a backtracking process and has such an attractive property that any iterative method with this line search generates a sequence of iterates that is approximately norm descent. Moreover, if the Jacobian matrices are uniformly nonsingular, then the generated sequence converges. Under appropriate conditions, we establish global and superlinear convergence of the proposed Gauss-Newton based DFP method, which supports the open problem positively.
引用
收藏
页码:59 / 77
页数:19
相关论文
共 19 条
[1]  
Broyden C. G., 1973, Journal of the Institute of Mathematics and Its Applications, V12, P223
[2]   GLOBAL CONVERGENCE OF A CLASS OF QUASI-NEWTON METHODS ON CONVEX PROBLEMS [J].
BYRD, RH ;
NOCEDAL, J ;
YUAN, YX .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1987, 24 (05) :1171-1190
[3]   A TOOL FOR THE ANALYSIS OF QUASI-NEWTON METHODS WITH APPLICATION TO UNCONSTRAINED MINIMIZATION [J].
BYRD, RH ;
NOCEDAL, J .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1989, 26 (03) :727-739
[4]   QUASI-NEWTON METHODS, MOTIVATION AND THEORY [J].
DENNIS, JE ;
MORE, JJ .
SIAM REVIEW, 1977, 19 (01) :46-89
[5]  
DENNIS JE, 1974, MATH COMPUT, V28, P549, DOI 10.1090/S0025-5718-1974-0343581-1
[6]  
Dixon L.C.W., 1972, J OPTIMIZ THEORY APP, V10, P34, DOI 10.1007/bf00934961
[7]  
FLETCHER R, 1994, NATO ADV SCI INST SE, V434, P109
[8]  
Fletcher Roger., 1987, PRACTICAL METHODS OP, DOI [DOI 10.1002/9781118723203, 10.1002/9781118723203]
[9]   THE GLOBAL CONVERGENCE OF PARTITIONED BFGS ON PROBLEMS WITH CONVEX DECOMPOSITIONS AND LIPSCHITZIAN GRADIENTS [J].
GRIEWANK, A .
MATHEMATICAL PROGRAMMING, 1991, 50 (02) :141-175
[10]   LOCAL CONVERGENCE ANALYSIS FOR PARTITIONED QUASI-NEWTON UPDATES [J].
GRIEWANK, A ;
TOINT, PL .
NUMERISCHE MATHEMATIK, 1982, 39 (03) :429-448