THE GLOBAL CONVERGENCE OF PARTITIONED BFGS ON PROBLEMS WITH CONVEX DECOMPOSITIONS AND LIPSCHITZIAN GRADIENTS

被引:40
作者
GRIEWANK, A
机构
[1] Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, 60439, IL
关键词
GLOBAL CONVERGENCE; R-LINEAR OR R-SUPERLINEAR CONVERGENCE; PARTIAL SEPARABILITY; PARTITIONED UPDATING; UNIFORM CONVEXITY;
D O I
10.1007/BF01594933
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The main purpose of this paper is the extension of Powell's (1976) global convergence result to the partitioned BFGS method introduced by Griewank and Toint (1982). Even in the unpartitioned case the original result is strengthened because the search directions need not be computed exactly and the gradient is only required to be Lipschitzian rather than differentiable. Using the PSI-functional of Byrd and Nocedal (1987) a strong form of R-superlinear convergence is obtained if the element functions are uniformly convex and their gradients are strictly differentiable at the minimizer x* only. In order to deal with the possibility of singular functions we utilize a damping of the BFGS update that becomes inactive if the problem turns out to be regular near x*.
引用
收藏
页码:141 / 175
页数:35
相关论文
共 34 条
[1]  
Abramowitz M., 1964, HDB MATH FUNCTIONS
[2]  
[Anonymous], 1970, IMA J APPL MATH, DOI DOI 10.1093/IMAMAT/6.1.76
[3]  
BRENT RP, 1978, ACM T MATH SOFTWARE, V6, P510
[4]  
Broyden C. G., 1970, Journal of the Institute of Mathematics and Its Applications, V6, P222
[5]   GLOBAL CONVERGENCE OF A CLASS OF QUASI-NEWTON METHODS ON CONVEX PROBLEMS [J].
BYRD, RH ;
NOCEDAL, J ;
YUAN, YX .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1987, 24 (05) :1171-1190
[6]   A TOOL FOR THE ANALYSIS OF QUASI-NEWTON METHODS WITH APPLICATION TO UNCONSTRAINED MINIMIZATION [J].
BYRD, RH ;
NOCEDAL, J .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1989, 26 (03) :727-739
[7]  
Clarke F.H., 1983, OPTIMIZATION NONSMOO
[8]  
GE RP, 1983, MATH PROGRAM, V27, P233
[9]   ON THE ACCURATE DETERMINATION OF SEARCH DIRECTIONS FOR SIMPLE DIFFERENTIABLE PENALTY-FUNCTIONS [J].
GOULD, NIM .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1986, 6 (03) :357-372
[10]   PARTITIONED VARIABLE-METRIC UPDATES FOR LARGE STRUCTURED OPTIMIZATION PROBLEMS [J].
GRIEWANK, A ;
TOINT, PL .
NUMERISCHE MATHEMATIK, 1982, 39 (01) :119-137