LOCAL AND SUPERLINEAR CONVERGENCE FOR PARTIALLY KNOWN QUASI-NEWTON METHODS

被引:33
作者
Engels, John R. [1 ]
Martinez, Hector J. [1 ]
机构
[1] Fac Univ Notre Dame Paix, Dept Math, B-5000 Namur, Belgium
关键词
convergence theory; bounded deterioration; superlinear convergence; unconstrained optimization; constrained optimization; least squares; secant methods; quasi-Newton methods;
D O I
10.1137/0801005
中图分类号
O29 [应用数学];
学科分类号
070104 [应用数学];
摘要
This paper develops a unified theory for establishing the local and q-superlinear convergence of quasi-Newton methods from the convex class when part of the Hessian matrix is known. One first proves the bounded deterioration principle due to Dennis (and popularized by Broyden, Dennis, and More) for the appropriate modifications of all update formulas in the convex Broyden class. Using standard conditions on the quasi-Newton updates, one then deduces local and q-superlinear convergence. Particular cases of these methods are the SQP augmented scale BFGS and DFP secant methods for constrained optimization problems introduced by Tapia and a generalization of the Al-Baali and Fletcher modification of the structured secant method considered by Dennis, Gay, and Welsch for the nonlinear least-squares problem. In all cases, bounded deterioration is proved for the approximate Hessian, not for its inverse.
引用
收藏
页码:42 / 56
页数:15
相关论文
共 20 条
[1]
ALBAALI M, 1985, J OPER RES SOC, V36, P405, DOI 10.2307/2582880
[2]
Avriel M, 2003, NONLINEAR PROGRAMMIN
[3]
ESTIMATION OF HESSIAN MATRIX IN NONLINEAR LEAST-SQUARES PROBLEMS WITH NON-ZERO RESIDUALS [J].
BARTHOLOMEWBIGGS, MC .
MATHEMATICAL PROGRAMMING, 1977, 12 (01) :67-80
[4]
Broyden C. G., 1973, Journal of the Institute of Mathematics and Its Applications, V12, P223
[5]
QUASI-NEWTON METHODS AND THEIR APPLICATION TO FUNCTION MINIMISATION [J].
BROYDEN, CG .
MATHEMATICS OF COMPUTATION, 1967, 21 (99) :368-&
[6]
A TRUST REGION ALGORITHM FOR NONLINEARLY CONSTRAINED OPTIMIZATION [J].
BYRD, RH ;
SCHNABEL, RB ;
SHULTZ, GA .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1987, 24 (05) :1152-1170
[7]
Cottle R., 1976, NONL PROGR SIAM AMS
[8]
Dennis J. E., 1971, NONLINEAR FUNCTIONAL
[9]
Dennis J. E., 1983, NUMERICAL METHODS UN
[10]
CONVERGENCE THEOREMS FOR LEAST-CHANGE SECANT UPDATE METHODS [J].
DENNIS, JE ;
WALKER, HF .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1981, 18 (06) :949-987