Convergence properties of an augmented Lagrangian algorithm for optimization with a combination of general equality and linear constraints

被引:75
作者
Conn, AR
Gould, N
Sartenaer, A
Toint, PL
机构
[1] RUTHERFORD APPLETON LAB,CHILTON,OXON,ENGLAND
[2] FAC UNIV NOTRE DAME PAIX,DEPT MATH,B-5000 NAMUR,BELGIUM
关键词
constrained optimization; augmented Lagrangian methods; linear constraints; convergence theory;
D O I
10.1137/S1052623493251463
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the global and local convergence properties of a class of augmented Lagrangian methods for solving nonlinear programming problems. In these methods, linear and more general constraints are handled in different ways. The general constraints are combined with the objective function in an augmented Lagrangian. The iteration consists of solving a sequence of subproblems; in each subproblem the augmented Lagrangian is approximately minimized in the region defined by the linear: constraints. A subproblem is terminated as soon as a stopping condition is satisfied, The stopping rules that we consider here encompass practical tests used in several existing packages for linearly constrained optimization. Our algorithm also allows different penalty parameters to be associated with disjoint subsets of the general constraints. In this paper, we analyze the convergence of the sequence of iterates generated bg such an algorithm and prove global and fast linear convergence as well as show that potentially troublesome penalty parameters remain bounded away from zero.
引用
收藏
页码:674 / 703
页数:30
相关论文
共 25 条
[1]  
ARIOLI M, 1993, TRPA9334 CERFACS
[2]  
Avriel M., 2003, NONLINEAR PROGRAMMIN
[3]  
Bertsekas D. P., 2019, Reinforcement learning and optimal control
[4]   CONVERGENCE PROPERTIES OF TRUST REGION METHODS FOR LINEAR AND CONVEX CONSTRAINTS [J].
BURKE, JV ;
MORE, JJ ;
TORALDO, G .
MATHEMATICAL PROGRAMMING, 1990, 47 (03) :305-336
[5]   GLOBAL CONVERGENCE OF A CLASS OF TRUST REGION ALGORITHMS FOR OPTIMIZATION USING INEXACT PROJECTIONS ON CONVEX CONSTRAINTS [J].
Conn, A. R. ;
Gould, Nick ;
Sartenaer, A. ;
Toint, Ph. L. .
SIAM JOURNAL ON OPTIMIZATION, 1993, 3 (01) :164-221
[6]   A GLOBALLY CONVERGENT AUGMENTED LAGRANGIAN ALGORITHM FOR OPTIMIZATION WITH GENERAL CONSTRAINTS AND SIMPLE BOUNDS [J].
CONN, AR ;
GOULD, NIM ;
TOINT, PL .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1991, 28 (02) :545-572
[7]  
CONN AR, 1992, P 14 BIENN NUM AN C, P49
[8]  
CONN AR, 1993, 9320 FUNDP DEP MATH
[9]  
CONN AR, 1992, SPRINGER SER COMPUT, V17
[10]  
CONN AR, 1993, 9301 FUNDP DEP MATH