On the solution of equality constrained quadratic programming problems arising in optimization

被引:180
作者
Gould, NIM [1 ]
Hribar, ME
Nocedal, J
机构
[1] Rutherford Appleton Lab, Computat Sci & Engn Dept, Chilton OX11 0QX, Oxon, England
[2] Cray Inc, Seattle, WA 98104 USA
[3] Northwestern Univ, ECE Dept, Evanston, IL 60208 USA
关键词
nonlinear optimization; conjugate gradient method; quadratic programming; preconditioning; iterative refinement;
D O I
10.1137/S1064827598345667
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider the application of the conjugate gradient method to the solution of large equality constrained quadratic programs arising in nonlinear optimization. Our approach is based implicitly on a reduced linear system and generates iterates in the null space of the constraints. Instead of computing a basis for this null space, we choose to work directly with the matrix of constraint gradients, computing projections into the null space by either a normal equations or an augmented system approach. Unfortunately, in practice such projections can result in significant rounding errors. We propose iterative refinement techniques, as well as an adaptive reformulation of the quadratic problem, that can greatly reduce these errors without incurring high computational overheads. Numerical results illustrating the efficacy of the proposed approaches are presented.
引用
收藏
页码:1375 / 1394
页数:20
相关论文
共 48 条
[1]   SOLVING SPARSE LINEAR-SYSTEMS WITH SPARSE BACKWARD ERROR [J].
ARIOLI, M ;
DEMMEL, JW ;
DUFF, IS .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1989, 10 (02) :165-190
[2]   ON THE AUGMENTED SYSTEM APPROACH TO SPARSE LEAST-SQUARES PROBLEMS [J].
ARIOLI, M ;
DUFF, IS ;
DERIJK, PPM .
NUMERISCHE MATHEMATIK, 1989, 55 (06) :667-684
[3]  
Axelsson O., 1996, Iterative solution methods
[4]  
Bjorck, 1996, NUMERICAL METHODS LE, V5, P497, DOI DOI 10.1137/1.9781611971484
[5]  
BJORCK A, 1992, PITMAN RES, V260, P1
[6]   CUTE - CONSTRAINED AND UNCONSTRAINED TESTING ENVIRONMENT [J].
BONGARTZ, I ;
CONN, AR ;
GOULD, N ;
TOINT, PL .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1995, 21 (01) :123-160
[7]  
BUNCH JR, 1977, MATH COMPUT, V31, P163, DOI 10.1090/S0025-5718-1977-0428694-0
[8]  
Businger P., 1965, NUMER MATH, V7, P269, DOI DOI 10.1007/BF01436084
[9]   An interior point algorithm for large-scale nonlinear programming [J].
Byrd, RH ;
Hribar, ME ;
Nocedal, J .
SIAM JOURNAL ON OPTIMIZATION, 1999, 9 (04) :877-900
[10]   THE NULL SPACE PROBLEM .1. COMPLEXITY [J].
COLEMAN, TF ;
POTHEN, A .
SIAM JOURNAL ON ALGEBRAIC AND DISCRETE METHODS, 1986, 7 (04) :527-537