Alternative Proofs of the Convergence Properties of the Conjugate-Gradient Method

被引:23
作者
McCormick, G. P. [1 ,2 ]
Ritter, K. [3 ]
机构
[1] George Washington Univ, Dept Operat Res, Washington, DC USA
[2] George Washington Univ, Inst Management Sci & Engn, Washington, DC USA
[3] Univ Stuttgart, Math Inst, Stuttgart, Germany
关键词
Conjugate-gradient method; unconstrained minimization; superlinearly convergent algorithms; mathematical programming; quadratically convergent algorithms;
D O I
10.1007/BF00933041
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
For the problem of minimizing an unconstrained function, the conjugate-gradient method is shown to be convergent. If the function is uniformly strictly convex, the ultimate rate of convergence is shown to be n-step superlinear. If the Hessian matrix is Lipschitz continuous, the rate of convergence is shown to be n-step quadratic. All results are obtained for the reset version of the method and with a relaxed requirement on the solution of the stepsize problem. In addition to obtaining sharper results, the paper differs from previously published ones in the mode of proof which contains as a corollary the proof of finiteness of the conjugate-gradient method when applied to a quadratic problem rather than assuming that result.
引用
收藏
页码:497 / 518
页数:22
相关论文
共 16 条
[1]  
[Anonymous], 1971, COMPUTATIONAL METHOD
[2]  
COHEN A, SIAM J NUME IN PRESS
[3]  
CROWDER H, 1971, RC3330 IBM TJ WATS R
[5]  
DANIEL JW, 1970, SIAM J NUMERICAL ANA, V7
[6]  
DIEUDONNEE J, 1960, FDN MODERN ANAL
[7]   FUNCTION MINIMIZATION BY CONJUGATE GRADIENTS [J].
FLETCHER, R ;
REEVES, CM .
COMPUTER JOURNAL, 1964, 7 (02) :149-&
[8]  
HESTENES MR, 1952, 1959 NAT BUR STAND
[9]  
KLESSIG R, 1970, ERLM279 U CAL EL RES
[10]  
MANGASARIAN OL, 1970, COMMUNICATION