Superlinear convergence and implicit filtering

被引:54
作者
Choi, TD
Kelley, CT
机构
[1] Intelligent Informat Syst, Durham, NC 27713 USA
[2] N Carolina State Univ, Dept Math, Raleigh, NC 27695 USA
[3] N Carolina State Univ, Ctr Res Sci Computat, Raleigh, NC 27695 USA
关键词
noisy optimization; implicit filtering; BFGS algorithm; superlinear convergence;
D O I
10.1137/S1052623499354096
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper we show how the implicit filtering algorithm can be coupled with the BFGS quasi-Newton update to obtain a superlinearly convergent iteration if the noise in the objective function decays sufficiently rapidly as the optimal point is approached. In this way we give insight into the observations of good performance in practice of quasi-Newton methods when they are coupled with implicit filtering. We also report on numerical experiments that show how an implementation of implicit filtering that exploits these new results can improve the performance of the algorithm.
引用
收藏
页码:1149 / 1162
页数:14
相关论文
共 50 条
[41]  
PERNAMBUCOWISE P, 1996, IEEE T MAGN, V4, P2458
[42]   The MATLAB ODE suite [J].
Shampine, LF ;
Reichelt, MW .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1997, 18 (01) :1-22
[43]   CONDITIONING OF QUASI-NEWTON METHODS FOR FUNCTION MINIMIZATION [J].
SHANNO, DF .
MATHEMATICS OF COMPUTATION, 1970, 24 (111) :647-&
[44]  
STONEKING DE, 1991, PROCEEDINGS : IEEE / CORNELL CONFERENCE ON ADVANCED CONCEPTS IN HIGH SPEED SEMICONDUCTOR DEVICES AND CIRCUITS, P374, DOI 10.1109/CORNEL.1991.170007
[45]   YIELD OPTIMIZATION USING A GAAS PROCESS SIMULATOR COUPLED TO A PHYSICAL DEVICE MODEL [J].
STONEKING, DE ;
BILBRO, GL ;
GILMORE, PA ;
TREW, RJ ;
KELLEY, CT .
IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 1992, 40 (07) :1353-1363
[46]   ON THE CONVERGENCE OF THE MULTIDIRECTIONAL SEARCH ALGORITHM [J].
Torczon, Virginia .
SIAM JOURNAL ON OPTIMIZATION, 1991, 1 (01) :123-145
[47]  
Walker H. F., 1984, MATH PROGRAM STUD, P70
[48]  
WINSLOW TA, 1991, PROCEEDINGS : IEEE / CORNELL CONFERENCE ON ADVANCED CONCEPTS IN HIGH SPEED SEMICONDUCTOR DEVICES AND CIRCUITS, P393, DOI 10.1109/CORNEL.1991.170009
[49]  
WINSLOW TA, 1991, PROCEEDINGS : IEEE / CORNELL CONFERENCE ON ADVANCED CONCEPTS IN HIGH SPEED SEMICONDUCTOR DEVICES AND CIRCUITS, P188, DOI 10.1109/CORNEL.1991.170048
[50]   ON THE GLOBAL OPTIMIZATION PROPERTIES OF FINITE-DIFFERENCE LOCAL DESCENT ALGORITHMS [J].
ZAVRIEV, SK .
JOURNAL OF GLOBAL OPTIMIZATION, 1993, 3 (01) :67-78