BENCHMARKING DERIVATIVE-FREE OPTIMIZATION ALGORITHMS

被引:407
作者
More, Jorge J. [1 ]
Wild, Stefan M. [1 ]
机构
[1] Argonne Natl Lab, Div Math & Comp Sci, Argonne, IL 60439 USA
关键词
derivative-free optimization; benchmarking; performance evaluation; deterministic simulations; computational budget; PARALLEL PATTERN SEARCH;
D O I
10.1137/080724083
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We propose data profiles as a tool for analyzing the performance of derivative-free optimization solvers when there are constraints on the computational budget. We use performance and data profiles, together with a convergence test that measures the decrease in function value, to analyze the performance of three solvers on sets of smooth, noisy, and piecewise-smooth problems. Our results provide estimates for the performance difference between these solvers, and show that on these problems, the model-based solver tested performs better than the two direct search solvers tested.
引用
收藏
页码:172 / 191
页数:20
相关论文
共 22 条
[1]   A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems [J].
Ali, MM ;
Khompatraporn, C ;
Zabinsky, ZB .
JOURNAL OF GLOBAL OPTIMIZATION, 2005, 31 (04) :635-672
[2]   Analysis of generalized pattern searches [J].
Audet, C ;
Dennis, JE .
SIAM JOURNAL ON OPTIMIZATION, 2003, 13 (03) :889-903
[3]  
Conn AndrewR., 1998, Proceedings of 7th aiaa/usaf/nasa/issmo symposium on multidisciplinary analysis and optimization, st. louis, V48, P3
[4]   Using sampling and simplex derivatives in pattern search methods [J].
Custodio, A. L. ;
Vicente, L. N. .
SIAM JOURNAL ON OPTIMIZATION, 2007, 18 (02) :537-555
[5]   Benchmarking optimization software with performance profiles [J].
Dolan, ED ;
Moré, JJ .
MATHEMATICAL PROGRAMMING, 2002, 91 (02) :201-213
[6]   A GRID ALGORITHM FOR BOUND CONSTRAINED OPTIMIZATION OF NOISY FUNCTIONS [J].
ELSTER, C ;
NEUMAIER, A .
IMA JOURNAL OF NUMERICAL ANALYSIS, 1995, 15 (04) :585-608
[7]   Comparison of derivative-free optimization methods for groundwater supply and hydraulic capture community problems [J].
Fowler, K. R. ;
Reese, J. P. ;
Kees, C. E. ;
Dennis, J. E., Jr. ;
Kelley, C. T. ;
Miller, C. T. ;
Audet, C. ;
Booker, A. J. ;
Couture, G. ;
Darwin, R. W. ;
Farthing, M. W. ;
Finkel, D. E. ;
Gablonsky, J. M. ;
Gray, G. ;
Kolda, T. G. .
ADVANCES IN WATER RESOURCES, 2008, 31 (05) :743-757
[8]   AN IMPLICIT FILTERING ALGORITHM FOR OPTIMIZATION OF FUNCTIONS WITH MANY LOCAL MINIMA [J].
GILMORE, P ;
KELLEY, CT .
SIAM JOURNAL ON OPTIMIZATION, 1995, 5 (02) :269-285
[9]   CUTEr and SifDec: a constrained and unconstrained testing environment, revisited [J].
Gould, NIM ;
Orban, D ;
Toint, PL .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2003, 29 (04) :373-394
[10]   Optimizing an empirical scoring function for transmembrane protein structure determination [J].
Gray, GA ;
Kolda, TG ;
Sale, K ;
Young, MM .
INFORMS JOURNAL ON COMPUTING, 2004, 16 (04) :406-418