Interior gradient and proximal methods for convex and conic optimization

被引:169
作者
Auslender, A [1 ]
Teboulle, M
机构
[1] Univ Lyon 1, Dept Math, F-69365 Lyon, France
[2] Tel Aviv Univ, Sch Math Sci, IL-69978 Ramat Aviv, Israel
关键词
convex optimization; interior gradient/subgradient algorithms; proximal distances; conic optimization; convergence and efficiency;
D O I
10.1137/S1052623403427823
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Interior gradient (subgradient) and proximal methods for convex constrained minimization have been much studied, in particular for optimization problems over the nonnegative octant. These methods are using non-Euclidean projections and proximal distance functions to exploit the geometry of the constraints. In this paper, we identify a simple mechanism that allows us to derive global convergence results of the produced iterates as well as improved global rates of convergence estimates for a wide class of such methods, and with more general convex constraints. Our results are illustrated with many applications and examples, including some new explicit and simple algorithms for conic optimization problems. In particular, we derive a class of interior gradient algorithms which exhibits an O(k(-2)) global convergence rate estimate.
引用
收藏
页码:697 / 725
页数:29
相关论文
共 45 条
[1]   Hessian Riemannian gradient flows in convex programming [J].
Alvarez, F ;
Bolte, J ;
Brahic, O .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2004, 43 (02) :477-501
[2]   Regularized Lotka-Volterra dynamical system as continuous proximal-like method in optimization [J].
Attouch, H ;
Teboulle, M .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2004, 121 (03) :541-570
[3]   A logarithmic-quadratic proximal method for variational inequalities [J].
Auslender, A ;
Teboulle, M ;
Ben-Tiba, S .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1999, 12 (1-3) :31-40
[4]   Interior proximal and multiplier methods based on second order homogeneous kernels [J].
Auslender, A ;
Teboulle, M ;
Ben-Tiba, S .
MATHEMATICS OF OPERATIONS RESEARCH, 1999, 24 (03) :645-668
[5]   Interior gradient and epsilon-subgradient descent methods for constrained convex minimization [J].
Auslender, A ;
Teboulle, M .
MATHEMATICS OF OPERATIONS RESEARCH, 2004, 29 (01) :1-26
[6]   An interior-proximal method for convex linearly constrained problems and its extension to variational inequalities [J].
Auslender, A ;
Haddou, M .
MATHEMATICAL PROGRAMMING, 1995, 71 (01) :77-100
[7]  
Auslender A., 2003, SPRINGER MONOGRAPHS
[8]   Mirror descent and nonlinear projected subgradient methods for convex optimization [J].
Beck, A ;
Teboulle, M .
OPERATIONS RESEARCH LETTERS, 2003, 31 (03) :167-175
[9]   The ordered subsets mirror descent optimization method with applications to tomography [J].
Ben-Tal, A ;
Margalit, T ;
Nemirovski, A .
SIAM JOURNAL ON OPTIMIZATION, 2001, 12 (01) :79-108
[10]   Penalty/barrier multiplier methods for convex programming problems [J].
BenTal, A ;
Zibulevsky, M .
SIAM JOURNAL ON OPTIMIZATION, 1997, 7 (02) :347-366