Hessian Riemannian gradient flows in convex programming

被引:72
作者
Alvarez, F
Bolte, J
Brahic, O
机构
[1] Univ Chile, Dept Ingn Matemat, Santiago, Chile
[2] Univ Chile, Ctr Modelamiento Matemat, CNRS, UMR 2071, Santiago, Chile
[3] Univ Montpellier 2, Dept Math, ACSIOM, CNRS,FRE 2311, F-34095 Montpellier 5, France
[4] Univ Montpellier 2, Dept Math, GTA, CNRS,UMR 5030, F-34095 Montpellier, France
关键词
gradient flow; Hessian Riemannian metric; Legendre-type convex function; existence; global convergence; Bregman distance; Lyapunov functional; quasi-convex minimization; convex and linear programming; Legendre transform coordinates; Lagrange and Hamilton equations;
D O I
10.1137/S0363012902419977
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In view of solving theoretically constrained minimization problems, we investigate the properties of the gradient flows with respect to Hessian Riemannian metrics induced by Legendre functions. The first result characterizes Hessian Riemannian structures on convex sets as metrics that have a specific integration property with respect to variational inequalities, giving a new motivation for the introduction of Bregman-type distances. Then, the general evolution problem is introduced, and global convergence is established under quasi-convexity conditions, with interesting refinements in the case of convex minimization. Some explicit examples of these gradient flows are discussed. Dual trajectories are identified, and sufficient conditions for dual convergence are examined for a convex program with positivity and equality constraints. Some convergence rate results are established. In the case of a linear objective function, several optimality characterizations of the orbits are given: optimal path of viscosity methods, continuous-time model of Bregman-type proximal algorithms, geodesics for some adequate metrics, and projections of. (q) over dot-trajectories of some Lagrange equations and completely integrable Hamiltonian systems.
引用
收藏
页码:477 / 501
页数:25
相关论文
共 43 条
[1]  
Akin E., 1979, LECT NOTES BIOMATH, V31
[2]  
[Anonymous], 1992, RIEMANNIAN GEOMETRY
[3]  
[Anonymous], 1998, Evol. Games Popul. Dyn., DOI DOI 10.1017/CBO9781139173179
[4]  
[Anonymous], 1994, MATH ITS APPL
[5]   Viscosity solutions of minimization problems [J].
Attouch, H .
SIAM JOURNAL ON OPTIMIZATION, 1996, 6 (03) :769-806
[6]  
ATTOUCH H, IN PRESS J OPTIM THE
[7]   Asymptotic analysis for penalty and barrier methods in convex and linear programming [J].
Auslender, A ;
Cominetti, R ;
Haddou, M .
MATHEMATICS OF OPERATIONS RESEARCH, 1997, 22 (01) :43-62
[8]   Bregman monotone optimization algorithms [J].
Bauschke, HH ;
Borwein, JM ;
Combettes, PL .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2003, 42 (02) :596-636
[9]   THE NONLINEAR GEOMETRY OF LINEAR-PROGRAMMING .2. LEGENDRE TRANSFORM COORDINATES AND CENTRAL TRAJECTORIES [J].
BAYER, DA ;
LAGARIAS, JC .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1989, 314 (02) :527-581
[10]   THE NONLINEAR GEOMETRY OF LINEAR-PROGRAMMING .1. AFFINE AND PROJECTIVE SCALING TRAJECTORIES [J].
BAYER, DA ;
LAGARIAS, JC .
TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1989, 314 (02) :499-526