Free-steering relaxation methods for problems with strictly convex costs and linear constraints

被引:31
作者
Kiwiel, KC
机构
[1] Systems Research Institute, 01-447 Warsaw
关键词
convex programming; entropy maximization; nondifferentiable optimization; relaxation methods; dual coordinate ascent; B-functions;
D O I
10.1287/moor.22.2.326
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider dual coordinate ascent methods for minimizing a strictly convex (possibly nondifferentiable) function subject to linear constraints. Such methods are useful in large-scale applications (e.g., entropy maximization, quadratic programming, network flow), because they are simply, can exploit sparsity and in certain cases are highly parallelizable. We establish their global convergence under weak conditions and a free-steering order of relaxation. Previous comparable results were restricted to special problems with separable costs and equality constraints. Our convergence framework unifies to a certain extent the approaches of Bregman. Censor and Lent, De Pierro and lusem, and Luo and Tseng, and complements that of Bertsekas and Tseng.
引用
收藏
页码:326 / 349
页数:24
相关论文
共 55 条
[1]  
BAUSCHKE HH, 1996, IN PRESS J CONVEX AN
[2]  
Bertsekas Dimitri P., 1989, PARALLEL DISTRIBUTED
[3]   RELAXATION METHODS FOR NETWORK FLOW PROBLEMS WITH CONVEX ARC COSTS [J].
BERTSEKAS, DP ;
HOSEIN, PA ;
TSENG, P .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1987, 25 (05) :1219-1243
[4]  
Bregman L.M., 1967, USSR Computational Mathematics and Mathematical Physics, V7, P200
[5]   ORDER INDEPENDENCE AND FACTOR CONVERGENCE IN ITERATIVE SCALING [J].
BROWN, JB ;
CHASE, PJ ;
PITTENGER, AO .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1993, 190 :1-38
[6]   OPTIMIZATION OF LOG-X ENTROPY OVER LINEAR EQUALITY CONSTRAINTS [J].
CENSOR, Y ;
LENT, A .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1987, 25 (04) :921-933
[7]   PROXIMAL MINIMIZATION ALGORITHM WITH D-FUNCTIONS [J].
CENSOR, Y ;
ZENIOS, SA .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1992, 73 (03) :451-464
[8]   PARALLEL APPLICATION OF BLOCK-ITERATIVE METHODS IN MEDICAL IMAGING AND RADIATION-THERAPY [J].
CENSOR, Y .
MATHEMATICAL PROGRAMMING, 1988, 42 (02) :307-325
[9]   ON SOME OPTIMIZATION TECHNIQUES IN IMAGE-RECONSTRUCTION FROM PROJECTIONS [J].
CENSOR, Y ;
HERMAN, GT .
APPLIED NUMERICAL MATHEMATICS, 1987, 3 (05) :365-391
[10]   ROW-ACTION METHODS FOR HUGE AND SPARSE SYSTEMS AND THEIR APPLICATIONS [J].
CENSOR, Y .
SIAM REVIEW, 1981, 23 (04) :444-446