Proximity function minimization using multiple Bregman projections, with applications to split feasibility and Kullback-Leibler distance minimization

被引:45
作者
Byrne, C [1 ]
Censor, Y
机构
[1] Univ Massachusetts, Dept Math Sci, Lowell, MA 01854 USA
[2] Univ Haifa, Dept Math, IL-31905 Haifa, Israel
基金
以色列科学基金会; 美国国家卫生研究院;
关键词
Bregman projections; convex feasibility problem; product space; Kullback-Leibler distance; proximity function;
D O I
10.1023/A:1013349430987
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
Problems in signal detection and image recovery can sometimes be formulated as a convex feasibility problem (CFP) of finding a vector in the intersection of a finite family of closed con-vex sets. Algorithms for this purpose typically employ orthogonal or generalized projections onto the individual convex sets. The simultaneous multiprojection algorithm of Censor and Elfving for solving the CFP, in which different generalized projections may be used at the same time, has been shown to converge for the case of nonempty intersection; still open is the question of its convergence when the intersection of the closed convex sets is empty. Motivated by the geometric alternating minimization approach of Csiszar and Tusnady and the product space formulation of Pierra, we derive a new simultaneous multiprojection algorithm that employs generalized projections of Bregman to solve the con-vex feasibility problem or, in the inconsistent case, to minimize a proximity function that measures the average distance from a point to all convex sets. We assume that the Bregman distances involved are jointly convex, so that the proximity function itself is convex. When the intersection of the convex sets is empty, but the closure of the proximity function has a unique global minimizer, the sequence of iterates converges to this unique minimizer. Special cases of this algorithm include the "Expectation Maximization Maximum Likelihood" (EMML) method in emission tomography and a new convergence result for an algorithm that solves the split feasibility problem.
引用
收藏
页码:77 / 98
页数:22
相关论文
共 52 条
[1]   BLOCK-ITERATIVE PROJECTION METHODS FOR PARALLEL COMPUTATION OF SOLUTIONS TO CONVEX FEASIBILITY PROBLEMS [J].
AHARONI, R ;
CENSOR, Y .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1989, 120 :165-180
[2]  
Auslender A, 1976, Optimisation: Methodes numeques
[3]  
Bauschke H. H., 1997, J CONVEX ANAL, V4, P27
[4]   Projection algorithms for solving convex feasibility problems [J].
Bauschke, HH ;
Borwein, JM .
SIAM REVIEW, 1996, 38 (03) :367-426
[5]  
Bregman LM, 1999, J CONVEX ANAL, V6, P319
[6]  
Bregman LM, 1967, USSR Computational Mathematics and Mathematical Physics, V7, P200
[7]   Iterative methods of solving stochastic convex feasibility problems and applications [J].
Butnariu, D ;
Iusem, AN ;
Burachik, RS .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2000, 15 (03) :269-307
[8]   ON THE BEHAVIOR OF A BLOCK-ITERATIVE PROJECTION METHOD FOR SOLVING CONVEX FEASIBILITY PROBLEMS [J].
BUTNARIU, D ;
CENSOR, Y .
INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 1990, 34 (1-2) :79-94
[9]   Iterative averaging of entropic projections for solving stochastic convex feasibility problems [J].
Butnariu, D ;
Censor, Y ;
Reich, S .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 1997, 8 (01) :21-39
[10]   STRONG-CONVERGENCE OF ALMOST SIMULTANEOUS BLOCK-ITERATIVE PROJECTION METHODS IN HILBERT-SPACES [J].
BUTNARIU, D ;
CENSOR, Y .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 1994, 53 (01) :33-42