PARTIALLY-FINITE PROGRAMMING IN L-1 AND THE EXISTENCE OF MAXIMUM ENTROPY ESTIMATES

被引:63
作者
Borwein, J. M. [1 ]
Lewis, A. S. [1 ]
机构
[1] Univ Waterloo, Dept Combinator & Optimizat, Waterloo, ON N2L 3G1, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
convex analysis; duality; existence; generalized solution; image reconstruction; maximum entropy method; moment problem; partially finite program; spectral estimation;
D O I
10.1137/0803012
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Best entropy estimation is a technique that has been widely applied in many areas of science. It consists of estimating an unknown density from some of its moments by maximizing some measure of the entropy of the estimate. This problem can be modelled as a partially-finite convex program, with an integrable function as the variable. A complete duality and existence theory is developed for this problem and for an associated extended problem which allows singular, measure-theoretic solutions. This theory explains the appearance of singular components observed in the literature when the Burg entropy is used. It also provides a unified treatment of existence conditions when the Burg, Boltzmann-Shannon, or some other entropy is used as the objective. Some examples are discussed.
引用
收藏
页码:248 / 267
页数:20
相关论文
共 55 条
  • [1] Aubin J.-P., 2009, SET-VALUED ANAL, DOI 10.1007/978-0-8176-4848-0
  • [2] A DUAL APPROACH TO MULTIDIMENSIONAL LP SPECTRAL ESTIMATION PROBLEMS
    BENTAL, A
    BORWEIN, JM
    TEBOULLE, M
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1988, 26 (04) : 985 - 996
  • [3] BIDAUT M. F., 1975, CR ACAD SCI A MATH, VA-28, P273
  • [4] CONVERGENCE OF BEST ENTROPY ESTIMATES
    Borwein, J. M.
    Lewis, A. S.
    [J]. SIAM JOURNAL ON OPTIMIZATION, 1991, 1 (02) : 191 - 205
  • [5] BORWEIN J. M., 1991, 9105 CORR U WAT DEP
  • [6] A SIMPLE CONSTRAINT QUALIFICATION IN INFINITE DIMENSIONAL PROGRAMMING
    BORWEIN, JM
    WOLKOWICZ, H
    [J]. MATHEMATICAL PROGRAMMING, 1986, 35 (01) : 83 - 96
  • [7] ON THE CONVERGENCE OF MOMENT PROBLEMS
    BORWEIN, JM
    LEWIS, AS
    [J]. TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1991, 325 (01) : 249 - 271
  • [8] PARTIALLY FINITE CONVEX-PROGRAMMING .1. QUASI RELATIVE INTERIORS AND DUALITY-THEORY
    BORWEIN, JM
    LEWIS, AS
    [J]. MATHEMATICAL PROGRAMMING, 1992, 57 (01) : 15 - 48
  • [9] DUALITY RELATIONSHIPS FOR ENTROPY-LIKE MINIMIZATION PROBLEMS
    BORWEIN, JM
    LEWIS, AS
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1991, 29 (02) : 325 - 338
  • [10] BORWEIN P., 1991, J MATH ANAL APPL SUB