On the solution of the Tikhonov regularization of the total least squares problem

被引:98
作者
Beck, Amir [1 ]
Ben-Tal, Aharon [1 ]
机构
[1] Technion Israel Inst Technol, Dept Ind Engn & Management, MINERVA Optimizat Ctr, IL-3200 Haifa, Israel
关键词
total least squares; Tikhonov regularization; fractional programming; nonconvex optimization; trust region subproblem;
D O I
10.1137/050624418
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Total least squares (TLS) is a method for treating an overdetermined system of linear equations Ax approximate to b, where both the matrix A and the vector b are contaminated by noise. Tikhonov regularization of the TLS (TRTLS) leads to an optimization problem of minimizing the sum of fractional quadratic and quadratic functions. As such, the problem is nonconvex. We show how to reduce the problem to a single variable minimization of a function G over a closed interval. Computing a value and a derivative of G consists of solving a single trust region subproblem. For the special case of regularization with a squared Euclidean norm we show that G is unimodal and provide an alternative algorithm, which requires only one spectral decomposition. A numerical example is given to illustrate the effectiveness of our method.
引用
收藏
页码:98 / 118
页数:21
相关论文
共 34 条
  • [1] [Anonymous], 1991, MATH COMPUT
  • [2] BECK A, IN PRESS SIAM J MATR
  • [3] Hidden convexity In some nonconvex quadratically constrained quadratic programming
    BenTal, A
    Teboulle, M
    [J]. MATHEMATICAL PROGRAMMING, 1996, 72 (01) : 51 - 63
  • [4] Bertsekas D., 1999, NONLINEAR PROGRAMMIN
  • [5] Bjorck A., 1996, NUMERICAL METHODS LE, DOI DOI 10.1137/1.9781611971484
  • [6] CONN AR, 2000, MPS SIAM SER OPTIM, V1
  • [7] Dinkelbach Werner., 1967, Manage. Sci., V13, P492, DOI [10.1287/mnsc.13.7.492, DOI 10.1287/MNSC.13.7.492]
  • [8] The trust region subproblem and semidefinite programming
    Fortin, C
    Wolkowicz, H
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2004, 19 (01) : 41 - 67
  • [9] A CONSTRAINED EIGENVALUE PROBLEM
    GANDER, W
    GOLUB, GH
    VONMATT, U
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 1989, 114 : 815 - 839
  • [10] GAUVIN J, 1982, MATH PROGRAM STUD, V19, P101, DOI 10.1007/BFb0120984