Choosing regularization parameters in iterative methods for ill-posed problems

被引:228
作者
Kilmer, ME [1 ]
O'Leary, DP
机构
[1] Tufts Univ, Dept Math, Medford, MA 02155 USA
[2] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
[3] Univ Maryland, Inst Adv Comp Studies, College Pk, MD 20742 USA
关键词
ill-posed problems; regularization; discrepancy principle; iterative methods; L-curve; Tikhonov; truncated singular value decomposition; projection; Krylov subspace;
D O I
10.1137/S0895479899345960
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Numerical solution of ill-posed problems is often accomplished by discretization (projection onto a finite dimensional subspace) followed by regularization. If the discrete problem has high dimension, though, typically we compute an approximate solution by projecting the discrete problem onto an even smaller dimensional space, via iterative methods based on Krylov subspaces. In this work we present a common framework for efficient algorithms that regularize after this second projection rather than before it. We show that determining regularization parameters based on the final projected problem rather than on the original discretization has firmer justification and often involves less computational expense. We prove some results on the approximate equivalence of this approach to other forms of regularization, and we present numerical examples.
引用
收藏
页码:1204 / 1221
页数:18
相关论文
共 29 条
[1]  
BJORCK A, 1994, BIT, V34, P510, DOI 10.1007/BF01934265
[2]  
BJORCK A, 1988, BIT, V28, P659, DOI 10.1007/BF01941141
[3]   Estimation of the L-curve via Lanczos bidiagonalization [J].
Calvetti, D ;
Golub, GH ;
Reichel, L .
BIT NUMERICAL MATHEMATICS, 1999, 39 (04) :603-619
[4]   Galerkin projection methods for solving multiple linear systems [J].
Chan, TF ;
Ng, MK .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1999, 21 (03) :836-850
[5]   THE MINIMUM RECONSTRUCTION ERROR CHOICE OF REGULARIZATION PARAMETERS - SOME MORE EFFICIENT METHODS AND THEIR APPLICATION TO DECONVOLUTION PROBLEMS [J].
DESBAT, L ;
GIRARD, D .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1995, 16 (06) :1387-1403
[6]   USING THE L-CURVE FOR DETERMINING OPTIMAL REGULARIZATION PARAMETERS [J].
ENGL, HW ;
GREVER, W .
NUMERISCHE MATHEMATIK, 1994, 69 (01) :25-31
[7]   EQUIVALENCE OF REGULARIZATION AND TRUNCATED ITERATION IN THE SOLUTION OF ILL-POSED IMAGE-RECONSTRUCTION PROBLEMS [J].
FLEMING, HE .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1990, 130 :133-150
[8]   Fast cg-based methods for Tikhonov-Phillips regularization [J].
Frommer, A ;
Maass, P .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1999, 20 (05) :1831-1850
[9]   GENERALIZED CROSS-VALIDATION AS A METHOD FOR CHOOSING A GOOD RIDGE PARAMETER [J].
GOLUB, GH ;
HEATH, M ;
WAHBA, G .
TECHNOMETRICS, 1979, 21 (02) :215-223
[10]  
Golub GH, 1965, SIAM J NUMER ANAL, V2, P205, DOI DOI 10.1137/0702016