THE MINIMUM RECONSTRUCTION ERROR CHOICE OF REGULARIZATION PARAMETERS - SOME MORE EFFICIENT METHODS AND THEIR APPLICATION TO DECONVOLUTION PROBLEMS

For the simple problem of estimating a vector x(0) from a noisy data vector y = Bx(0) + e where B is a known ill-conditioned m x n matrix and e is an unknown ''white noise'' vector, a classical regularized solution, say x(tau) where tau > 0 is the regularization parameter, can be satisfactory provided tau is well chosen. Standard data-based methods for choosing tau (like generalized cross validation, or GCV) are known to give a good estimate of the value of tau which minimizes the prediction error parallel to Bx(tau) - Bx(0) parallel to(2). In this paper, we focus on the minimization of the estimation (or reconstruction) error parallel to x(tau) - x(0) parallel to(2). We give sufficient conditions for the existence of two unbiased estimators of the expectation of the inner product (x(0), x(tau)). This provides two estimates of the tau which minimizes parallel to x(tau) - x(0) parallel to(2). (The first one was proposed by Rice [Contemporary Mathematics, 59 (1986), pp. 137-151].) We compare these two estimators in the case of deconvolution problems. In theory, the second estimator no longer has the possibly ''infinite'' variance of the first one; however, both are likely to produce frequent dramatic undersmoothing. Then we propose a third class of estimators based on automatic stabilization procedures, which are much more efficient in many deconvolution problems. This new approach for choosing regularization parameters can significantly improve on GCV especially for ''severely'' ill-conditioned problems. This is easily shown by analyzing a simple example and is confirmed by numerical simulations with different degrees of ill-conditioning.