Minimax estimation via wavelet shrinkage

被引:19
作者
Donoho, DL [1 ]
Johnstone, IM [1 ]
机构
[1] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
关键词
minimax decision theory; minimax Bayes estimation; Besov; Holder; Sobolev; Triebel spaces; nonlinear estimation; white noise model; nonparametric regression; orthonormal bases of compactly supported wavelets; renormalization; white noise approximation;
D O I
暂无
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We attempt to recover an unknown function from noisy, sampled data. Using orthonormal bases of compactly supported wavelets, we develop a nonlinear method which works in the wavelet domain by simple nonlinear shrinkage of the empirical wavelet coefficient. The shrinkage can be tuned to be nearly minimax over any member of a wide range of Triebel- and Besov-type smoothness constraints and asymptotically minimax over Besov bodies with p less than or equal to q. Linear estimates cannot achieve even the minimax rates over Triebel and Besov classes with p < 2, so the method can significantly outperform every linear method (e.g., kernel, smoothing spline, sieve) in a minimax sense. Variants of our method based on simple threshold nonlinear estimators are nearly minimax. Our method possesses the interpretation of spatial adaptivity; it reconstructs using a kernel which may vary in shape and bandwidth from point to point, depending on the data. Least favorable distributions for certain of the Triebel and Besov scales generate objects with sparse wavelet transforms. Many real objects have similarly sparse transforms, which suggests that these minimax results are relevant for practical problems. Sequels to this paper, which was first drafted in November 1990, discuss practical implementation, spatial adaptation properties, universal near minimaxity and applications to inverse problems.
引用
收藏
页码:879 / 921
页数:43
相关论文
共 59 条
  • [1] [Anonymous], 1983, CART: Classification and regression trees
  • [2] Bergh J., 1976, INTERPOLATION SPACES
  • [3] Bickel P. J., 1983, RECENT ADV STAT, P511
  • [4] BIRGE L., 1997, FESTSCHRIFT L LECAM, P55
  • [5] Brown LD, 1996, ANN STAT, V24, P2384
  • [6] Chui C.K., 1992, An introduction to wavelets, V1, DOI DOI 10.1109/99.388960
  • [7] Cohen A., 1993, Applied and Computational Harmonic Analysis, V1, P54, DOI 10.1006/acha.1993.1005
  • [8] COHEN A, 1993, CR ACAD SCI I-MATH, V316, P417
  • [9] ORTHONORMAL BASES OF COMPACTLY SUPPORTED WAVELETS
    DAUBECHIES, I
    [J]. COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 1988, 41 (07) : 909 - 996
  • [10] DAUBECHIES I, 1992, LECT WAVELETS