RATES OF CONVERGENCE FOR MINIMUM CONTRAST ESTIMATORS

被引:139
作者
BIRGE, L [1 ]
MASSART, P [1 ]
机构
[1] UNIV PARIS 11,URA 743,F-91405 ORSAY,FRANCE
关键词
D O I
10.1007/BF01199316
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We shall present here a general study of minimum contrast estimators in a nonparametric setting (although our results are also valid in the classical parametric case) for independent observations. These estimators include many of the most popular estimators in various situations such as maximum likelihood estimators, least squares and other estimators of the regression function, estimators for mixture models or deconvolution... The main theorem relates the rate of convergence of those estimators to the entropy structure of the space of parameters. Optimal rates depending on entropy conditions are already known, at least for some of the models involved, and they agree with what we get for minimum contrast estimators as long as the entropy counts are not too large. But, under some circumstances (''large'' entropies or changes in the entropy structure due to local perturbations), the resulting rates are only suboptimal. Counterexamples are constructed which show that the phenomenon is real for non-parametric maximum likelihood or regression. This proves that, under purely metric assumptions, our theorem is optimal and that minimum contrast estimators happen to be suboptimal.
引用
收藏
页码:113 / 150
页数:38
相关论文
共 37 条
[1]   THE CENTRAL LIMIT-THEOREM AND THE LAW OF ITERATED LOGARITHM FOR EMPIRICAL PROCESSES UNDER LOCAL CONDITIONS [J].
ANDERSEN, NT ;
GINE, E ;
OSSIANDER, M ;
ZINN, J .
PROBABILITY THEORY AND RELATED FIELDS, 1988, 77 (02) :271-305
[2]  
BAHADUR R. R., 1958, SANKHYA, V20, P207
[3]   LAW OF THE ITERATED LOGARITHM FOR SET-INDEXED PARTIAL SUM PROCESSES WITH FINITE VARIANCE [J].
BASS, RF .
ZEITSCHRIFT FUR WAHRSCHEINLICHKEITSTHEORIE UND VERWANDTE GEBIETE, 1985, 70 (04) :591-608
[4]   APPROXIMATION IN METRIC-SPACES AND ESTIMATION THEORY [J].
BIRGE, L .
ZEITSCHRIFT FUR WAHRSCHEINLICHKEITSTHEORIE UND VERWANDTE GEBIETE, 1983, 65 (02) :181-237
[5]  
BIRGE L, 1984, ANN I H POINCARE-PR, V20, P201
[6]   THE GRENANDER ESTIMATOR - A NONASYMPTOTIC APPROACH [J].
BIRGE, L .
ANNALS OF STATISTICS, 1989, 17 (04) :1532-1549
[7]   ON ESTIMATING A DENSITY USING HELLINGER DISTANCE AND SOME OTHER STRANGE FACTS [J].
BIRGE, L .
PROBABILITY THEORY AND RELATED FIELDS, 1986, 71 (02) :271-291
[8]  
BIRGE L, 1993, UNPUB L2 ENTROPY BRA
[9]  
Brunk HD., 1972, STAT-US
[10]  
DONOHO DL, 1989, STATISTICAL ESTIMATI