Two-stage model selection procedures in partially linear regression

被引:18
作者
Bunea, F [1 ]
Wegkamp, MH [1 ]
机构
[1] Florida State Univ, Dept Stat, Tallahassee, FL 32306 USA
来源
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE | 2004年 / 32卷 / 02期
关键词
adaptive minimax estimation; consistent covariate selection; oracle inequality; partially linear regression;
D O I
10.2307/3315936
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The authors propose a two-stage estimation procedure for the partially linear model Y = f(0) (T) + X'beta(0) + epsilon. They show how to estimate consistently the location of the nonzero components of beta(0). Their approach turns out to be compatible with minimax adaptive estimation of f(0) over Besov balls in the case of penalized least squares. Their proofs are based on a new type of oracle inequality.
引用
收藏
页码:105 / 118
页数:14
相关论文
共 20 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]   Model selection for regression on a fixed design [J].
Baraud, Y .
PROBABILITY THEORY AND RELATED FIELDS, 2000, 117 (04) :467-493
[3]  
Baraud Y., 2002, ESAIM Probability and Statistics, V6, P127
[4]   Risk bounds for model selection via penalization [J].
Barron, A ;
Birgé, L ;
Massart, P .
PROBABILITY THEORY AND RELATED FIELDS, 1999, 113 (03) :301-413
[5]   Minimum contrast estimators on sieves: exponential bounds and rates of convergence [J].
Birge, L ;
Massart, P .
BERNOULLI, 1998, 4 (03) :329-375
[6]  
BUNEA F, 2004, IN PRESS ANN STAT, P32
[7]   SELECTION OF THE SPLINED VARIABLES AND CONVERGENCE-RATES IN A PARTIAL SPLINE MODEL [J].
CHEN, H ;
CHEN, KW .
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1991, 19 (03) :323-339
[8]   CONVERGENCE-RATES FOR PARAMETRIC COMPONENTS IN A PARTLY LINEAR-MODEL [J].
CHEN, H .
ANNALS OF STATISTICS, 1988, 16 (01) :136-146
[9]  
DEVORE A, 1993, CONSTRUCTIVE APPROXI
[10]   SEMIPARAMETRIC ESTIMATES OF THE RELATION BETWEEN WEATHER AND ELECTRICITY SALES [J].
ENGLE, RF ;
GRANGER, CWJ ;
RICE, J ;
WEISS, A .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1986, 81 (394) :310-320