Consistent covariate selection and post model selection inference in semiparametric regression

被引:52
作者
Bunea, F [1 ]
机构
[1] Florida State Univ, Dept Stat, Tallahassee, FL 32306 USA
关键词
semiparametric regression; consistent covariate selection; post model selection inference; penalized least squares; oracle inequalities;
D O I
10.1214/009053604000000247
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper presents a model selection technique of estimation in semiparametric regression models of the type Y-i = beta'X-i + f (T-i) + W-i, i = 1,..., n. The parametric and nonparametric components are estimated simultaneously by this procedure. Estimation is based on a collection of finite-dimensional models, using a penalized least squares criterion for selection. We show that by tailoring the penalty terms developed for nonparametric regression to semiparametric models, we can consistently estimate the subset of nonzero coefficients of the linear part. Moreover, the selected estimator of the linear component is asymptotically normal.
引用
收藏
页码:898 / 927
页数:30
相关论文
共 26 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]   Model selection for regression on a fixed design [J].
Baraud, Y .
PROBABILITY THEORY AND RELATED FIELDS, 2000, 117 (04) :467-493
[3]  
Baraud Y., 2002, ESAIM Probability and Statistics, V6, P127
[4]   Risk bounds for model selection via penalization [J].
Barron, A ;
Birgé, L ;
Massart, P .
PROBABILITY THEORY AND RELATED FIELDS, 1999, 113 (03) :301-413
[5]  
Bickel P. J., 1993, Efficient and Adaptive Estimation for Semiparametric Models
[6]   Minimum contrast estimators on sieves: exponential bounds and rates of convergence [J].
Birge, L ;
Massart, P .
BERNOULLI, 1998, 4 (03) :329-375
[7]   An adaptive compression algorithm in Besov spaces [J].
Birgé, L ;
Massart, P .
CONSTRUCTIVE APPROXIMATION, 2000, 16 (01) :1-36
[8]   SELECTION OF THE SPLINED VARIABLES AND CONVERGENCE-RATES IN A PARTIAL SPLINE MODEL [J].
CHEN, H ;
CHEN, KW .
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1991, 19 (03) :323-339
[9]   CONVERGENCE-RATES FOR PARAMETRIC COMPONENTS IN A PARTLY LINEAR-MODEL [J].
CHEN, H .
ANNALS OF STATISTICS, 1988, 16 (01) :136-146
[10]  
DeVore Ronald A., 1993, CONSTRUTIVE APPROXIM, V303