Shrinkage Estimation of the Varying Coefficient Model

被引:252
作者
Wang, Hansheng [1 ]
Xia, Yingcun [2 ]
机构
[1] Peking Univ, Guanghua Sch Management, Beijing 100871, Peoples R China
[2] Natl Univ Singapore, Risk Management Inst, Dept Stat & Appl Probabil, Singapore 117546, Singapore
基金
中国国家自然科学基金;
关键词
Bayesian information criterion; Kernel smoothing; Least Absolute Shrinkage and Selection Operator; Oracle property; Smoothly Clipped Absolute Deviation; Variable selections; Varying coefficient model; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; ADAPTIVE LASSO; REGRESSION; INFERENCES;
D O I
10.1198/jasa.2009.0138
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The varying coefficient model is a useful extension of the linear regression model. Nevertheless, how to conduct variable selection for the varying coefficient model in a computationally efficient manner is poorly understood. To solve the problem, we propose here a novel method, which combines the ideas of the local polynomial smoothing and the Least Absolute Shrinkage and Selection Operator (LASSO). The new method can do nonparametric estimation and variable selection simultaneously. With a local constant estimator and the adaptive LASSO penalty the new method can identify the true model consistently, and that the resulting estimator can be as efficient as the oracle estimator Numerical studies clearly confirm our theories. Extension to other shrinkage methods(e.g. the SCAD. i.e., the Smoothly Clipped Absolute Deviation.) mid other smoothing methods is stiaightforward.
引用
收藏
页码:747 / 757
页数:11
相关论文
共 35 条
[1]   BETTER SUBSET REGRESSION USING THE NONNEGATIVE GARROTE [J].
BREIMAN, L .
TECHNOMETRICS, 1995, 37 (04) :373-384
[2]   Efficient estimation and inferences for varying-coefficient models [J].
Cai, ZW ;
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2000, 95 (451) :888-902
[3]   FUNCTIONAL-COEFFICIENT AUTOREGRESSIVE MODELS [J].
CHEN, R ;
TSAY, RS .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (421) :298-308
[4]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[5]  
Fan J., 1996, Local polynomial modelling and its applications
[6]   Simultaneous confidence bands and hypothesis testing in varying-coefficient models [J].
Fan, JQ ;
Zhang, WY .
SCANDINAVIAN JOURNAL OF STATISTICS, 2000, 27 (04) :715-731
[7]   Statistical estimation in varying coefficient models [J].
Fan, JQ ;
Zhang, WY .
ANNALS OF STATISTICS, 1999, 27 (05) :1491-1518
[8]   Profile likelihood inferences on semiparametric varying-coefficient partially linear models [J].
Fan, JQ ;
Huang, T .
BERNOULLI, 2005, 11 (06) :1031-1057
[9]   New estimation and model selection procedures for semiparametric modeling in longitudinal data analysis [J].
Fan, JQ ;
Li, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2004, 99 (467) :710-723
[10]   Two-step estimation of functional linear models with applications to longitudinal data [J].
Fan, JQ ;
Zhang, JT .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2000, 62 :303-322