Tuning parameter selectors for the smoothly clipped absolute deviation method

被引:628
作者
Wang, Hansheng [1 ]
Li, Runze
Tsai, Chih-Ling
机构
[1] Peking Univ, Guanghua Sch Math, Beijing 100871, Peoples R China
[2] Penn State Univ, Dept Stat, University Pk, PA 16802 USA
[3] Penn State Univ, Methodol Ctr, University Pk, PA 16802 USA
[4] Univ Calif Davis, Grad Sch Management, Davis, CA 95616 USA
关键词
AIC; BIC; generalized crossvalidation; least absolute shrinkage and selection operator; smoothly clipped absolute deviation;
D O I
10.1093/biomet/asm053
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The penalized least squares approach with smoothly clipped absolute deviation penalty has been consistently demonstrated to be an attractive regression shrinkage and selection method. It not only automatically and consistently selects the important variables, but also produces estimators which are as efficient as the oracle estimator. However, these attractive features depend on appropriate choice of the tuning parameter. We show that the commonly used generalized crossvalidation cannot select the tuning parameter satisfactorily, with a nonignorable overfitting effect in the resulting model. In addition, we propose a BIC tuning parameter selector, which is shown to be able to identify the true model consistently. Simulation studies are presented to support theoretical findings, and an empirical example is given to illustrate its use in the Female Labor Supply data.
引用
收藏
页码:553 / 568
页数:16
相关论文
共 26 条
[1]  
Akaike H., 1973, 2 INT S INFORM THEOR, P267, DOI [DOI 10.1007/978-1-4612-1694-0_15, 10.1007/978-1-4612-1694-0_15]
[2]  
Breiman L, 1996, ANN STAT, V24, P2350
[3]   Two-stage model selection procedures in partially linear regression [J].
Bunea, F ;
Wegkamp, MH .
CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2004, 32 (02) :105-118
[4]   Consistent covariate selection and post model selection inference in semiparametric regression [J].
Bunea, F .
ANNALS OF STATISTICS, 2004, 32 (03) :898-927
[5]   SMOOTHING NOISY DATA WITH SPLINE FUNCTIONS [J].
WAHBA, G .
NUMERISCHE MATHEMATIK, 1975, 24 (05) :383-393
[6]   SEMIPARAMETRIC ESTIMATES OF THE RELATION BETWEEN WEATHER AND ELECTRICITY SALES [J].
ENGLE, RF ;
GRANGER, CWJ ;
RICE, J ;
WEISS, A .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1986, 81 (394) :310-320
[7]  
Fan J., 1996, LOCAL POLYNOMIAL MOD
[8]   Profile likelihood inferences on semiparametric varying-coefficient partially linear models [J].
Fan, JQ ;
Huang, T .
BERNOULLI, 2005, 11 (06) :1031-1057
[9]   New estimation and model selection procedures for semiparametric modeling in longitudinal data analysis [J].
Fan, JQ ;
Li, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2004, 99 (467) :710-723
[10]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360