Shrinkage Estimation of the Varying Coefficient Model

被引:252
作者
Wang, Hansheng [1 ]
Xia, Yingcun [2 ]
机构
[1] Peking Univ, Guanghua Sch Management, Beijing 100871, Peoples R China
[2] Natl Univ Singapore, Risk Management Inst, Dept Stat & Appl Probabil, Singapore 117546, Singapore
基金
中国国家自然科学基金;
关键词
Bayesian information criterion; Kernel smoothing; Least Absolute Shrinkage and Selection Operator; Oracle property; Smoothly Clipped Absolute Deviation; Variable selections; Varying coefficient model; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; ADAPTIVE LASSO; REGRESSION; INFERENCES;
D O I
10.1198/jasa.2009.0138
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The varying coefficient model is a useful extension of the linear regression model. Nevertheless, how to conduct variable selection for the varying coefficient model in a computationally efficient manner is poorly understood. To solve the problem, we propose here a novel method, which combines the ideas of the local polynomial smoothing and the Least Absolute Shrinkage and Selection Operator (LASSO). The new method can do nonparametric estimation and variable selection simultaneously. With a local constant estimator and the adaptive LASSO penalty the new method can identify the true model consistently, and that the resulting estimator can be as efficient as the oracle estimator Numerical studies clearly confirm our theories. Extension to other shrinkage methods(e.g. the SCAD. i.e., the Smoothly Clipped Absolute Deviation.) mid other smoothing methods is stiaightforward.
引用
收藏
页码:747 / 757
页数:11
相关论文
共 35 条
[11]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[12]   Generalized likelihood ratio statistics and Wilks phenomenon [J].
Fan, JQ ;
Zhang, CM ;
Zhang, J .
ANNALS OF STATISTICS, 2001, 29 (01) :153-193
[13]   Penalized regressions: The bridge versus the lasso [J].
Fu, WJJ .
JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 1998, 7 (03) :397-416
[14]  
HARDLE W, 2000, PATIAL LINEAR MODELS
[15]  
HASTIE T, 1993, J ROY STAT SOC B MET, V55, P757
[16]  
Huang JHZ, 2004, STAT SINICA, V14, P763
[17]   Varying-coefficient models and basis function approximations for the analysis of repeated measurements [J].
Huang, JHZ ;
Wu, CO ;
Zhou, L .
BIOMETRIKA, 2002, 89 (01) :111-128
[18]   Variable selection using MM algorithms [J].
Hunter, DR ;
Li, RZ .
ANNALS OF STATISTICS, 2005, 33 (04) :1617-1642
[19]   MAXIMAL SPACINGS IN SEVERAL DIMENSIONS [J].
JANSON, S .
ANNALS OF PROBABILITY, 1987, 15 (01) :274-280
[20]  
Knight K, 2000, ANN STAT, V28, P1356