Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors

被引:233
作者
Breheny, Patrick [1 ]
Huang, Jian [1 ,2 ]
机构
[1] Univ Iowa, Dept Biostat, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Stat & Actuarial Sci, Iowa City, IA 52242 USA
关键词
Optimization; Penalized regression; Group lasso; Descent algorithms; VARIABLE SELECTION; GENE-EXPRESSION; GROUP LASSO; LIKELIHOOD; SHRINKAGE;
D O I
10.1007/s11222-013-9424-2
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Penalized regression is an attractive framework for variable selection problems. Often, variables possess a grouping structure, and the relevant selection problem is that of selecting groups, not individual variables. The group lasso has been proposed as a way of extending the ideas of the lasso to the problem of group selection. Nonconvex penalties such as SCAD and MCP have been proposed and shown to have several advantages over the lasso; these penalties may also be extended to the group selection problem, giving rise to group SCAD and group MCP methods. Here, we describe algorithms for fitting these models stably and efficiently. In addition, we present simulation results and real data examples comparing and contrasting the statistical properties of these methods.
引用
收藏
页码:173 / 187
页数:15
相关论文
共 30 条
[1]  
[Anonymous], 1999, Nonlinear Programming
[2]  
[Anonymous], 2010, STATISTICS-ABINGDON
[3]  
Bakin S., 1999, Ph.D. thesis)
[4]   COORDINATE DESCENT ALGORITHMS FOR NONCONVEX PENALIZED REGRESSION, WITH APPLICATIONS TO BIOLOGICAL FEATURE SELECTION [J].
Breheny, Patrick ;
Huang, Jian .
ANNALS OF APPLIED STATISTICS, 2011, 5 (01) :232-253
[5]   Homozygosity mapping with SNP arrays identifies TRIM32 an E3 ubiquitin ligase, as a Bardet-Biedl syndrome gene (BBS11) [J].
Chiang, AP ;
Beck, JS ;
Yen, HJ ;
Tayeh, MK ;
Scheetz, TE ;
Swiderski, RE ;
Nishimura, DY ;
Braun, TA ;
Kim, KYA ;
Huang, J ;
Elbedour, K ;
Carmi, R ;
Slusarski, DC ;
Casavant, TL ;
Stone, EM ;
Sheffield, VC .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2006, 103 (16) :6287-6292
[6]   IDEAL SPATIAL ADAPTATION BY WAVELET SHRINKAGE [J].
DONOHO, DL ;
JOHNSTONE, IM .
BIOMETRIKA, 1994, 81 (03) :425-455
[7]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[8]  
Friedman J., 2010, ARXIV
[9]   PATHWISE COORDINATE OPTIMIZATION [J].
Friedman, Jerome ;
Hastie, Trevor ;
Hoefling, Holger ;
Tibshirani, Robert .
ANNALS OF APPLIED STATISTICS, 2007, 1 (02) :302-332
[10]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22