Penalized methods for bi-level variable selection

被引:13
作者
Breheny, Patrick [2 ]
Huang, Jian [1 ]
机构
[1] Univ Iowa, Dept Stat & Actuarial Sci, Iowa City, IA 52242 USA
[2] Univ Kentucky, Dept Biostat, Lexington, KY 40506 USA
基金
美国国家科学基金会;
关键词
High-dimensional data; Grouping structure; Minimax concave penalty; Local coordinate descent algorithms; Genetic association studies; MODEL SELECTION; REGRESSION; LASSO; OPTIMIZATION; LIKELIHOOD; SHRINKAGE;
D O I
暂无
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
In many applications, covariates possess a grouping structure that can be incorporated into the analysis to select important groups as well as important members of those groups. This work focuses on the incorporation of grouping structure into penalized regression. We investigate the previously proposed group lasso and group bridge penalties as well as a novel method, group MCP, introducing a framework and conducting simulation studies that shed light on the behavior of these methods. To fit these models, we use the idea of a locally approximated coordinate descent to develop algorithms which are fast and stable even when the number of features is much larger than the sample size. Finally, these methods are applied to a genetic association study of age-related macular degeneration.
引用
收藏
页码:369 / 380
页数:12
相关论文
共 21 条
  • [1] Breiman L, 1996, ANN STAT, V24, P2350
  • [2] IDEAL SPATIAL ADAPTATION BY WAVELET SHRINKAGE
    DONOHO, DL
    JOHNSTONE, IM
    [J]. BIOMETRIKA, 1994, 81 (03) : 425 - 455
  • [3] Least angle regression - Rejoinder
    Efron, B
    Hastie, T
    Johnstone, I
    Tibshirani, R
    [J]. ANNALS OF STATISTICS, 2004, 32 (02) : 494 - 499
  • [4] Variable selection via nonconcave penalized likelihood and its oracle properties
    Fan, JQ
    Li, RZ
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) : 1348 - 1360
  • [5] A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS
    FRANK, IE
    FRIEDMAN, JH
    [J]. TECHNOMETRICS, 1993, 35 (02) : 109 - 135
  • [6] Friedman J., 2008, REGULARIZATION PATHS
  • [7] PATHWISE COORDINATE OPTIMIZATION
    Friedman, Jerome
    Hastie, Trevor
    Hoefling, Holger
    Tibshirani, Robert
    [J]. ANNALS OF APPLIED STATISTICS, 2007, 1 (02) : 302 - 332
  • [8] Hastie T., 2008, ELEMENTS STAT LEARNI, V2nd
  • [9] HUANG J, 2007, 376 U IOW DEP STAT A
  • [10] Lange K, 2000, J COMPUT GRAPH STAT, V9, P1, DOI 10.2307/1390605