L1-norm quantile regression

被引:243
作者
Li, Youjuan [1 ]
Zhu, Ji [1 ]
机构
[1] Univ Michigan, Dept Stat, Ann Arbor, MI 48109 USA
基金
美国国家科学基金会;
关键词
effective dimension; LASSO; linear programming; L-1-norm penalty; variable selection;
D O I
10.1198/106186008X289155
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Classical regression methods have focused mainly on estimating conditional mean functions. In recent years, however, quantile regression has emerged as a comprehensive approach to the statistical analysis of response models. In this article we consider the L-1-norm (LASSO) regularized quantile regression (L-1-norm QR), which uses the sum of the absolute values of the coefficients as the penalty. The L-1-norm penalty has the advantage of simultaneously controlling the variance of the fitted coefficients and performing automatic variable selection. We propose an efficient algorithm that computes the entire solution path of the L-1-norm QR. Furthermore, we derive an estimate for the effective dimension of the L-1-norm QR model, which allows convenient selection of the regularization parameter.
引用
收藏
页码:163 / 185
页数:23
相关论文
共 26 条
[1]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[2]   SMOOTHING REFERENCE CENTILE CURVES - THE LMS METHOD AND PENALIZED LIKELIHOOD [J].
COLE, TJ ;
GREEN, PJ .
STATISTICS IN MEDICINE, 1992, 11 (10) :1305-1319
[4]  
Efron B, 2004, J AM STAT ASSOC, V99, P619, DOI 10.1198/016214504000000692
[5]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[6]  
Friedman J, 2004, ANN STAT, V32, P102
[7]   Semiparametric estimation of regression quantiles with application to standardizing weight for height and age in US children [J].
Heagerty, PJ ;
Pepe, MS .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 1999, 48 :533-551
[8]   HIERARCHICAL SPLINE MODELS FOR CONDITIONAL QUANTILES AND THE DEMAND FOR ELECTRICITY [J].
HENDRICKS, W ;
KOENKER, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1992, 87 (417) :58-68
[9]   RIDGE REGRESSION - BIASED ESTIMATION FOR NONORTHOGONAL PROBLEMS [J].
HOERL, AE ;
KENNARD, RW .
TECHNOMETRICS, 1970, 12 (01) :55-&
[10]   Reappraising medfly longevity: A quantile regression survival analysis [J].
Koenker, R ;
Geling, O .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (454) :458-468