Bayesian lasso regression

被引:295
作者
Hans, Chris [1 ]
机构
[1] Ohio State Univ, Dept Stat, Columbus, OH 43210 USA
基金
美国国家科学基金会;
关键词
Double-exponential distribution; Gibbs sampler; L(1) penalty; Laplace distribution; Markov chain Monte Carlo; Posterior predictive distribution; Regularization; SCALE MIXTURES; NORMAL-DISTRIBUTIONS; POSTERIOR MOMENTS;
D O I
10.1093/biomet/asp047
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The lasso estimate for linear regression corresponds to a posterior mode when independent, double-exponential prior distributions are placed on the regression coefficients. This paper introduces new aspects of the broader Bayesian treatment of lasso regression. A direct characterization of the regression coefficients' posterior distribution is provided, and computation and inference under this characterization is shown to be straightforward. Emphasis is placed on point estimation using the posterior mean, which facilitates prediction of future observations via the posterior predictive distribution. It is shown that the standard lasso prediction method does not necessarily agree with model-based, Bayesian predictions. A new Gibbs sampler for Bayesian lasso regression is introduced.
引用
收藏
页码:835 / 845
页数:11
相关论文
共 16 条
  • [1] ANDREWS DF, 1974, J ROY STAT SOC B MET, V36, P99
  • [2] [Anonymous], APPL STAT, DOI DOI 10.2307/2347565
  • [3] Bernardo J. M., 2000, Bayesian Theory, V1st
  • [4] INFERENCE FOR NONCONJUGATE BAYESIAN MODELS USING THE GIBBS SAMPLER
    CARLIN, BP
    POLSON, NG
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 1991, 19 (04): : 399 - 405
  • [5] A MONTE-CARLO APPROACH TO NONNORMAL AND NONLINEAR STATE-SPACE MODELING
    CARLIN, BP
    POLSON, NG
    STOFFER, DS
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1992, 87 (418) : 493 - 500
  • [6] Least angle regression - Rejoinder
    Efron, B
    Hastie, T
    Johnstone, I
    Tibshirani, R
    [J]. ANNALS OF STATISTICS, 2004, 32 (02) : 494 - 499
  • [7] Bayesian regression analysis with scale mixtures of normals
    Fernández, C
    Steel, MFJ
    [J]. ECONOMETRIC THEORY, 2000, 16 (01) : 80 - 101
  • [8] GEWEKE J, 1991, COMPUTING SCIENCE AND STATISTICS, P571
  • [9] MITCHELL AFS, 1994, J ROY STAT SOC B MET, V56, P605
  • [10] The Bayesian Lasso
    Park, Trevor
    Casella, George
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2008, 103 (482) : 681 - 686