![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Recently, variable selection by penalized likelihood has attracted much research interest. In this paper, we propose adaptive Lasso quantile regression (BALQR) from a Bayesian perspective. The method extends the Bayesian Lasso quantile regression by allowing different penalization parameters for different regression coefficients. Inverse gamma prior distributions are placed on the penalty parameters. We treat the hyperparameters of the inverse gamma prior as unknowns and estimate them along with the other parameters. A Gibbs sampler is developed to simulate the parameters from the posterior distributions. Through simulation studies and analysis of a prostate cancer dataset, we compare the performance of the BALQR method proposed with six existing Bayesian and non-Bayesian methods. The simulation studies and the prostate cancer data analysis indicate that the BALQR method performs well in comparison to the other approaches.
References
|
Alhamzawi, R, Yu, K, Vinciotti, V, Tucker, A (2011) Prior elicitation for mixed quantile regression with an allometric model. Environmetrics, 22, 911–20. doi: 10.1002/env.111810.1002/env.1118 Google Scholar | Crossref | |
|
Andrews, DF, Mallows, CL (1974) Scale mixtures of normal distributions. Journal of the Royal Statistical Society, Series B, 36, 99–102. Google Scholar | |
|
Benoit, DF, Alhamzawi, R, Yu, K, Van den Poel, D (2011) bayesQR: Bayesian quantile regression. Available on CRAN R website: http://cran.r-project.org/web/packages/bayesQR/index.html. Google Scholar | |
|
Benoit, DF, Van den Poel, D (2011) Binary quantile regression: a Bayesian approach based on the asymmetric Laplace distribution. Journal of Applied Econometrics, 26, 1–10. doi: 10.1002/jae.121610.1002/jae.1216. Google Scholar | Crossref | |
|
Breiman, L (1996) Heuristics of instability and stabilization in model selection. Annals of Statistics, 24, 2350–238. Google Scholar | Crossref | ISI | |
|
Chhikara, RS, Folks, L (1989) The inverse gaussian distribution: theory, methodology, and applications. New York: Marcel Dekker. Google Scholar | |
|
Efron, B, Hastie, T, Johnstone, I, Tibshirani, R (2004) Least angle regression (with discussion). Annals of Statistics, 32, 407–51. Google Scholar | Crossref | ISI | |
|
Fahrmeir, L, Kneib, T, Konrath, S (2010) Bayesian regularisation in structured additive regression: a unifying perspective on shrinkage, smoothing and predictor selection. Statistics and Computing, 20, 203–19. Google Scholar | Crossref | ISI | |
|
Fan, J, Li, RZ (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96, 1348–60. Google Scholar | Crossref | ISI | |
|
Fan, J, Peng, H (2004) On Nonconcave penalized likelihood with diverging number of parameters. The Annals of Statistics, 32, 928–61. Google Scholar | Crossref | |
|
George, EI, McCulloch, RE (1997) Approaches for Bayesian variable selection. Statistica Sinica, 7, 339–73. Google Scholar | ISI | |
|
Gilks, WR (1992) Derivative-free adaptive rejection sampling for gibbs sampling. In Bernardo, J, Berger, J, Dawid, AP, Smith, AFM (eds), Bayesian Statistics, Vol. 4, pp. 641–49. Clarendon, Oxford: Oxford University Press. Google Scholar | |
|
Griffin, JE, Brown, PJ (2010) Bayesian adaptive Lassos with non-convex penalization. Technical report, Institute of Mathematics, Statistics and Actuarial Science, University of Kent. Google Scholar | |
|
Hans, C (2009) Bayesian lasso regression. Biometrika, 96, 835–45. Google Scholar | Crossref | ISI | |
|
Huang, J, Ma, S, Zhang, C-H (2008) Adaptive Lasso for sparse high-dimensional regression models. Statistica Sinica, 18, 1603–618. Google Scholar | |
|
Kocherginsky, M, He, X, Mu, Y (2005) Practical confidence intervals for regression quantiles. Journal of Computational and Graphical Statistics, 14, 41–55. Google Scholar | Crossref | |
|
Koenker, R (2004) Quantile regression for longitudinal data. Journal of Multivariate Analysis, 91, 74–89. Google Scholar | Crossref | ISI | |
|
Koenker, R (2005) Quantile regression. New York: Cambridge University Press. Google Scholar | Crossref | |
|
Koenker, R, Machado, J (1999) Goodness of fit and related inference processes for quantile regression. Journal of the American Statistical Association, 94, 1296–310. Google Scholar | Crossref | |
|
Kozumi, H, Kobayashi, G (2011) Gibbs sampling methods for Bayesian quantile regression. Journal of Statistical Computation and Simulation, 81, 1565–1578. Google Scholar | Crossref | |
|
Li, Q, Xi, R, Lin, N (2010) Bayesian regularized quantile regression. Bayesian Analysis, 5, 1–24. Google Scholar | Crossref | Medline | |
|
Li, Y, Zhu, J (2008) l1-norm quantile regressions. Journal of Computational and Graphical Statistics, 17, 163–85. Google Scholar | Crossref | |
|
Mitchell, TJ, Beauchamp, JJ (1988) Bayesian variable selection in linear regression (with Discussion). Journal of the American Statistical Association, 83, 1023–36. Google Scholar | Crossref | |
|
Park, T, Casella, G (2008) The Bayesian Lasso. Journal of the American Statistical Association, 103, 681–86. Google Scholar | Crossref | ISI | |
|
Polsen, NG, Scott, JG (2011) Shrink globally, act locally: sparse Bayesian regularization and prediction, Proceedings of Valencia International Conference 2010, forthcoming. Google Scholar | Crossref | |
|
Reed, C, Dunson, D, Yu, K (2009) Bayesian variable selection in quantile regression. Technical report, Department of Mathematical Sciences, Brunel University. Google Scholar | |
|
Reed, C, Yu, K (2009) An efficient Gibbs sampler for Bayesian quantile regression. Technical report, Department of Mathematical Sciences, Brunel University. Google Scholar | |
|
Rue, H, Held, L (2005) Gaussian Markov random fields: theory and applications. In Vol. 4 of Monographs on Statistics and Applied Probability, 104. Boca Raton, FL: Chapman and Hall. Google Scholar | Crossref | |
|
Stamey, T, Kabalin, J, McNeal, J, Johnstone, I, Freiha, F, Redwine, E, Yang, N (1989) Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate, ii: Radical prostatectomy treated patients. Journal of Urology, 16, 1076–83. Google Scholar | Crossref | |
|
Sun, W, Ibrahim, JG, Zou, F (2010) Genome-wide multiple loci mapping in experimental crosses by the iterative adaptive penalized regression. Genetics, 185, 349–59. Google Scholar | Crossref | Medline | |
|
Tibshirani, R (1996) Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society, Series B, 58, 267–88. Google Scholar | |
|
Tsionas, EG (2003) Bayesian quantile inference. Journal of Statistical Computation and Simulation, 73, 659–74. Google Scholar | Crossref | |
|
Wang, H, Li, G, Jiang, G (2007) Robust regression shrinkage and consistent variable selection through the LAD-Lasso. Journal of Business and Economic Statistics, 25, 347–55. Google Scholar | Crossref | |
|
Wu, Y, Liu, Y (2009) Variable selection in quantile regression. Statistica Sinica, 19, 801–17. Google Scholar | ISI | |
|
Yi, N, Xu, S (2008) Bayesian LASSO for quantitative trait loci mapping. Genetics, 179, 1045–55. Google Scholar | Crossref | Medline | |
|
Yu, K, Moyeed, RA (2001) Bayesian quantile regression. Statistics and Probability Letters, 54, 437–47. Google Scholar | Crossref | |
|
Yu, K, Stander, J (2007) Bayesian analysis of a Tobit quantile regression model. Journal of Econometrics, 137, 260–76. Google Scholar | Crossref | ISI | |
|
Yuan, M, Lin, Y (2005) Efficient empirical Bayes variable selection and estimation in linear models. Journal American Statistical Association, 100, 1215–24. Google Scholar | Crossref | |
|
Yuan, Y, Yin, G (2010) Bayesian quantile regression for longitudinal studies with nonignorable missing data. Biometrics, 66, 105–14. Google Scholar | Crossref | Medline | ISI | |
|
Yue, YR, Rue, H (2010) Bayesian inference for additive mixed quantile regression models. Computational Statistics and Data Analysis, 55, 84–96. Google Scholar | Crossref | |
|
Zou, H (2006) The adaptive lasso and its oracle properties. Journal of the American Statistical Association, 101, 1418–29. Google Scholar | Crossref | ISI |
