Consistent parameter estimation for lasso and approximate message passing

Ali Mousavi, Arian Maleki, Richard G. Baraniuk

Research output: Contribution to journalArticle

9 Scopus citations

Abstract

This paper studies the optimal tuning of the regularization parameter in LASSO or the threshold parameters in approximate message passing (AMP). Considering a model in which the design matrix and noise are zero-mean i.i.d. Gaussian, we propose a data-driven approach for estimating the regularization parameter of LASSO and the threshold parameters in AMP. Our estimates are consistent, that is, they converge to their asymptotically optimal values in probability as n, the number of observations, and p, the ambient dimension of the sparse vector, grow to infinity, while n/p converges to a fixed number δ. As a byproduct of our analysis, we will shed light on the asymptotic properties of the solution paths of LASSO and AMP.

Original languageEnglish (US)
Pages (from-to)119-148
Number of pages30
JournalAnnals of Statistics
Volume46
Issue number1
DOIs
StatePublished - Feb 2018

Keywords

  • Approximate message passing
  • Estimation
  • LASSO
  • Sparsity

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint Dive into the research topics of 'Consistent parameter estimation for lasso and approximate message passing'. Together they form a unique fingerprint.

Cite this