The degrees of freedom of the group Lasso for a general design

Abstract

In this paper, we are concerned with regression problems where covariates can be grouped in nonoverlapping blocks, from which a few are active. In such a situation, the group Lasso is an attractive method for variable selection since it promotes sparsity of the groups. We study the sensitivity of any group Lasso solution to the observations and provide its precise local parameterization. When the noise is Gaussian, this allows us to derive an unbiased estimator of the degrees of freedom of the group Lasso. This result holds true for any fixed design, no matter whether it is under- or overdetermined. Our results specialize to those of [1], [2] for blocks of size one, i.e. l1 norm. These results allow objective choice of the regularisation parameter through e.g. the SURE.

Publication
SPARS 2013 (Signal Processing with Adaptive Sparse Structured Representations)