Group-Sparse Regression Using the Covariance Fitting Criterion

Kronvall, Ted; Adalbjörnsson, Stefan Ingi; Nadig, Santhosh; Jakobsson, Andreas (2017). Group-Sparse Regression Using the Covariance Fitting Criterion. Signal Processing, 139,, 116 - 130
Download:
DOI:
| Published | English
Authors:
Kronvall, Ted ; Adalbjörnsson, Stefan Ingi ; Nadig, Santhosh ; Jakobsson, Andreas
Department:
Statistical Signal Processing Group
Mathematics (Faculty of Engineering)
Research Group:
Statistical Signal Processing Group
Abstract:

In this work, we present a novel formulation for efficient estimation of group-sparse regression problems. By relaxing a covariance fitting criteria commonly used in array signal processing, we derive a generalization of the recent SPICE method for grouped variables. Such a formulation circumvents cumbersome model order estimation, while being inherently hyperparameter-free. We derive an implementation which iteratively decomposes into a series of convex optimization problems, each being solvable in closed-form. Furthermore, we show the connection between the proposed estimator and the class of LASSO-type estimators, where a dictionary-dependent regularization level is inherently set by the covariance fitting criteria. We also show how the proposed estimator may be used to form group-sparse estimates for sparse groups, as well as validating its robustness against coherency in the dictionary, i.e., the case of overlapping dictionary groups. Numerical results show preferable estimation performance, on par with a group-LASSO bestowed with oracle regularization, and well exceeding comparable greedy estimation methods.

Keywords:
Convex optimization ; Covariance fitting ; Group sparsity ; Group-LASSO ; Hyperparameter-free ; SPICE
ISSN:
0165-1684
LUP-ID:
ef7c6723-9eea-4b0e-aeca-9d00be69fc64 | Link: https://lup.lub.lu.se/record/ef7c6723-9eea-4b0e-aeca-9d00be69fc64 | Statistics

Cite this