CONVERGENCE RATE ANALYSIS OF SMOOTHED LASSO

Mukherjee, Subhadip and Seelamantula, Chandra Sekhar (2016) CONVERGENCE RATE ANALYSIS OF SMOOTHED LASSO. In: 22nd National Conference on Communications (NCC), MAR 04-06, 2016, Guwahati, INDIA.

PDF 2016_Twe_Sec_Nat_Con_com.pdf - Published Version Restricted to Registered users only Download (751kB) | Request a copy

Abstract

The LASSO regression has been studied extensively in the statistics and signal processing community, especially in the realm of sparse parameter estimation from linear measurements. We analyze the convergence rate of a first-order method applied on a smooth, strictly convex, and parametric upper bound on the LASSO objective function. The upper bound approaches the true non-smooth objective as the parameter tends to infinity. We show that a gradient-based algorithm, applied to minimize the smooth upper bound, yields a convergence rate of O (1/K), where K denotes the number of iterations performed. The analysis also reveals the optimum value of the parameter that achieves a desired prediction accuracy, provided that the total number of iterations is decided a priori. The convergence rate of the proposed algorithm and the amount of computation required in each iteration are same as that of the iterative soft thresholding technique. However, the proposed algorithm does not involve any thresholding operation. The performance of the proposed technique, referred to as smoothed LASSO, is validated on synthesized signals. We also deploy smoothed LASSO for estimating an image from its blurred and noisy measurement, and compare the performance with the fast iterative shrinkage thresholding algorithm for a fixed run-time budget, in terms of the reconstruction peak signal-to-noise ratio and structural similarity index.

Item Type:	Conference Proceedings
Additional Information:	Copy right for this article belongs to the IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	04 Jan 2017 05:04
Last Modified:	04 Jan 2017 05:04
URI:	http://eprints.iisc.ac.in/id/eprint/55723

Actions (login required)

View Item