ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Improved Hessian estimation for adaptive random directions stochastic approximation

Reddy, D Sai Koti and Prashanth, L A and Bhatnagar, Shalabh (2017) Improved Hessian estimation for adaptive random directions stochastic approximation. In: 55th IEEE Conference on Decision and Control (CDC), DEC 12-14, 2016, Las Vegas, NV, pp. 3682-3687.

[img] PDF
2016_Iee_55th_con_Dec_Con_3682.pdf - Published Version
Restricted to Registered users only

Download (363kB) | Request a copy
Official URL: http://dx.doi.org/ 10.1109/CDC.2016.7798823

Abstract

We propose an improved Hessian estimation scheme for the second-order random directions stochastic approximation (2RDSA) algorithm I]. The proposed scheme, inspired by 121, reduces the error in the Hessian estimate by (i) incorporating a zero-mean feedback term; and (ii) optimizing the step-sizes used in the Hessian recursion of 2RDSA. We prove that 2RDSA with our Hessian improvement scheme (2RDSAIII) converges asymptotically to the true Hessian. The advantage with 2RDSA-III is that it requires only 75% of the simulation cost per-iteration for 2SPSA with improved Hessian estimation (2SPSA-IH) 2]. Numerical experiments show that 2RDSA-IH outperforms both 2SPSA-Ill and 2RDSA without the improved hessian estimation scheme.

Item Type: Conference Proceedings
Additional Information: 55th IEEE Conference on Decision and Control (CDC), Las Vegas, NV, DEC 12-14, 2016
Department/Centre: Division of Electrical Sciences > Computer Science & Automation
Depositing User: Id for Latest eprints
Date Deposited: 10 Jun 2017 04:41
Last Modified: 10 Jun 2017 04:41
URI: http://eprints.iisc.ac.in/id/eprint/57204

Actions (login required)

View Item View Item