Adaptive Multivariate Three-Timescale Stochastic Approximation Algorithms for Simulation Based Optimization

Bhatnagar, Shalabh (2005) Adaptive Multivariate Three-Timescale Stochastic Approximation Algorithms for Simulation Based Optimization. In: ACM Transactions on Modeling and Computer Simulation, 15 (1). pp. 74-107.

PDF record111.pdf Restricted to Registered users only Download (258kB) | Request a copy

Abstract

We develop in this article, four adaptive three-timescale stochastic approximation algorithms for simulation optimization that estimate both the gradient and Hessian of average cost at each update epoch. These algorithms use four, three, two, and one simulation(s), respectively, and update the values of the decision variable and Hessian matrix components simultaneously, with estimates based on the simultaneous perturbation methodology. Our algorithms use coupled stochastic recursions that proceed using three different timescales or step-size schedules.We present a detailed convergence analysis of the algorithms and show numerical experiments using all the developed algorithms on a two-node network of M/G/1 queues with feedback for a 50-dimensional parameter vector. We provide comparisons of the performance of these algorithms with two recently developed two-timescale steepest descent simultaneous perturbation analogs that use randomized and deterministic perturbation sequences, respectively.We also present experiments to explore the sensitivity of the algorithms to their associated parameters. The algorithms that use four and three simulations, respectively, perform significantly better than the rest of the algorithms.

Item Type:	Journal Article
Publication:	ACM Transactions on Modeling and Computer Simulation
Publisher:	Association for Computing Machinery(ACM)
Additional Information:	Copyright of this article belongs to Association for Computing Machinery(ACM).
Keywords:	Algorithms;Performance;Theory;Adaptive three-timescale stochastic approximation algorithms;Simulation optimization;Simultaneous perturbation stochastic approximation;Newton-type algorithms
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	02 May 2007
Last Modified:	19 Sep 2010 04:37
URI:	http://eprints.iisc.ac.in/id/eprint/10785

Actions (login required)

View Item