ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization

Bhatnagar, Shalabh (2007) Adaptive Newton-based multivariate smoothed functional algorithms for simulation optimization. In: ACM Transactions on Modeling and Computer Simulation, 18 (1). 2:1-2:35.

[img] PDF
Restricted to Registered users only

Download (331kB) | Request a copy


In this article, we present three smoothed functional (SF) algorithms for simulation optimization.While one of these estimates only the gradient by using a finite difference approximation with two parallel simulations, the other two are adaptive Newton-based stochastic approximation algorithms that estimate both the gradient and Hessian. One of the Newton-based algorithms uses only one simulation and has a one-sided estimate in both the gradient and Hessian, while the other uses two-sided estimates in both quantities and requires two simulations. For obtaining gradient and Hessian estimates, we perturb each parameter component randomly using independent and identically distributed (i.i.d) Gaussian random variates. The earlier SF algorithms in the literature only estimate the gradient of the objective function. Using similar techniques, we derive two unbiased SF-based estimators for the Hessian and develop suitable three-timescale stochastic approximation procedures for simulation optimization. We present a detailed convergence analysis of our algorithms and show numerical experiments with parameters of dimension 50 on a setting involving a network of M/G/1 queues with feedback. We compare the performance of our algorithms with related algorithms in the literature. While our two-simulation Newton-based algorithm shows the best results overall, our one-simulation algorithm shows better performance compared to other one-simulation algorithms.

Item Type: Journal Article
Publication: ACM Transactions on Modeling and Computer Simulation
Publisher: ACM
Additional Information: Copyright of this artcle belongs to ACM.
Keywords: Algorithms;Performance;Theory;Smoothed functional algorithms;three-timescale stochastic approximation;simulation optimization;Gaussian perturbations;Newton-based algorithms.
Department/Centre: Division of Electrical Sciences > Computer Science & Automation
Date Deposited: 26 Aug 2008
Last Modified: 19 Sep 2010 04:49
URI: http://eprints.iisc.ac.in/id/eprint/15635

Actions (login required)

View Item View Item