Continuous action set learning automata for stochastic Optimization

Santharam, G and Sastry, PS and Thathachar, MAL (1994) Continuous action set learning automata for stochastic Optimization. In: Journal of the Franklin Institute, 331 (5). pp. 607-628.

PDF Continuous_Action-201.pdf Restricted to Registered users only Download (1MB) | Request a copy

Abstract

The problem of optimization with noisy measurements is common in many areas of engineering. The only available information is the noise-corrupted value of the objective function at any chosen point in the parameter space. One well-known method for solving this problem is the stochastic approximation procedure. In this paper we consider an adaptive random search procedure, based on the reinforcement-learning paradigm. The learning model presented here generalizes the traditional model of a learning automaton [Narendra and Thathachar, Learning Automata: An Introduction, Prentice Hall, Englewood Cliffs, 1989]. This procedure requires a lesser number of function evaluations at each step compared to the stochastic approximation. The convergence properties of the algorithm are theoretically investigated. Simulation results are presented to show the efficacy of the learning method.

Item Type:	Journal Article
Publication:	Journal of the Franklin Institute
Publisher:	Elsevier
Additional Information:	The copyright of this article belongs to Elsevier.
Department/Centre:	Division of Electrical Sciences > Electrical Engineering
Date Deposited:	25 Aug 2008
Last Modified:	19 Sep 2010 04:30
URI:	http://eprints.iisc.ac.in/id/eprint/8043

Actions (login required)

View Item