ePrints@IIScePrints@IISc Home | About | Browse | Latest Additions | Advanced Search | Contact | Help

Controlled Markov chains with constraints

Borkar, VS (1990) Controlled Markov chains with constraints. In: Sadhana, 15 (4-5). pp. 405-413.

[img] PDF

Download (464kB)


We consider the ergodic control of a Markov chain on a countable state space with a compact action space in presence of finitely many (say, m) ergodic constraints. Under a condition on the cost functions that penalizes instability, the existence of an optimal stable stationary strategy randomized at a maximum of m states is established using convex analytic arguments.

Item Type: Journal Article
Publication: Sadhana
Publisher: Indian Academy of Sciences
Additional Information: Copyright of this article belongs to Indian Academy of Sciences.
Keywords: Controlled Markov chains; ergodic control; control under constraints; optimal strategy; stationary strategy.
Department/Centre: Division of Electrical Sciences > Electrical Engineering
Date Deposited: 04 Mar 2008
Last Modified: 28 Feb 2019 05:04
URI: http://eprints.iisc.ac.in/id/eprint/13299

Actions (login required)

View Item View Item