Bhatnagar, S and Borkar, VS (1995) A convex analytic framework for ergodic control of semi-Markov processes. In: Mathematics of Operations Research, 20 (4). pp. 923-936.
Full text not available from this repository. (Request a copy)Abstract
The ergodic control problem for semi-Markov processes is reformulated as an optimization problem over the set of suitably defined `ergodic occupation measures'. This set is shown to be closed and convex, with its extreme points corresponding to stationary strategies. This leads to the existence of optimal stationary strategies under additional hypotheses. A pathwise analysis of the joint empirical occupation measures of the state and control processes shows that this optimality is in the strong (i.e., almost sure) sense. (15 refs.)
| Item Type: | Journal Article |
|---|---|
| Publication: | Mathematics of Operations Research |
| Publisher: | Inst. Oper. Res. & Manage. Sci |
| Additional Information: | Copyright of this article belongs to Inst. Oper. Res. & Manage. Sci. |
| Department/Centre: | Division of Electrical Sciences > Electrical Engineering |
| Date Deposited: | 15 Sep 2006 |
| Last Modified: | 27 Aug 2008 12:22 |
| URI: | http://eprints.iisc.ac.in/id/eprint/8625 |
Actions (login required)
 |
View Item |
