DMCA
Optimal Control of Stochastic Hybrid Systems Based on Locally Consistent Markov Decision Processes (2005)
Cached
Download Links
| Citations: | 16 - 7 self |
BibTeX
@MISC{Koutsoukos05optimalcontrol,
author = {Xenofon D. Koutsoukos},
title = {Optimal Control of Stochastic Hybrid Systems Based on Locally Consistent Markov Decision Processes},
year = {2005}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper applies a known approach for approximating controlled stochastic diffusion to hybrid systems. Stochastic hybrid systems are approximated by locally consistent Markov decision processes that preserve local mean and covariance. A randomized switching policy is introduced for approximating the dynamics on the switching boundaries. The validity of the approximation is shown by solving the optimal control problem of minimizing a cost until a target set is reached using dynamic programming. It is shown that using the randomized switching policy, the solution obtained based on the discrete approximation converges to the solution of the original problem.
Keyphrases
stochastic hybrid system optimal control locally consistent markov decision process randomized switching policy local mean dynamic programming original problem discrete approximation converges hybrid system known approach optimal control problem stochastic diffusion switching boundary consistent markov decision
