DMCA
Exploiting Structure to Efficiently Solve Large Scale Partially Observable Markov Decision Processes (2005)
| Citations: | 91 - 6 self |
BibTeX
@MISC{Poupart05exploitingstructure,
author = {Pascal Poupart},
title = {Exploiting Structure to Efficiently Solve Large Scale Partially Observable Markov Decision Processes},
year = {2005}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Partially observable Markov decision processes (POMDPs) provide a natural and principled framework to model a wide range of sequential decision making problems under uncertainty. To date, the use of POMDPs in real-world problems has been limited by the poor scalability of existing solution algorithms, which can only solve problems with up to ten thousand states. In fact, the complexity of finding an optimal policy for a finite-horizon discrete POMDP is PSPACE-complete. In practice, two important sources of intractability plague most solution algorithms: large policy spaces and large state spaces. On the other hand,
