Heuristic Search Value Iteration for POMDPs

Heuristic Search Value Iteration for POMDPs (2004)

Cached

Download Links

Other Repositories/Bibliography

DBLP

by Trey Smith , Reid Simmons

Citations:

66 - 1 self

BibTeX

@MISC{Smith04heuristicsearch,
    author = {Trey Smith and Reid Simmons},
    title = {Heuristic Search Value Iteration for POMDPs},
    year = {2004}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

We present a novel POMDP planning algorithm called heuristic search value iteration (HSVI). HSVI is

Citations

472	Learning to act using real-time dynamic programming - Barto, Bradtke, et al. - 1995
285	The Optimal Control of Partially Observable Markov Processes - Sondik - 1971
280	Learning in embedded systems - Kaelbling - 1993
185	Point-based value iteration: An anytime algorithm for POMDPs - Pineau, Gordon, et al.
146	SPUDD: Stochastic planning using decision diagrams - Hoey, St-Aubin, et al. - 1999
144	Incremental pruning: a simple, fast, exact method for partially observable Markov decision processes - Cassandra, Littman, et al. - 1997
114	A heuristic search algorithm that finds solutions with loops - Hansen, Zilberstein, et al.
105	Value-function approximations for partially observable markov decision processes - Hauskrecht - 2000
99	Optimal control of Markov decision processes with incomplete state estimation - Astrom - 1965
51	A heuristic variable grid solution method of POMDPs - Brafman - 1997
47	Speeding up the convergence of value iteration in partially observable Markov decision processes - Zhang, Zhang
37	A (revised) survey of approximate methods for solving pomdps - Aberdeen - 2003
34	Incremental methods for computing bounds in partially observable Markov decision processes - Hauskrecht - 1997
27	A fast heuristic algorithm for decision-theoretic planning. Masters Thesis. The Hong-Kong - Poon - 2001
25	Integrating planning and execution in stochastic domains - Dearden, Boutilier - 1994
20	BI-POMDP: Bounded, incremental, partially-observable Markovmodel planning - Washington - 1997
15	Structured reachability analysis for Markov decision processes - Boutilier, Brafman, et al. - 1998
7	Solving large POMDPs by real time dynamic programming - Geffner, Bonet - 1998
1	Heuristic search value iteration for POMDPs: Detailed theory and results - Smith, Simmons - 2004