Library

The value functions of Markov decision processes

We provide a full characterization of the set of value functions of Markov decision processes.

MathematicsComputer Science
View graphSource

Paper

Similar papers

The Value Function Semi-Algebraic Set in Partially Observable Markov Decision ProcessesRyan Anderson, Guido Montúfar2026 · 0 citations In Library
Markov Decision ProcessesThomas J Sargent, John Stachurski2025 · Cambridge University Press eBooks In Library
A Notation for Markov Decision ProcessesP. Thomas2015 · arXiv.org · 19 citations In Library
Markov Decision Processes‪Nathanaël Fijalkow2026 · Cambridge University Press eBooks In Library
Markov Decision Processes with Incomplete Information and Semi-Uniform Feller Transition ProbabilitiesEugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky2021 · arXiv (Cornell University) · 19 citations In Library
Markov Decision Processes with Incomplete Information and Semiuniform Feller Transition ProbabilitiesEugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky2022 · SIAM Journal on Control and Optimization In Library
The Value Function Polytope in Reinforcement LearningRobert Dadashi, Adrien Ali Taïga, Nicolas Le Roux et al.2019 · International Conference on Machine Learning · 57 citations In Library
Structural Results for Markov Decision ProcessesVikram Krishnamurthy2025 · Cambridge University Press eBooks In Library
A unified view of configurable Markov Decision Processes: Solution concepts, value functions, and operatorsAlberto Maria Metelli2022 · Intelligenza Artificiale · 0 citations In Library
Cascade Markov Decision Processes: Theory and ApplicationsManish Gupta2015 · arXiv.org · 0 citations In Library
© 2026 NYSGPT2525 LLC