MDPtoolbox: Markov Decision Processes Toolbox

The Markov Decision Processes (MDP) toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: finite horizon, value iteration, policy iteration, linear programming algorithms with some variants and also proposes some functions related to Reinforcement Learning.

Version: 4.0.4
Depends: Matrix, linprog
Published: 2026-08-31
DOI: 10.32614/CRAN.package.MDPtoolbox
Author: Iadine Chades [aut], Guillaume Chapron [aut, cre], Marie-Josee Cros [aut], Frederick Garcia [aut], Regis Sabbadin [aut]
Maintainer: Guillaume Chapron <gchapron at carnivoreconservation.org>
License: BSD_3_clause + file LICENSE
NeedsCompilation: no
CRAN checks: MDPtoolbox results

Documentation:

Reference manual: MDPtoolbox.html , MDPtoolbox.pdf

Downloads:

Package source: MDPtoolbox_4.0.4.tar.gz
Windows binaries: r-devel: MDPtoolbox_4.0.3.zip, r-release: MDPtoolbox_4.0.3.zip, r-oldrel: MDPtoolbox_4.0.3.zip
macOS binaries: r-release (arm64): MDPtoolbox_4.0.3.tgz, r-oldrel (arm64): MDPtoolbox_4.0.3.tgz, r-release (x86_64): MDPtoolbox_4.0.4.tgz, r-oldrel (x86_64): MDPtoolbox_4.0.4.tgz
Old sources: MDPtoolbox archive

Linking:

Please use the canonical form https://CRAN.R-project.org/package=MDPtoolbox to link to this page.