Abstract:
This paper describes a suite of MATLAB® routines devised to provide an approximately optimal solution to an infinite-horizon stochastic optimal control problem. The suite is an updated version of that described in [1] and [2]. Its routines implement a policy improvement algorithm to optimise a Markov decision chain approximating the original control problem, as described in [3].