RO  EN
IMI/Publicaţii/BASM/Ediţii/BASM n.1(86), 2018/

An Approach for Determining the Optimal Strategies for an Average Markov Decision Problem with Finite State and Action Spaces

Authors: Lozovanu Dmitrii, Stefan Pickl

Abstract

The average reward Markov decision problem with finite state and action spaces is considered and an approach for determining the optimal pure and mixed stationary strategies for this problem is proposed. We show that the considered problem can be formulated in terms of stationary strategies where the objective function is quasi-monotonic (i.\,e. it is quasi-convex and quasi-concave) on the feasible set of stationary strategies. Using such a quasi-monotonic programming model with linear constraints we ground algorithms for determining the optimal pure and mixed stationary strategies for the average Markov decision problem.

Dmitrii Lozovanu
Institute of Mathematics and Computer Science
5 Academiei str., Chisinau, MD−2028
Moldova
E-mail:

Stefan Pickl
Institute for Theoretical Computer Science
Mathematics and Operations Research
Universit¨ at der Bundeswehr
München, 85577 Neubiberg-München
Germany,
E-mail:



Fulltext

Adobe PDF document – 0.16 Mb