IMCS/Publications/BASM/Issues/BASM n.1 (65), 2011/

Algorithms for Determining the State-Time Probabilities and the Limit Matrix in Markov Chains

Authors: Lozovanu Dmitrii, Stefan Pickl


New calculation procedures for finding the probabilities of state transitions of the system in Markov chains based on dynamic programming are developed and polynomial time algorithms for determining the limit state matrix in such processes are proposed. Computational complexity aspects and possible applications of the proposed algorithms for the stochastic optimization problems are characterized.

E-mail: ,


Adobe PDF document0.26 Mb