RO  EN
IMCS/Publications/BASM/Issues/BASM n2(108)-n3(109), 2025/

Temporal Analysis of Hidden and Standard Markov Processes with Final Sequences of States

Authors: Lazari Alexandru
Keywords: Markov Process, Hidden Markov Model, Final Sequence of States, Evolution Time, Total Alert Time, Homogeneous Linear Recurrence

Abstract

This research is focused on temporal analysis of hidden and standard Markov processes with final sequences of states and the related games. Initially, the stochastic systems with final sequences of states are considered and enhanced me\-thods for determining the distributions of the evolution time and the game duration are proposed. These approaches are extended later for the hidden Markov models with final sequences of observable states. Additionally, the definition of the total alert time is generalized for the hidden and standard Markov processes and the developed numerical algorithms for the evolution time are adapted to cover also the computation of distribution of the total alert time. For both, hidden and standard Markov processes, and for the associated games, it is shown that the evolution time, the total alert time and the game duration have homogeneous linear recurrent distributions, which allows us to easily evaluate their main probabilistic characteristics, using the previously developed polynomial algorithms.

Institute of Mathematics and Computer Science,
Moldova State University,
5 Academiei str., Chisinau, MD-2028, Moldova.
E-mail:

DOI

https://doi.org/10.56415/basm.y2025.i2-3.p74

Fulltext

Adobe PDF document0.32 Mb