Solved problems on Markov chains (Paperback) (ISBN-13: 9786206843801)

Markov chains have many applications, ranging from modeling communication networks to analyzing stock prices, Markov chains can be used in market research studies, they can model the probabilities of claims for insurance, they are used in the fields of public health and medicine, also they are used in ranking of websites in web searches. In general, Markov chains are particularly useful in modeling systems that have a finite number of states and transitions between those states and can be used to analyze and predict the long-term behavior of such systems.Most books on Markov chains are dedicated to reviewing theoretical concepts. The objective of this work is to make available to students and teachers a collection of solved problems on discrete-time Markov chains. In this sense, the work consists of solving 74 problems of different types. In them are obtained the transition probabilities and the transition matrix, the state spaces and the classes of those states, the n-step transition probabilities, the recurrence and transience, the invariant distributions, the mean return time and the convergence to equilibrium.

Author: Alicia Corbacho Sánchez
ISBN-10: 6206843807
ISBN-13: 9786206843801
Publisher: LAP Lambert Academic Publishing
Language: English
Published: 07/01/2025
Pages: 128
Format: Paperback
Weight: 0.40lbs
Size: 9.00h x 6.00w x 0.30d