Course for international guest/part time students
- Faculty
- Faculty of Science
- Organization
- TTK Department of Probability Theory and Statistics
- Code
- difoml1u0um17em
- Title
- Markov chains in discrete and continuous time (l)
- Usual semester
- Autumn
- Published semester
- 2026/27/1
- ECTS
- 3
- Language
- en
- Learning outcomes
- Knowledge: getting familiar with the modern notions and methods of Markov chains Ability: to understand and use of Markov chains Attitude: the need to deepen the applied mathematical knowledge, to gain new applied mathematical skills, to develop competencies. The aim to apply the mathematical knowledge for a wide range of problems Autonomy and Responsibility: based on the gained knowledge in Markov chains, the students are able to decide which tools are the most suitable to solve applied problems
- Course content
- Stochastic processes: Markov property, strong Markov property, homogeneity. Markov chains with discrete parameters: definition, transition matrix, classification of states. Period, recurrence. Convergence of transition probabilities. Stationary distribution. Central limit theorem for irreducible, positive recurrent Markov chain. Transition probabilities with taboo states. Regular measure, Doeblin's quotient theorem. Inverted Markov chain. Absorption probabilities. Perron-Frobenius theorems. Markov chains with continuous parameters: definition, transition matrix, derivative at zero, infinitesimal generator. Examples: Poisson process, birth and death processes.
- Assessment method
- oral exam
- Bibliography
- lecture notes