Course for international guest/part time students

Faculty
Faculty of Science
Organization
TTK Department of Probability Theory and Statistics
Code
bevinf1u0um17em
Title
Introduction to information theory (l)
Usual semester
Spring
Published semester
2025/26/2
ECTS
3
Language
en
Learning outcomes
Knowledge: getting familiar with the modern notions of information theory Ability: to understand and use information theory Attitude: the need to extend the mathematical knowledge, to gain new analytic and applied  programming skills Autonomy and Responsibility: based on the gained knowledge in information theory, the students are able to decide which tools are the most suitable to solve applied problems
Course content
Source coding with variable length and block codes. Entropy and its formal properties. I-divergence and its formal properties. Typical series. The concept of a noisy channel, channel coding theorems. Channel capacity and its calculation methods. Source and channel coding with linear codes. Multi-user communication systems: unique coding of correlated sources. The channel with additive Gaussian noise.
Assessment method
exam

Programmes of the course

Title (code) Lang. Level Mandatory Year ...
Alkalmazott matematikus MSc - Sztochasztika szakirány (TTK-ALKMAT-SZTOCHASZTIKA-NMHU) hu 7
Applied Mathematician (TTK-ALKMAT-NMHU) hu 7 2/2
Applied Mathematician (TTK-ALKMAT-NMEN) en 7
Erasmus Programme (TTK-ERASMUS-NXXX) en Mandatory
Mathematician (TTK-MATEMAT-NMHU) hu 7 1/2
Mathematician (TTK-MATEMAT-NMEN) en 7 1/2
Back