Information Theory
WMiI UŁ — Master Studies — Spring 2022
Course book
-
Ł. Dębowski. A Short Course in Universal Coding.
(Draft dated July 26, 2024) pdf
Information Theory and Statistics
IPI PAN — PhD Studies — Spring 2014, Spring 2015
Course book
-
Ł. Dębowski, (2013). Information Theory and
Statistics.
Institute of Computer Science, Polish Academy of Sciences. pdf
Course organization: pdf
Slides
- Entropy and information. pdf
- Source coding. pdf
- Stationary ergodic processes. pdf
- Lempel-Ziv code. pdf
- Exponential families. pdf
- Fisher information. pdf
- Kolmogorov complexity. pdf
- Kolmogorov complexity and entropy. pdf
Laboratory projects