KMI/TIK Information Theory and Coding

Lecturer: Radim Bělohlávek
Lecture: 2 hours/week + exercise 1 hour/week
Credits: 4
Winter semester
Form of course completion: credit course, exam

The course provides introduction to information theory and its applications, and coding.

• Entropy, conditional and joint entropy, mutual information.
• Basic inequalities of information theory.
• AEP (asymptotic equipartition property) and its applications.
• Selected applications of information theory.
• Basic concepts of coding.
• Optimal codes.
• Error correcting codes (basic concepts, block codes, linear codes).