DCC 831/030/049 – Information Theory (2024/1)

General Information

  • Time and place: Tuesdays and Thursdays, 2:55 pm - 4:35 pm, in Auditorium B301 in CAD 3.

  • Syllabus: Important information about the course, including textbook, grading, and program : [pdf]

  • Calendar of activities: Plan of lectures, due dates for problem sets and exams (last updated on 2024-07-17): [pdf]

  • FAQ: Answers to frequently asked questions about my didactic principles can be found here.

Supporting Material

UnitSlidesProblem sets
01B - Discrete Probability (Supplemental material in Portuguese).[pdf][pdf]
01A - Introduction to Information Theory.[pdf][—]
02 - Probability, Entropy, and Inference. More about Inference.[pdf][pdf]
03 - The Source Coding Theorem.[pdf][pdf]
04 - Symbol codes.[pdf][pdf]
05 - Stream codes.[pdf][pdf]
06 - Dependent Random Variables.[pdf][pdf]
07 - Communication Over a Noisy Channel.[pdf][pdf]
08 - Kolmogorov Complexity and Universal Probability.[pdf][pdf]
09 - Decision Theory.[pdf][pdf]
10 - Advanced Information Measures.[pdf][pdf]

Supplemental Material

In-class activity: Communication over a noisy channel as inference [pdf]