VVZ API is not affiliated with ETH Zurich. Data might be outdated or incorrect. Please view the official ETHZ Vorlesungsverzeichnis for binding information.

252-0055-00L 4 Credits BSC D-INFK
You're viewing possible stale or outdated data. Please check the latest semester for more up-to-date information.

Information Theory

Informationstheorie

Lecturers & Examiners: Prof. em. Dr. Joachim M. Buhmann, Dr. Luis Haug
VVZ CR 3.5

Last Updated: 2026-02-05 15:41:30

Abstract

The course covers the fundamental concepts of Shannon's information theory.The most important topics are: Entropy, information, data compression, channel coding, codes.

Objective

The goal of the course is to familiarize with the theoretical fundamentals of information theory and to illustrate the practical use of the theory with the help of selected examples of data compression and coding.

Content

Introduction and motivation, basics of probability theory, entropy and information, Kraft inequality, bounds on expected length of source codes, Huffman coding, asymptotic equipartition property and typical sequences, Shannon's source coding theorem, channel capacity and channel coding, Shannon's noisy channel coding theorem, examples

Resources

Literature

T. Cover, J. Thomas: Elements of Information Theory, John Wiley, 1991. D. MacKay, Information Theory, Inference and Learning Algorithms, Cambridge University Press, 2003. C. Shannon, The Mathematical Theory of Communication, 1948.

Learning Materials (Links)

General Information

Language
German
Levels
BSC
Frequency
Yearly recurring

Examination

Type
session examination
Mode
written 120 minutes
Aids
Keine!

Course Components

Type Title Time & Place Hours
lecture Informationstheorie
  • Thu 13:15-15:00 (ML F 36)
  • 20.02 Date 13:15-15:00 (CAB G 52)
  • 27.02 Date 13:15-15:00 (CAB G 52)
2 h weekly
exercise Informationstheorie
  • Wed 15:15-17:00 (HG D 7.1)
  • 19.02 Date 15:15-17:00 (HG D 3.3)
1 h weekly

Offered In

  • Computer Science Bachelor
    • Electives (Students may also choose courses from the Master's program in Computer Science. It is their responsibility to make sure that they meet the requirements and conditions for these courses.)