VVZ API is not affiliated with ETH Zurich. Data might be outdated or incorrect. Please view the official ETHZ Vorlesungsverzeichnis for binding information.

252-0055-00L 4 Credits BSC D-INFK
You're viewing possible stale or outdated data. Please check the latest semester for more up-to-date information.

Information Theory

Informationstheorie

Lecturers & Examiners: Prof. Dr. Markus Gross
VVZ CR 3.5

Last Updated: 2026-02-05 15:14:28

Abstract

The course covers the fundamental concepts of (Shannon's) information theory. Specific topics include:Introduction and fundamentals, stochastic processes, entropy,information sources, coding of discrete sources, discrete, noisychannels, Shannon's channel coding theorem, channel coding,linear and cyclic codes, Lempel-Ziv data compression, case studies.

Objective

The goal of the course is to familiarize with the theoretical fundamentals of information theory and to illustrate the practical use of the theory with the help of selected examples of data coding and compression. Several algorithms are implemented for learning and demonstration purposes.

Content

Introduction and fundamentals, stochastic processes, entropy, information sources, coding of discrete sources, discrete, noisy channels, Shannon's channel coding theorem, channel coding, linear and cyclic codes, Lempel-Ziv data compression, case studies.

Resources

Lecture Notes

U. Maurer: Skript zur Vorlesung Information undKommunikation (in German), WS 2003/2004.

Literature

- H. Klimant, R. Piotraschke, D. Schönfeld: Informations- und Kommunikationstheorie, 2.Auflage, Teubner, 2003. - T. Cover, J. Thomas: Elements of Information Theory, John Wiley, 1991. - F. Reza: An introduction to Information Theory, Dover Publications, 1994. - H.D. Lüke: Signalübertragung, Springer, 6. Auflage, 1995. - T. Bell, J. Cleary, I. Witten: Text Compression, Prentice Hall, 1990. - A. Oppenheim, R. Schafer, J. Buck: Zeitdiskrete Signalverarbeitung, 2. Auflage Pearson, 2004.

General Information

Language
German
Levels
BSC
Frequency
Yearly recurring

Examination

Type
session examination
Mode
written 120 minutes
Aids
Keine Hilfsmittel

Course Components

Type Title Time & Place Hours
lecture Informationstheorie
  • Mon 08:15-10:00 (HG E 5)
2 h weekly
exercise Informationstheorie
  • Thu 08:15-09:00 (CAB G 57)
  • Thu 08:15-09:00 (IFW A 32.1)
  • Thu 08:15-09:00 (IFW A 34)
  • Thu 08:15-09:00 (IFW C 42)
  • Thu 08:15-09:00 (ML E 12)
  • Thu 08:15-09:00 (ML H 37.1)
  • Thu 08:15-09:00 (ML J 34.1)
  • Thu 14:15-15:00 (IFW A 34)
1 h weekly

Offered In