VVZ API is not affiliated with ETH Zurich. Data might be outdated or incorrect. Please view the official ETHZ Vorlesungsverzeichnis for binding information.
Information Theory II
Last Updated: 2026-02-05 15:41:55
Abstract
This course builds on Information Theory I. It introduces additional topics in single-user communication, connections between Information Theory and Statistics, and Network Information Theory.
Objective
The course has two objectives: to introduce the students to the key information theoretic results that underlay the design of communication systems and to equip the students with the tools that are needed to conduct research in Information Theory.
Content
Differential entropy, maximum entropy, the Gaussian channel and water filling, the entropy-power inequality, Sanov's Theorem, Fisher information, the broadcast channel, the multiple-access channel, Slepian-Wolf coding, and the Gelfand-Pinsker problem.
Resources
Lecture Notes
n/a
Literature
T.M. Cover and J.A. Thomas, Elements of Information Theory, second edition, Wiley 2006
Learning Materials (Links)
- Main link
- Information
General Information
- Language
- English
- Levels
- BSC , DR , MSC
- Frequency
- Every two years
Examination
- Type
- session examination
- Mode
- oral 30 minutes
Course Components
| Type | Title | Time & Place | Hours |
|---|---|---|---|
| lecture |
Information Theory II
Does not take place this semester.
|
No time listed | 2 h weekly |
| exercise |
Information Theory II
Does not take place this semester.
|
No time listed | 2 h weekly |
Offered In
-
-
-
Electives (In the ‘electives’ subcategory, at least two course units must be successfully completed.)
-
-
-
-
Electives (In the ‘electives’ subcategory, at least two course units must be successfully completed.)
-
-
-
Application Area (Only necessary and eligible for the Master degree in Applied Mathematics. One of the application areas specified must be selected for the category Application Area for the Master degree in Applied Mathematics. At least 8 credits are required in the chosen application area.)
-
-
-
-
Communication (The core courses and specialization courses below are a selection for students who wish to specialize in the area of "Communication", see . The individual study plan is subject to the tutor's approval.)
-
Core Courses (These core courses are particularly recommended for the field of "Communication". You may choose core courses form other fields in agreement with your tutor. A minimum of 24 credits must be obtained from core courses during the MSc EEIT.)
-
-
Computers and Networks (The core courses and specialization courses below are a selection for students who wish to specialize in the area of "Computers and Networks", see . The individual study plan is subject to the tutor's approval.)
-
Specialization Courses (These specialization courses are particularly recommended for the area of "Computers and Networks", but you are free to choose courses from any other field in agreement with your tutor. A minimum of 40 credits must be obtained from specialization courses during the Master's Programme.)
-
-
-
-
Major Courses (A total of 42 CP must be achieved form courses during the Master Program. The individual study plan is subject to the tutor's approval.)
-
-
Core Subjects (These core subjects are particularly recommended for the field of "Communication".)
-
-
-
Recommended Subjects (These courses are recommended, but you are free to choose courses from any other special field. Please consult your tutor.)
-
-
-
-
-
Doctoral Dep. of Information Technology and Electrical Engineering (More Information at: )
-
Doctoral and Post-Doctoral Courses (A minimum of 12 ECTS credit points must be obtained during doctoral studies. The courses on offer below are but a small selection out of a much larger available number of courses. Please discuss your course selection with your PhD supervisor.)
-
-
-