VVZ API is not affiliated with ETH Zurich. Data might be outdated or incorrect. Please view the official ETHZ Vorlesungsverzeichnis for binding information.
Information Theory I
Last Updated: 2026-06-03 00:07:36
Abstract
This course covers the basic concepts of information theory and of communication theory. Topics covered include the entropy rate of a source, mutual information, typical sequences, the asymptotic equi-partition property, Huffman coding, channel capacity, the channel coding theorem, the source-channel separation theorem, and feedback capacity.
Objective
The fundamentals of Information Theory including Shannon's source coding and channel coding theorems
Content
The entropy rate of a source, Typical sequences, the asymptotic equi-partition property, the source coding theorem, Huffman coding, Arithmetic coding, channel capacity, the channel coding theorem, the source-channel separation theorem, feedback capacity
Resources
Literature
T.M. Cover and J. Thomas, Elements of Information Theory (second edition)
General Information
- Language
- English
- Levels
- BSC , DR , MSC
- Frequency
- Yearly recurring
Examination
- Type
- session examination
- Mode
- written 180 minutes
- Aids
- Hardcopies of the course textbook, course handouts, and personal notes.
Course Components
| Type | Title | Time & Place | Hours |
|---|---|---|---|
| lecture with exercise | Information Theory I | No time listed | 4 h weekly |
Offered In
-
-
Electives (In the ‘electives’ subcategory, at least two course units must be successfully completed.)
-
-
-
Electives (In the ‘electives’ subcategory, at least two course units must be successfully completed. All courses listed as core courses (not electives) for one of the following ETH MSc programmes, MSc Statistics, MSc Physics, MSc Computer Science, MSc (Applied) Mathematics, MSc Neural Systems and Computation, MSc Robotics, Systems, and Control, MSc Data Science, MSc Electrical Engineering and Information Technology, can be taken as an elective course in the MSc CSE without prior permission.)
-
-
-
-
-
Application Area (Only necessary and eligible for the Master degree in Applied Mathematics. One of the application areas specified must be selected for the category Application Area for the Master degree in Applied Mathematics. At least 8 credits are required in the chosen application area. Credits from other application areas cannot be recognised for further application areas.)
-
Electives (For the Master's degree in Applied Mathematics the following additional condition (not manifest in myStudies) must be obeyed: At least 14 of the required 26 credits from core courses and electives must be acquired in areas of applied mathematics and further application-oriented fields.)
-
-
-
-
-
Track: Signal Processing and Machine Learning (The core courses and specialisation courses below are a selection for students who wish to specialise in the area of "Signal Processing and Machine Learning ", see . The individual study plan is subject to the tutor's approval.)
-
Core Courses (These core courses are particularly recommended for the field of "Signal Processing and Machine Learning". You may choose core courses form other fields in agreement with your tutor. A minimum of 24 credits must be obtained from core courses during the MSc EEIT.)
-
Specialisation Courses (These specialisation courses are particularly recommended for the area of "Signal Processing and Machine Learning", but you are free to choose courses from any other field in agreement with your tutor. A minimum of 40 credits must be obtained from specialisation courses during the MSc EEIT.)
-
-
Track: Communication (The core courses and specialisation courses below are a selection for students who wish to specialise in the area of "Communication", see . The individual study plan is subject to the tutor's approval.)
-
Core Courses (These core courses are particularly recommended for the field of "Communication". You may choose core courses form other fields in agreement with your tutor. A minimum of 24 credits must be obtained from core courses during the MSc EEIT.)
-
-
-
-
Doctorate Mathematics (More Information at: )
-
Subject Specialisation (The list of courses eligible for doctoral students is published each semester in the newsletter of the ZGSM.)
-
Graduate School (Official website of the Zurich Graduate School in Mathematics: )
-
-
-
Doctorate Information Technology and Electrical Engineering (A minimum of 12 ECTS credit points must be obtained during doctoral studies (also see sub-categories for details) More Information at )
-
Subject Specialisation (The courses on offer below are only a small selection out of a much larger available number of courses. Please discuss your course selection with your PhD supervisor.)
-
-
-
-
-
Core Courses (A minimum of 24 credits must be obtained from core courses during the MSc QE, course selection is subject to the tutor's agreement.)
-
Engineering Core Courses (These core courses target students with a physics background and all those who need additional engineering foundations.)
-
-
-
-
-
-
Deep Track Courses (At least 20 credits must be completed within the deep track courses. Surplus credit points can be counted towards the electives.)
-
-
Elective Courses Space Communication (These subjects can only be credited as electives.)
-
-
-