VVZ API is not affiliated with ETH Zurich. Data might be outdated or incorrect. Please view the official ETHZ Vorlesungsverzeichnis for binding information.
Mathematics of Information
Last Updated: 2026-02-05 16:23:00
Abstract
The class focuses on mathematical aspects of1. Information science: Sampling theorems, frame theory, compressed sensing, sparsity, super-resolution, spectrum-blind sampling, subspace algorithms, dimensionality reduction2. Learning theory: Approximation theory, greedy algorithms, uniform laws of large numbers, Rademacher complexity, Vapnik-Chervonenkis dimension
Objective
The aim of the class is to familiarize the students with the most commonly used mathematical theories in data science, high-dimensional data analysis, and learning theory. The class consists of the lecture and exercise sessions with homework problems.
Content
Mathematics of Information 1. Signal representations: Frame theory, wavelets, Gabor expansions, sampling theorems, density theorems 2. Sparsity and compressed sensing: Sparse linear models, uncertainty relations in sparse signal recovery, super-resolution, spectrum-blind sampling, subspace algorithms (ESPRIT), estimation in the high-dimensional noisy case, Lasso 3. Dimensionality reduction: Random projections, the Johnson-Lindenstrauss Lemma Mathematics of Learning 4. Approximation theory: Nonlinear approximation theory, best M-term approximation, greedy algorithms, fundamental limits on compressibility of signal classes, Kolmogorov-Tikhomirov epsilon-entropy of signal classes, optimal compression of signal classes 5. Uniform laws of large numbers: Rademacher complexity, Vapnik-Chervonenkis dimension, classes with polynomial discrimination
Resources
Lecture Notes
Detailed lecture notes will be provided at the beginning of the semester.
Learning Materials (Links)
- Main link
- Course Website
General Information
- Language
- English
- Levels
- DR , MSC
- Frequency
- Yearly recurring
Examination
- Type
- session examination
- Mode
- written 180 minutes
- Aids
- 10 handwritten or printed A4 pages summary (or 5 A4 pages on both sides). Electronic devices (laptops, calculators, cellphones, etc...) are not allowed.
Course Components
| Type | Title | Time & Place | Hours |
|---|---|---|---|
| lecture | Mathematics of Information |
|
3 h weekly |
| exercise | Mathematics of Information |
|
2 h weekly |
| independent project | Mathematics of Information | No time listed | 2 h weekly |
Offered In
-
-
Electives (In the ‘electives’ subcategory, at least two course units must be successfully completed.)
-
-
-
-
-
Electives (For the Master's degree in Applied Mathematics the following additional condition (not manifest in myStudies) must be obeyed: At least 15 of the required 28 credits from core courses and electives must be acquired in areas of applied mathematics and further application-oriented fields.)
-
-
-
-
-
Communication (The core courses and specialization courses below are a selection for students who wish to specialize in the area of "Communication", see . The individual study plan is subject to the tutor's approval.)
-
Specialization Courses (These specialization courses are particularly recommended for the area of "Communication", but you are free to choose courses from any other field in agreement with your tutor. A minimum of 40 credits must be obtained from specialization courses during the Master's Programme.)
-
-
Signal Processing and Machine Learning (The core courses and specialization courses below are a selection for students who wish to specialize in the area of "Signal Processing and Machine Learning ", see . The individual study plan is subject to the tutor's approval.)
-
Core Courses (These core courses are particularly recommended for the field of "Signal Processing and Machine Learning". You may choose core courses form other fields in agreement with your tutor. A minimum of 24 credits must be obtained from core courses during the MSc EEIT.)
-
-
-
-
Major Courses (A total of 42 CP must be achieved form courses during the Master Program. The individual study plan is subject to the tutor's approval.)
-
-
Recommended Subjects (These courses are recommended, but you are free to choose courses from any other special field. Please consult your tutor.)
-
-
-
-
-
-
Statistics Master (The following courses belong to the curriculum of the Master's Programme in Statistics. The corresponding credits do not count as external credits even for course units where an enrolment at ETH Zurich is not possible.)
-
-
-
General Electives (Students may choose General Electives from the entire course programme of ETH Zurich - with the following restrictions: courses that belong to the first or second year of a Bachelor curriculum at ETH Zurich as well as courses from GESS "Science in Perspective" are not eligible here. The following courses are explicitly recommended to physics students by their lecturers. (Courses in this list may be assigned to the category "General Electives" directly in myStudies. For the category assignment of other eligible courses keep the choice "no category" and take contact with the Study Administration ( ) after having received the credits.))
-
-
-
Doctorate Information Technology and Electrical Engineering (More Information at: )
-
Subject Specialisation (A minimum of 12 ECTS credit points must be obtained during doctoral studies (also see other categories for details) The courses on offer below are but a small selection out of a much larger available number of courses. Please discuss your course selection with your PhD supervisor.)
-
-
-
-
-
-
-
Electives (This is a selection of courses particularly suitable for the MSc QE. In agreement with the tutor, students may choose other courses from the ETH course catalogue.)
-