VVZ API is not affiliated with ETH Zurich. Data might be outdated or incorrect. Please view the official ETHZ Vorlesungsverzeichnis for binding information.

227-0560-00L 6 Credits MSC D-ITET , D-MATH , D-INFK , D-ERDW , D-MAVT , D-PHYS

Computer Vision and Artificial Intelligence for Autonomous Cars

Lecturers & Examiners: Dr. Christos Sakaridis

Up until FS2022 offered as Deep Learning for Autonomous Driving

VVZ CR n/a

Last Updated: 2026-06-01 11:30:52

Abstract

This course introduces the core computer vision techniques and algorithms that autonomous cars use to perceive the semantics and geometry of their driving environment, localize themselves in it, and predict its dynamic evolution. Emphasis is placed on techniques tailored for real-world settings, such as multi-modal fusion, domain-adaptive and outlier-aware architectures, and multi-agent methods.

Objective

Students will learn about the fundamentals of autonomous cars and of the computer vision models and methods these cars use to analyze their environment and navigate themselves in it. Students will be presented with state-of-the-art representations and algorithms for semantic, geometric and temporal visual reasoning in automated driving and will gain hands-on experience in developing computer vision algorithms and architectures for solving such tasks. After completing this course, students will be able to: 1. understand the operating principles of visual sensors in autonomous cars 2. differentiate between the core architectural paradigms and components of modern visual perception models and describe their logic and the role of their parameters 3. systematically categorize the main visual tasks related to automated driving and understand the primary representations and algorithms which are used for solving them 4. critically analyze and evaluate current research in the area of computer vision for autonomous cars 5. practically reproduce state-of-the-art computer vision methods in automated driving 6. independently develop new models for visual perception

Content

The content of the lectures consists in the following topics: 1. Fundamentals (a) Fundamentals of autonomous cars and their visual sensors (b) Fundamental computer vision architectures and algorithms for autonomous cars 2. Semantic perception (a) Semantic segmentation (b) Object detection (c) Instance segmentation and panoptic segmentation 3. Geometric perception and localization (a) Depth estimation (b) 3D reconstruction (c) Visual localization (d) Unimodal visual/lidar 3D object detection 4. Robust perception: multi-modal, multi-domain and multi-agent methods (a) Multi-modal 2D and 3D object detection (b) Visual grounding and verbo-visual fusion (c) Domain-adaptive and outlier-aware semantic perception (d) Vehicle-to-vehicle communication for perception 5. Temporal perception (a) Multiple object tracking (b) Motion prediction The practical projects involve implementing complex computer vision architectures and algorithms and applying them to real-world, multi-modal driving datasets. In particular, students will develop models and algorithms for: 1. Semantic segmentation and depth estimation 2. Sensor calibration for multi-modal 3D driving datasets 3. 3D object detection using lidars

Resources

Lecture Notes

Lecture slides are provided in PDF format.

Learning Materials (Links)

Main link
Course Website

General Information

Language: English
Levels: MSC
Frequency: Yearly recurring

Examination

Type: session examination
Mode: written 120 minutes
Aids: One A4 sheet of paper. Simple non-programmable calculator.

The final grade will be calculated from the session examination grade and the overall projects grade, with each of the two elements weighing 50%.The projects are an integral part of the course, they are group-based and their completion is compulsory. Receiving a failing overall projects grade results in a failing final grade for the course. Students who do not pass the projects are required to de-register from the exam.

Registration & Places

Max Places: 90

Course Components

Type	Title	Time & Place	Hours
lecture	Computer Vision and Artificial Intelligence for Autonomous Cars	Fri 14:15-17:00 (HG D 5.2)	3 h weekly
practical/laboratory course	Computer Vision and Artificial Intelligence for Autonomous Cars The lecturer will communicate the exact lesson times of ONLINE courses.	Fri 10:00-12:00 (ON LI NE)	2 h weekly

Offered In

Informatik Master
- Vertiefungen
  - Vertiefung in Visual and Interactive Computing
    - Wahlfächer
- Ergänzungen
  - Ergänzung in Computer Vision
Elektrotechnik und Informationstechnologie Master
- 01 - Fächer der Vertiefungen
  - Vertiefung: Signal Processing and Machine Learning (The core courses and specialisation courses below are a selection for students who wish to specialise in the area of "Signal Processing and Machine Learning ", see . The individual study plan is subject to the tutor's approval.)
    - Vertiefungsfächer (These specialisation courses are particularly recommended for the area of "Signal Processing and Machine Learning", but you are free to choose courses from any other field in agreement with your tutor. A minimum of 40 credits must be obtained from specialisation courses during the MSc EEIT.)
Robotics, Systems and Control Master
- Kernfächer
Data Science Master
- Master-Studium (Studienreglement 2023)
  - Wahlfächer
    - Fachspezifische Wahlfächer
- Master-Studium (Studienreglement 2017)
  - Kernfächer
    - Wählbare Kernfächer
Cyber Security Master
- Ergänzung
  - Visual and Interactive Computing
    - Wahlfächer
Space Systems Master
- Fachspezifische Vertiefung (Es müssen mindestens 20 KP aus den Deep Track Lerneinheiten absolviert werden. Überzählige KP können für Wahlfächer angerechnet werden.)
  - Robotics
    - Vertiefungsfächer Robotics (Diese LE's können sowohl als Vertiefungsfach als auch als Wahlfach angerechnet werden.)