Algorithms and Systems for Autonomous Vehicles, Umea University, Spring 2022

Zonghua Gu and Kalle Prorok

Lectures

Lec Date

Lecture Notes

Topics Discussed

Additional Readings (Optional)

W1

L1 Introduction and Overview PPTX, PDF

Background, history, AD processing pipeline

The Truth About Self Driving Cars by New Mind (YouTube)

2020 Autonomous Vehicle Technology Report by Wevolver

Self-Driving Cars, 2022, Uni Bonn (YouTube)

Self-Driving Cars, 2022, Uni Tuebingen (YouTube playlist)

W2

L1 Introduction and Overview cont.

Sensors and perception, HD maps, HW platforms, SW platforms, V2X communication, Ethical issues

 

W2

L2 Intro to Machine Learning PPTX, PDF

Activation functions, Cross-Entropy Loss, SoftMax, ROC and AUC, NN training issues

A collection of the latest machine learning and deep learning courses

W3

L3.1 CNN for Computer Vision PPTX, PDF

Intro to CNN, case studies (LeNet, AlexNet, VGGNet, GooLeNet, ResNet...)

UC Berkeley CS231n Convolutional Neural Networks for Visual Recognition

Introduction to Convolutional Neural Networks by Animated AI (YouTube)

Convolutional Neural Networks | CNN | Kernel | Stride | Padding | Pooling | Flatten | Formula (YouTube)

Essentials of Object Detection by

Kapil Sachdeva (YouTube)

W3

L3.2 Adversarial Attacks PPTX, PDF

Adversarial attacks

NeurIPS 2018 tutorial, Adversarial Robustness: Theory and Practice

W4

L4 Object Detection and Segmentation PPTX, PDF

Object detection (R-CNN, Fast R-CNN, Faster R-CNN, Single-Stage Detectors), object segmentation

Deep Learning for Computer Vision, U Michigan, YouTube playlist

W5

L5 Planning PPTX, PDF

Route planning, behavior planning, local planning, Responsibility Sensitive Safety (RSS)

Self-Driving Cars: Planning (Benedikt Mersch 2020) (YouTube)

W6

L6 Control Theory PPTX, PDF

PID, MPC, Udacity racetrack control, PID tuning with twiddle()

Lesson 15 PID Control, AI for Robotics at Udacity

Controlling Self Driving Cars PID Control tutorial

PIDs Simplified

Understanding PID Control, Part 1: What Is PID Control? By MATLAB

W7

L7.1 MDP Planning, PPTX, PDF

Markov Decision Process (MDP), Bellman Equations, Policy Iteration, Value Iteration

Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto

Reinforcement Learning MOOC by Chris G. Willcocks (based on Sutton & Barto book)

W8

L7.2 Q-Learning, PPTX, PDF

Q-learning

Q-Learning, let us create an autonomous Taxi

W10

Final Exam, Date TBD, Online on ZOOM, Sample Exam Questions

 

 


*Slides subject to change. Please download the latest version after class.

*Lectures on Mon & Wed 15:30-17:00 on Zoom https://umu.zoom.us/j/62818040552

*For your reference, you may look at the previous course offerings Fall 2022 and Spring 2021.

Lab Sections

Assign

Date

Assignment

Due Date

Additional Readings (Optional)

W4

Lab1. Adversarial Attacks on a CNN for Traffic Sign Classification

LabX. Bonus project proposal (refer to instructions in Canvas)

TBD

Traffic Sign Recognition using PyTorch and Deep Learning

UC Berkeley CS231n Python Numpy Tutorial (with Colab)

T81 558:Applications of Deep Neural Networks by Jeff Heaton, YouTube playlist (Good intro to Python, CoLab, Tensorflow, Keras)

Deep Neural Networks with PyTorch at Coursera

PyTorch Notebooks/Tutorials

Official tutorials: Colab, PyTorch

Free Python Books

W6

Lab2. PID Control

TBD

Parameter Optimization w. twiddle() from Udacity

Racetrack Control from Udacity

W8

Lab3. DQN RL for Highway Driving, PPTX, PDF, Video Lecture

TBD

highway-env

Script to Stop Google Colab From Disconnecting

W10

LabX. Bonus project

TBD

 


*Students should form teams of 1-3 people each for the lab sections. The report should contain a paragraph that explains each team member’s contribution, and each team member should submit the same copy of report/source code in Canvas. 

======= 12.0pt;mso-ansi-language:EN-US'>* Lab materials: https://github.com/guzonghua/saavlabs

* Students should form teams of 1-3 people each for the lab sections. Each team member should submit the same copy of report/source code in Canvas.

>>>>>>> da0f42f1865a437a12d50f455edc355d1502601e

 

Anonymous feedback form