EE5438
Home
Schedule
Projects
Links
Schedule (Semester B 2024/2025)
Applied Deep Learning
Put First Things First. ~ S. R. Covey
Week
Date
Topics
Notes
Readings
Submissions
1
13 Jan
Course Overview
A Brief History of AI with Deep Learning
Review of Math
Your browser does not support the audio element.
Lecture01A
Lecture01B
Lecture01C
Colab Python Tutorial
PyTorch Linear Algebra
EE5438
A Brief History of AI with DL
Python Basics
Python Classes
Colab Tutorial
-
2
20 Jan
Perceptron and ADALINE
Multi-Layer Perceptrons (MLPs)
MLP Achitectures
Traditional Activation Functions
Loss/Cost Functions
Gradient Descent
Lecture02A
Lecture02B
Colab Housing Regression
Colab IRIS Classification
The Evolution of AN
Mastering MLPs
Activation Functions
PyTorch
-
3
27 Jan
Backpropagation
Gradient Descent Optimizer Variants
Techniques for Optimizing Neural Networks
Advanced Activation Functions
Weight Initializations: Xavier and He
Batch Normalization
Regularizations
Lecture03A
Lecture03B
Lecture03C
Colab MLP MNIST
Colab MLP FMNIST
Colab MLP CIFAR-10
Backpropagation
PyTorch AutoGrad
Classification Metrics
GD Optimizer Variants
Optimizing Neural Networks
Deep Dive with PyTorch
Project Grouping
Feb 3, 2025
4
10 Feb
Convolutional Neural Networks (CNNs)
Evolution of CNN Architectures
LeNet, AlexNet, VGGNet, ResNet, etc
Transfer Learning
CNN-based Computer Vision Apps
Lecture04A
Lecture04B
Colab LeNet-5 MNIST
Colab LeNet-5 FMNIST
Colab CNN CIFAR-10
Colab AlexNet CIFAR-10
Colab Transfer Learning VGGNet
Colab YOLOv8 Demo
Basics of CNNs
The Evolution of CNNs
AlexNet Paper
Two-Stage Object Detections
One-Stage Object Detections
CNN-based Segmentations
YOLO CVPR2016
Project Proposal
Feb 14, 2025
5
17 Feb
Tokenization and Word Embeddings
Recurrent Neural Networks: RNN, LSTM and GRU
RNN Attention Machanism
Lecture05A
Lecture05B
Lecture05C
Colab Word2Vec
Colab LSTM SA
Tokenization
Word Embeddings
RNN, LSTM, GRU
RNN Attention
Assignment 1
Feb 21, 2025
6
24 Feb
Transformers
Quiz
(1:45pm - 2:45pm)
Lecture06A
Colab LSTM Stock Prediction
Colab Transformer Stock Prediction
Self-Attention & Transformers
Attention Is All You Need
7
Mar 3
Large Language Models (LLMs)
BERT and its Variants
GPT-1, GPT-2, GPT-3, LLaMA
BART and T5
Your browser does not support the audio element.
Lecture06B
Lecture06C
Lecture06D
Colab BERT Spam
Colab LLaMA3-8B
Colab NLP Apps
A Brief History of LLMs
The BERT Revolution
The GPT Revolution
BART and T5
DeepSeek-V3
8
Mar 10
LLM Decoding Algorithms
Prompt Engineering
LLM Evaluations (Optional)
Lecture07A
Lecture07B
Lecture07C
Colab RAQ LLaMA3
LLM Decoding
Prompt Engineering
LLM Evaluations
Prompt Engineering Guide
9
17 Mar
LLM Quantization
Parameter-Efficient Fine-Tuning (PEFT)
Adapter, LoRA, QLoRA
Lecture08A
Lecture08B
Colab LLM Quantization
Colab LLaMA-2 QLoRA
LLM Quantization
VRAM Estimation
PEFT of LLMs
LoRA
Assignment 2
Mar 21, 2024
10
24 Mar
LLM Instruction Tuning
Preference Alignment:
Reinforcement Learning from Human Feedback (RLHF)
Direct Preference Optimization (DPO)
Lecture09A
Lecture09B
Instruction Tuning
RLHF
DPO
11
31 Mar
Multimodal Models: LLaVA Series (Optional)
Reasoning Models: DeepSeek-R1 (Optional)
Mid-Term Exam
Lecture10A
Colab LLaVA Voice Assistant
CLIP and SigLIP
LLaVA
DeeepSeek-R1
12
7 April
Project Presentation I
Nexus of Fear
13
14 April
Project Presentation II
Assignment 3
April 18, 2025
14
21 Dec
Group Project Report Submission
Final Report
April 25, 2025