Schedule (Semester B 2024/2025)

Applied Deep Learning

Put First Things First. ~ S. R. Covey
Week
Date
Topics
Notes
Readings
Submissions
1 13 Jan
  • Course Overview
  • A Brief History of AI with Deep Learning
  • Review of Math

Lecture01A
Lecture01B
Lecture01C
Colab Python Tutorial
PyTorch Linear Algebra
EE5438
A Brief History of AI with DL
Python Basics
Python Classes
Colab Tutorial
-
2 20 Jan
  • Perceptron and ADALINE
  • Multi-Layer Perceptrons (MLPs)
    • MLP Achitectures
    • Traditional Activation Functions
    • Loss/Cost Functions
    • Gradient Descent
Lecture02A
Lecture02B
Colab Housing Regression
Colab IRIS Classification
The Evolution of AN
Mastering MLPs
Activation Functions
PyTorch
-
3 27 Jan
  • Backpropagation
  • Gradient Descent Optimizer Variants
  • Techniques for Optimizing Neural Networks
    • Advanced Activation Functions
    • Weight Initializations: Xavier and He
    • Batch Normalization
    • Regularizations
Lecture03A
Lecture03B
Lecture03C
Colab MLP MNIST
Colab MLP FMNIST
Colab MLP CIFAR-10
Backpropagation
PyTorch AutoGrad
Classification Metrics
GD Optimizer Variants
Optimizing Neural Networks
Deep Dive with PyTorch
Project Grouping
Feb 3, 2025
4 10 Feb
  • Convolutional Neural Networks (CNNs)
  • Evolution of CNN Architectures
    • LeNet, AlexNet, VGGNet, ResNet, etc
    • Transfer Learning
    • CNN-based Computer Vision Apps
Lecture04A
Lecture04B
Colab LeNet-5 MNIST
Colab LeNet-5 FMNIST
Colab CNN CIFAR-10
Colab AlexNet CIFAR-10
Colab Transfer Learning VGGNet
Colab YOLOv8 Demo
Basics of CNNs
The Evolution of CNNs
AlexNet Paper
Two-Stage Object Detections
One-Stage Object Detections
CNN-based Segmentations
YOLO CVPR2016
Project Proposal
Feb 14, 2025
5 17 Feb
  • Tokenization and Word Embeddings
  • Recurrent Neural Networks: RNN, LSTM and GRU
  • RNN Attention Machanism
Lecture05A
Lecture05B
Lecture05C
Colab Word2Vec
Colab LSTM SA
Tokenization
Word Embeddings
RNN, LSTM, GRU
RNN Attention
Assignment 1
Feb 21, 2025
6 24 Feb
  • Transformers
  • Quiz (1:45pm - 2:45pm)
Lecture06A
Colab LSTM Stock Prediction
Colab Transformer Stock Prediction
Self-Attention & Transformers
Attention Is All You Need
7 Mar 3
  • Large Language Models (LLMs)
    • BERT and its Variants
    • GPT-1, GPT-2, GPT-3, LLaMA
    • BART and T5
Lecture06B
Lecture06C
Lecture06D
Colab BERT Spam
Colab LLaMA3-8B
Colab NLP Apps
A Brief History of LLMs
The BERT Revolution
The GPT Revolution
BART and T5
DeepSeek-V3
8 Mar 10
  • LLM Decoding Algorithms
  • Prompt Engineering
  • LLM Evaluations (Optional)
Lecture07A
Lecture07B
Lecture07C
Colab RAQ LLaMA3
LLM Decoding
Prompt Engineering
LLM Evaluations
Prompt Engineering Guide
9 17 Mar
  • LLM Quantization
  • Parameter-Efficient Fine-Tuning (PEFT)
    • Adapter, LoRA, QLoRA
Lecture08A
Lecture08B
Colab LLM Quantization
Colab LLaMA-2 QLoRA
LLM Quantization
VRAM Estimation
PEFT of LLMs
LoRA
Assignment 2
Mar 21, 2024
10 24 Mar
  • LLM Instruction Tuning
  • Preference Alignment:
    • Reinforcement Learning from Human Feedback (RLHF)
    • Direct Preference Optimization (DPO)
Lecture09A
Lecture09B
Instruction Tuning
RLHF
DPO
11 31 Mar
  • Multimodal Models: LLaVA Series (Optional)
  • Reasoning Models: DeepSeek-R1 (Optional)
  • Mid-Term Exam
Lecture10A
Colab LLaVA Voice Assistant
CLIP and SigLIP
LLaVA
DeeepSeek-R1
12 7 April
  • Project Presentation I
Nexus of Fear
13 14 April
  • Project Presentation II

Assignment 3
April 18, 2025
14 21 Dec
  • Group Project Report Submission
Final Report
April 25, 2025