Schedule of EE5438 in Semester B 2024/2025

Schedule (Semester B 2024/2025)

Applied Deep Learning

Put First Things First. ~ S. R. Covey

Week	Date	Topics	Notes	Readings	Submissions
1	13 Jan	Course Overview A Brief History of AI with Deep Learning Review of Math	Lecture01A Lecture01B Lecture01C Colab Python Tutorial PyTorch Linear Algebra	EE5438 A Brief History of AI with DL Python Basics Python Classes Colab Tutorial	-
2	20 Jan	Perceptron and ADALINE Multi-Layer Perceptrons (MLPs) MLP Achitectures Traditional Activation Functions Loss/Cost Functions Gradient Descent	Lecture02A Lecture02B Colab Housing Regression Colab IRIS Classification	The Evolution of AN Mastering MLPs Activation Functions PyTorch	-
3	27 Jan	Backpropagation Gradient Descent Optimizer Variants Techniques for Optimizing Neural Networks Advanced Activation Functions Weight Initializations: Xavier and He Batch Normalization Regularizations	Lecture03A Lecture03B Lecture03C Colab MLP MNIST Colab MLP FMNIST Colab MLP CIFAR-10	Backpropagation PyTorch AutoGrad Classification Metrics GD Optimizer Variants Optimizing Neural Networks Deep Dive with PyTorch	Project Grouping Feb 3, 2025
4	10 Feb	Convolutional Neural Networks (CNNs) Evolution of CNN Architectures LeNet, AlexNet, VGGNet, ResNet, etc Transfer Learning CNN-based Computer Vision Apps	Lecture04A Lecture04B Colab LeNet-5 MNIST Colab LeNet-5 FMNIST Colab CNN CIFAR-10 Colab AlexNet CIFAR-10 Colab Transfer Learning VGGNet Colab YOLOv8 Demo	Basics of CNNs The Evolution of CNNs AlexNet Paper Two-Stage Object Detections One-Stage Object Detections CNN-based Segmentations YOLO CVPR2016	Project Proposal Feb 14, 2025
5	17 Feb	Tokenization and Word Embeddings Recurrent Neural Networks: RNN, LSTM and GRU RNN Attention Machanism	Lecture05A Lecture05B Lecture05C Colab Word2Vec Colab LSTM SA	Tokenization Word Embeddings RNN, LSTM, GRU RNN Attention	Assignment 1 Feb 21, 2025
6	24 Feb	Transformers Quiz (1:45pm - 2:45pm)	Lecture06A Colab LSTM Stock Prediction Colab Transformer Stock Prediction	Self-Attention & Transformers Attention Is All You Need
7	Mar 3	Large Language Models (LLMs) BERT and its Variants GPT-1, GPT-2, GPT-3, LLaMA BART and T5	Lecture06B Lecture06C Lecture06D Colab BERT Spam Colab LLaMA3-8B Colab NLP Apps	A Brief History of LLMs The BERT Revolution The GPT Revolution BART and T5 DeepSeek-V3
8	Mar 10	LLM Decoding Algorithms Prompt Engineering LLM Evaluations (Optional)	Lecture07A Lecture07B Lecture07C Colab RAQ LLaMA3	LLM Decoding Prompt Engineering LLM Evaluations Prompt Engineering Guide
9	17 Mar	LLM Quantization Parameter-Efficient Fine-Tuning (PEFT) Adapter, LoRA, QLoRA	Lecture08A Lecture08B Colab LLM Quantization Colab LLaMA-2 QLoRA	LLM Quantization VRAM Estimation PEFT of LLMs LoRA	Assignment 2 Mar 21, 2024
10	24 Mar	LLM Instruction Tuning Preference Alignment: Reinforcement Learning from Human Feedback (RLHF) Direct Preference Optimization (DPO)	Lecture09A Lecture09B	Instruction Tuning RLHF DPO
11	31 Mar	Multimodal Models: LLaVA Series (Optional) Reasoning Models: DeepSeek-R1 (Optional) Mid-Term Exam	Lecture10A Colab LLaVA Voice Assistant	CLIP and SigLIP LLaVA DeeepSeek-R1
12	7 April	Project Presentation I		Nexus of Fear
13	14 April	Project Presentation II			Assignment 3 April 18, 2025
14	21 Dec	Group Project Report Submission			Final Report April 25, 2025