Schedule of EE4016 in Semester B 2023/2024

Schedule (Semester A 2024/2025)

Applications of AI with Deep Learning

Put First Things First. ~ S. R. Covey

Week	Date	Topics	Notes	Readings	Submissions
1	2 Sep	Course Overview A Brief History of AI with Deep Learning Review of Math	Lecture01A Lecture01B Lecture01C PyTorch Linear Algebra	AI-DL History Chapter 1 Chapter 2 Colab Tutorial Python Tutorial	-
2	9 Sep	Perceptron and ADALINE Multi-Layer Perceptrons (MLPs) MLP Achitectures Traditional Activation Functions Loss/Cost Functions MLP Training: Gradient Descent	Lecture02A Lecture02B Colab Housing Regression Colab IRIS Classification	The Evolution of AN Mastering MLPs Chapter 3 Chapter 4 Deep Dive with PyTorch Colab Python Tutorial	-
3	16 Sep	Backpropagation Gradient Descent Optimizers Techniques for Improving Neural Network Training Advanced Activation Functions Weight Initializations: Xavier and He Batch Normalization Regularizations	Lecture03A Lecture03B Lecture03C Colab MLP MNIST Colab MLP FMNIST Colab MLP CIFAR-10	Backpropagation GD Optimizers Improve Training Chapter 5 Chapter 6 3 Elements of PyTorch	Project Grouping Sep 20, 2024
4	23 Sep	Convolutional Neural Networks (CNNs) Evolution of CNN Architectures LeNet, AlexNet, VGGNet, ResNet, etc Transfer Learning CNN-based Computer Vision Apps	Lecture04A Lecture04B Colab LeNet-5 MNIST Colab LeNet-5 FMNIST Colab LeNet-5 CIFAR-10 Colab AlexNet CIFAR-10 Colab Transfer Learning VGGNet Colab Modern CNN CIFAR-10 Colab YOLOv8 Demo	The Evolution of CNNs Chapter 7 Chapter 8 AlexNet Paper Two-Stage Object Detections One-Stage Object Detections CNN-based Segmentations YOLO CVPR2016	Project Proposal Sep 27, 2024
5	30 Sep	NLP and Word Representations Recurrent Neural Networks (RNNs) RNN Apps and Attention Machanism	Lecture05A Lecture05B Lecture05C Colab Word2Vec Colab LSTM SA	Text Representations The Math Behind RNNs Chapter 9 Chapter 10 Attention	Assignment 1 Oct 4, 2024
6	7 Oct	Transformers Quiz (4:45pm - 5:45pm)	Lecture06A Colab LSTM Stock Prediction Colab Transformer Stock Prediction	Self-Attention & Transformers Chapter 11 Attention Is All You Need
7	14 Oct	Large Language Models (LLMs) BERT and its Variants GPT-1, GPT-2, GPT-3, LLaMA BART and T5	Lecture06B Lecture06C Lecture06D Colab BERT Spam Colab LLaMA3-8B Colab NLP Apps	The BERT Revolution The GPT Revolution BART and T5 History of LLMs
8	21 Oct	Decoding Algorithms Prompt Engineering LLM Evaluations (Optional)	Lecture07A Lecture07B Lecture07C	LLM Decoding Prompt Engineering LLM Evaluations Prompt Engineering Guide	Assignment 2 Oct 25, 2024
9	28 Oct	LLM Quantization Parameter-Efficient Fine-Tuning (PEFT) Adapter, LoRA, QLoRA	Lecture08A Lecture08B Colab LLM Quantization Colab LLaMA-2 QLoRA	LLM Quantization PEFT of LLMs LoRA SBoRA
10	4 Nov	LLM Instruction Tuning Preference Alignment: RLHF (PPO), DPO, ORPO	Lecture09A Lecture09B	Instruction Tuning RLHF DPO
11	11 Nov	Multimodality (Optional) Mid-Term Exam	Lecture10A Colab LLaVA Voice Assistant	Multi-Modal Generative AI Multimodal Models
12	18 Nov	Project Presentation I		Predictions for AI: 2024-2030
13	25 Nov	Project Presentation II			Assignment 3 Nov 29, 2024
14	2 Dec	Group Project Report Submission			Final Report Dec 6, 2024