Schedule of EE4016 in Semester B 2023/2024

Schedule (Semester B 2023/2024)

Engineering Applications of Artificial Intelligence

Put First Things First. ~ S. R. Covey

Week	Date	Topics	Notes	Readings	Submissions
1	15 Jan	Course Overview History of AI with Deep Learning Review of Math	Lecture01A Lecture01B Lecture01C Colab PyTorch Examples	Chapter 1 Chapter 2 Bengio: AI with DL Colab Tutorial Python Tutorial	-
2	22 Jan	Perceptron and ADALINE Multi-Layer Perceptrons (MLPs)	Lecture02A Lecture02B Colab Housing Regression Colab IRIS Classification	Chapter 3 Chapter 4 Deep Dive with PyTorch Colab Python Tutorial	-
3	29 Jan	Gradient Descent and Backpropagation Optimization Algorithms Improving Deep Neural Networks Modern Activation Functions Weight Initializations: Xavier and He Batch Normalization Regularizations	Lecture03A Lecture03B Lecture03C Colab MLP MNIST Colab MLP FMNIST Colab MLP CIFAR-10	Chapter 5 Chapter 6 PyTorch for DL 3 Elements of PyTorch GD Optimization Algorithms	Project Grouping Feb 2, 2024
4	5 Feb	Convolutional Neural Networks (CNNs) Evolution of CNN Architectures LeNet, AlexNet, VGGNet, ResNet, etc Transfer Learning CNN-based Computer Vision Apps	Lecture04A Lecture04B Colab LeNet-5 MNIST Colab LeNet-5 CIFAR-10 Colab AlexNet CIFAR-10 Colab Transfer Learning VGGNet Colab YOLOv8 Demo	Chapter 7 Chapter 8 AlexNet Paper Two-Stage Object Detections One-Stage Object Detections CNN-based Segmentations YOLO CVPR2016	Project Proposal Feb 16, 2024
5	19 Feb	NLP and Word Representations Recurrent Neural Networks (RNNs) RNN Apps and Attention Machanism	Lecture05A Lecture05B Lecture05C Colab Word2Vec Colab LSTM SA	Chapter 9 Chapter 10 A Neural Probabilistic LM Word2Vec Paper LSTM Paper Attention	Assignment 1 Feb 23, 2024
6	26 Feb	Transformers Quiz (1:45pm - 2:45pm)	Lecture06A Colab LSTM Stock Prediction Colab Transformer Stock Prediction	Chapter 11 Attention Is All You Need Transformers
7	4 Mar	Large Language Models (LLMs) BERT and its Variants GPT-1, GPT-2, GPT-3, LLaMA BART and T5	Lecture06B Lecture06C Lecture06D Colab BERT Spam Colab LLM Apps	Chapter 15 History of LLMs BERT GPT-2
8	11 Mar	Parameter-Efficient Fine-Tuning (PEFT) Adapter, LoRA, QLoRA, 1-bit LLMs Prompt Engineering LLM Decoding: Greedy, Beam Search, Sampling Prompting: Few-Shot, CoT, Self-Consistency, etc	Lecture07A Lecture07B Colab LLM Quantization	Chapter 16 Prompt Engineering Guide PEFT, LoRA, QLoRA, etc LLaMA 2	Assignment 2 Mar 15, 2024
9	18 Mar	Alignment of Language Models: Instruction Finetuning RLHF: InstructGPT and ChatGPT Direct Preference Optimization (DPO)	Lecture08A Colab LLaMA 2 Apps Colab LLaMA 2 QLoRA	InstructGPT RLHF Story DPO
10	25 Mar	Multimodality: CLIP, Flamingo, GPT-4V, etc Mid-Term Exam	Lecture09A Colab LLaVA Voice Assistant	CLIP LMMs
11	1 Apr	Easter Monday Holiday		GTC2024: Transforming AI	Assignment 3 Apirl 5, 2024
12	8 Apr	Project Presentation I			-
13	15 Apr	Project Presentation II
14	22 Apr	Group Project Report Submission		-	Final Report April 22, 2024