EE4016

Topics:

• History of AI with Deep Learning
• Perceptron and Multi-Layer Perceptrons (MLPs)
• Gradient Descent and Backpropagation
• Optimizations and Regularizations
• Convolutional Neural Networks (CNNs)
• Reurrent Neural Networks (RNNs)
• Self-Attention and Transformers
• Large Language Models (LLMs): BERT, GPT and T5
• Prompt Engineering
• Parameter-Efficient Fine-Tuning
• LLM Hallucination and Human Alignment
• Multimodality

Grading:

• Assignments - 15%
• Quiz - 5%
• Midterm - 10%
• Group Project - 40%
• Final Exam - 30%

Prerequisites:

• MA2001 Multi-variable Calculus and Linear Algebra
• EE2331 Data Structures and Algorithms

Please be advised, EE4016 is a course with STRONG Mathematical and Programming components.

Instructor:

Dr. PO Lai-Man

• Email: eelmpo@cityu.edu.hk
  
• Phone: 3442-7779
  
• Room: G6506, Green Zone, 6/F, AC1
  

Graders:

WU Haoxuan

• Email: haoxuanwu2-c@my.cityu.edu.hk

LIU Yuyang

• Email: yuyangliu5-c@my.cityu.edu.hk

LI Kun

• Email: kunli25-c@my.cityu.edu.hk

HE Lei

• Email: leihe9-c@my.cityu.edu.hk

LIU Ji

• Email: jiliu8-c@my.cityu.edu.hk

Level and Units:

• B4 Level with 3 CUs

Lecture:

• Monday : 12:00pm to 2:50pm

Venue:

• LT401 - Herbalgy Lecture Theatre

Rules:

• Lecture attendance: Required. You are responsible for whatever is taught in the lecture and tutorial.

• Submission of Assignments and Project Reports:
  1. Hardcopies are not required.
  2. Soft copies of assignment and project materials, such as PDF files, presentation PPTs, Colab source code and related files, need to be uploaded to CANVAS by the deadline of 11:00pm.

• Late Submission:
  1. Assignments and project reports mush be received by the course email account before 11:00PM on the due date.
  2. NO late homework is accepted without previous arrangement with the instructor.
  3. If approved, late homework receives 20% per business day penalty.
  4. Write your name and student number on the top right corner of the paper.
  5. Write your answers legibly and derive all of the steps to show your work clearly.
  6. No credits will be given to answers without showing the steps.
  7. Students may work together on the homework, but copying is unacceptable.

• Cheating: In particular copying your fellow classmate's assignments or programs, is a very serious offense! If you are found cheating, you will automatically get an F grade in this course and your act will be reported to the Department for necessary disciplinary actions. Please don't let others copy your assignments or programs as we don't have a way to tell who is copying who and you may be liable to the penalties.