AI60213 - Foundation of Large Language Models

Date	Topic	Class Notes	Resources
Week 1
July 21 Monday	Introduction to LLMs Historical developement and Impact Fundamentals History	Introduction to LLMs
July 22 Tuesday	Introduction to LLMs Understanding the evaluation of Langugae Models pLM Language Model	Probabilistic and Neural LM
Week 2
July 28 Monday	Transformer: Self-Attention Deep dive into self-attention mechanism and multi-head attention Self-Attention Multi-Head	Tranformer and Self attention	Attention Is All You Need The Illustrated Transformer

Course Schedule