Topics
A list of topics for each seminar is provided below. Topics are subject to change. You can expect more detailed information about the subtopics approximately one week before each seminar via the subtopics registration sheet (log into courses to see the link) .
- September 13: Intro
- Short seminar, no paper
- September 20: Data curation and pretraining
- September 27: Inference-time Algorithms
- October 4: Parameter-Efficient Fine-Tuning
- October 11: Reinforcement Learning from Human Feedback (RLHF)
- October 18: Model Merging
- October 25: Mixture of experts (MoE)
- November 1: Prompt Engineering
- November 8: Retrieval-Augmented Generation (RAG)
- November 15: Evaluation
- November 22: -
- November 29: -
- December 6: -
- December 13: -
- December 20: -