Institute of Computer Science
Courses.cs.ut.ee Institute of Computer Science University of Tartu
  1. Courses
  2. 2023/24 fall
  3. Transformers (MTAT.06.055)
ET
Log in

Transformers 2023/24 fall

  • Main
  • Lectures
  • Labs
  • Homeworks
  • Projects
  • Grades

Labs

  • Given by Lisa (lisa_k@tartunlp.ai) and Pasha (pavel.chizhov@ut.ee)
  • Thursdays at 14:15 in Delta 2047
  • Communication channel in Slack
1.Sep 14Intro + training a toy modelslidescodesolved
2.Sep 21Encoder from scratchslidescodesolved
3.Oct 5Pre-trained models & HuggingFaceslidescodesolved
4.Oct 12Pre-processing and BPE---codesolved
5.Oct 19HW1 Review + Intro to MT---codesolved
6.Oct 26MT metricsslidescodesolved
7.Nov 2Text generationslidescodesolved
8.Nov 9GPT from scratchslidescodesolved
9.Nov 16Guest lab: Fine-tuning LLMs---code (Kaggle), code (Colab)
10.Nov 23Projects info + ViT from scratchslidescodesolved
11.Nov 30Swin Transformer discussionslides------
12.Dec 7HW3 Review + Bells & Whistlesslidescode---
13.Dec 14ASRslidescode---
  • Institute of Computer Science
  • Faculty of Science and Technology
  • University of Tartu
In case of technical problems or questions write to:

Contact the course organizers with the organizational and course content questions.
The proprietary copyrights of educational materials belong to the University of Tartu. The use of educational materials is permitted for the purposes and under the conditions provided for in the copyright law for the free use of a work. When using educational materials, the user is obligated to give credit to the author of the educational materials.
The use of educational materials for other purposes is allowed only with the prior written consent of the University of Tartu.
Terms of use for the Courses environment