Institute of Computer Science
  1. Courses
  2. 2024/25 fall
  3. Transformers (MTAT.06.055)
ET
Log in

Transformers 2024/25 fall

  • Main
  • Lectures
  • Labs
  • Homeworks
  • Projects
  • Grades

Labs

  • Given by Dmytro Pashchenko, Martin Vainikko and Taido Purason
  • Thursdays at 14:15 in Delta 2047
  • Communication channel in Slack
1.Sep 12Intro + training a toy modelslidescodesolved
2.Sep 19Encoder from scratchslidescodesolved
3.Sep 26Pre-trained models & HuggingFaceslidescodesolved
4.Oct 03Pre-processing and BPE---codesolved
5.Oct 10MT metrics---codesolved
6.Oct 17MT intro---codesolved
7.Oct 24Text generation + HW1 reviewslidescodesolved
8.Oct 31GPT from scratchslidescodesolved
9.Nov 7Introduction to Rocket HPCguide--
10.Nov 21ViT from scratchslidescodesolved
11.Nov 28Guest lab with: LLM fine-tuningslidescodesolved
12.Dec 12Promptingslidescodesolved
  • Institute of Computer Science
  • Faculty of Science and Technology
  • University of Tartu
In case of technical problems or questions write to:

Contact the course organizers with the organizational and course content questions.
The proprietary copyrights of educational materials belong to the University of Tartu. The use of educational materials is permitted for the purposes and under the conditions provided for in the copyright law for the free use of a work. When using educational materials, the user is obligated to give credit to the author of the educational materials.
The use of educational materials for other purposes is allowed only with the prior written consent of the University of Tartu.
Terms of use for the Courses environment