Links
Here you can find useful links and resources related to the course.
Additional Resources on Transformers and Deep Learning
- The Illustrated Transformer by Jay Alammar
- MicroGPT by Andrej Karpathy
- GPT from scratch by Andrej Karpathy
- ARENA courses
- The Stanford course "Transformers"
- The MIT course "Deep Learning"
- The MIT course "Hands on Deep Learning"
Mathematical background
- StatQuest: Essential Matrix Algebra for Neural Networks
- 3Blue1Brown: Matrix multiplication as composition
- 3Blue1Brown: Dot products
- StatQuest: The Main Ideas behind Probability Distributions
For additional refreshers, you may also want to explore other videos from StatQuest and 3Blue1Brown.