IV. Introduction to Optimization
Given by Ilya Kuzovkin
Materials by Konstantin Tretyakov
Brief summary: Optimization problem statement and basic terminology (minimum, maximum, gradient, Hessian). Classical methods for unconstrained optimization - gradient descent, stochastic gradient descent, Newton's method. Brief overview of constrained optimization.
Slides: PDF
Auxiliary reading: PDF
Literature: Wikipedia has some good articles on the topic. Otherwise, pick any fat textbook with "Optimization methods" in the title.
Video: panopto.ut.ee (2014)