LTAT.01.001 Natural language processing
This course aims to provide an overview of the main tasks in the field of natural language processing and to introduce the contemporary methods to address them. The course will cover tasks such as language modeling and word/sentence representations, text classification, sequence tagging for finding parts of speech or morphological features, information extraction such as named entity recognition, finding the important structural parts of a sentence as well as some higher level tasks such as machine translation.
During recent years, the NLP field has more and more started to use deep neural models. Thus, in this course we will look at various deep neural models that are nowadays commonly used for NLP: recurrent networks for modeling sequential data, convolutional networks for text classification, static and contextual word embeddings, attention mechanism for finding alignment between different inputs or inputs and outputs.
Course info
Starting from March 16, the lectures and labs take place via zoom.
- Lectures: Fridays at 10:15, Delta building (Narva mnt 18), room 2034, lecture zoom
- Labs: Fridays at 12:15, Delta building (Narva mnt 18), room 2034 (bring your own laptop), practice zoom
- Lecturer: Kairit Sirts (kairit.sirts@ut.ee)
- TA: Kirill Milintsevich (kirill.milintsevich@ut.ee )
Assessment
| Type | Points | Comment |
|---|---|---|
| Reading tests | 20 points | 20 reading tests, max 2 points each |
| Homeworks | 36 points | 6 practical homeworks, max 6 points each |
| Project | 30 points | |
| Attending guest lectures | 4 points | 4 guest lectures, 1 point each |
| Final exam | 20 points | |
| Total | 110 points |
Prerequisites
This course assumes knowledge from various areas. In Study Information System, the required prerequisite course is Machine Learning (MTAT.03.227) and the recommended prerequisite courses are Language Technology (MTAT.06.045) and Artificial Intelligence I (MTAT.06.008). In practice, we also assume the basic knowledge of higher math (calculus, linear algebra, probabilities) and computer programming (python). If you lack some of the required knowledge then it is your responsibility to acquire it at the level necessary for advancing on this course. We can help to find suitable materials for obtaining the necessary background.