Andmekaeve uurimisseminar 2015/16 sügis

Timetable

See syllabus of Deep Learning for Natural Language Processing for links to videos, lecture notes and assignments.

I didn't copy those links here, because then you wouldn't notice links to supplementary materials.

Date	Video to watch	In seminar	Assignee
31.08.2015	-	Introduction	Tambet Matiisen
7.09.2015	Intro to NLP and Deep Learning	Test: Python tutorial Take the test IPython notebook	Tambet Matiisen
14.09.2015	Simple Word Vector representations: word2vec, GloVe	Test: Lecture Notes 1 Take the test	Groups AKI + ÃœMD
21.09.2015	Advanced word vector representations: language models, softmax, single layer networks	Assignment #1, tasks 1 & 2	Group ÃœMD
28.09.2015	Word Window Classification and Neural Network	Test: Lecture Notes 2 Take the test	Groups JGA + RKM
5.10.2015	Project Advice, Neural Networks and Back-Prop (in full gory detail)	Assignment #1, tasks 3 & 4 Gradient derivations	Group RKM
12.10.2015	None	Assignment #1, tasks 3 & 4	Group RKM
19.10.2015	Practical tips: gradient checks, overfitting, regularization, activation functions, details	Test: Lecture notes 3 Take the test	Groups KML + AZA
26.10.2015	Recurrent neural networks -- for language modeling and other tasks	Assignment #2, tasks 0 & 1	Group AZA
2.11.2015	None	Assignment #2, tasks 0 & 1	Group AZA
9.11.2015	GRUs and LSTMs -- for machine translation	Test: Lecture notes 4 Take the test	Group TAÜ
16.11.2015	Recursive neural networks -- for parsing	Assignment #2, task 2	Group KML
23.11.2015	Recursive neural networks -- for different tasks (e.g. sentiment analysis)	Assignment #3, task 1	Group AKI
30.11.2015	Guest Lecture with Jason Weston from Facebook: Neural Models with Memory -- for question answering	Assignment #3, task 2 Visualization code	Group TAÜ
7.12.2015	Convolutional neural networks -- for sentence classification	Assignment #3, task 3	Group JGA
14.12.2015	Guest Lecture with Andrew Maas: Speech recognition	Project presentations
21.12.2015	Applications of Deep Learning to Natural Language Processing	Project presentations

Study group	Members
Group AKI	Andres Viikmaa, Kaido Lepik, Irene Teinemaa
Group ÜMD	Ülari Laurson, Markus Lippus, Dage Särg
Group JGA	Kristjan-Julius Laak, Gea Pajula, Andres Karjus, Kristjan Jansons (for homework)
Group KML	Karl Tarbe, Mihkel Heidleberg, Lauri Tammeveski, Kristjan Jansons (for test)
Group RKM	Robert Roosalu, Kaarel Tõnisson, Marit Asula
Group AZA	Andrii Rozumnyi, Zurabi Isakadze, Aqeel Labash (Gaga)
Group TAÜ	Tambet Matiisen, Ardi Tampuu, Üllar Lindmaa