Institute of Computer Science
  1. Courses
  2. 2022/23 fall
  3. NLP seminar: seq2seq transformations (MTAT.06.046)
ET
Log in

NLP seminar: seq2seq transformations 2022/23 fall

  • General
  • Topics

Topics

A list of topics and papers for each seminar is provided below:

  1. September 16: Neural machine translation
    • NMT by jointly learning to align and translate: https://arxiv.org/abs/1409.0473
    • Effective Approaches to attention NMT: https://aclanthology.org/D15-1166/
    • NMT with subword units: https://aclanthology.org/P16-1162/
  2. September 23: Multilingual neural machine translation
    • M2M-100: https://jmlr.csail.mit.edu/papers/volume22/20-1307/20-1307.pdf
    • balancing training data: https://aclanthology.org/2020.acl-main.754/
    • shared parameters in MNMT: https://aclanthology.org/2022.eamt-1.12/
    • zero-shot opt: https://aclanthology.org/2022.acl-long.12/
  3. September 30: “No language left behind” MNMT:
    • Translation, NLLB: https://arxiv.org/ftp/arxiv/papers/2207/2207.04672.pdf
  4. October 7: Low-resource NMT:
    • Smugri: https://aclanthology.org/2021.nodalida-main.5/
    • Livonian: https://aclanthology.org/2022.acl-short.55/
    • Revisiting: https://aclanthology.org/P19-1021/
  5. October 14: Multi-task learning:
    • T5: https://arxiv.org/abs/1910.10683
    • mT5: https://arxiv.org/abs/2010.11934
    • ExT5: https://openreview.net/forum?id=Vzh1BFUCiIX
  6. October 21: Text summarization:
    • https://aclanthology.org/2021.acl-long.538/
    • https://aclanthology.org/2022.acl-long.100/
  7. October 28: Task-oriented dialogue:
    • https://aclanthology.org/2021.insights-1.9/
    • https://aclanthology.org/2021.emnlp-main.590/
    • https://aclanthology.org/2021.emnlp-main.142/
  8. November 4: Question answering:
    • https://aclanthology.org/2022.dialdoc-1.5/
    • https://aclanthology.org/2021.acl-long.239/
  9. November 11: Information extraction
    • Text-to-Triple: https://aclanthology.org/2021.emnlp-main.94/
    • Text-to-table: https://aclanthology.org/2022.acl-long.180/
  10. November 18: Text-to-image:
    • Dall-e 2: https://arxiv.org/abs/2204.06125
    • 0-shot text-to-image: https://arxiv.org/abs/2102.12092
  11. November 25: Text-to-speech:
    • Microsoft’s “human-level” TTS: https://arxiv.org/pdf/2205.04421.pdf
    • Neurokõne: https://www.bjmc.lu.lv/.../10_3_17_Ratsep.pdf
  12. December 2: Data-to-text
    • https://aclanthology.org/D17-1239/
    • https://aclanthology.org/2022.acl-long.271/
  13. December 11: image-to-text
    • GIT: https://arxiv.org/pdf/2205.14100.pdf
    • ViT+GPT: https://arxiv.org/abs/2201.12723
  14. December 18: weird stuff
    • AMR-to-text: https://aclanthology.org/2021.emnlp-main.57.pdf
    • bert2BERT: https://aclanthology.org/2022.acl-long.151/
  • Institute of Computer Science
  • Faculty of Science and Technology
  • University of Tartu
In case of technical problems or questions write to:

Contact the course organizers with the organizational and course content questions.
The proprietary copyrights of educational materials belong to the University of Tartu. The use of educational materials is permitted for the purposes and under the conditions provided for in the copyright law for the free use of a work. When using educational materials, the user is obligated to give credit to the author of the educational materials.
The use of educational materials for other purposes is allowed only with the prior written consent of the University of Tartu.
Terms of use for the Courses environment