Keeletehnoloogia seminar: jada-jada teisendused 2022/23 sügis

Topics

A list of topics and papers for each seminar is provided below:

1. September 16: Neural machine translation
   • NMT by jointly learning to align and translate: https://arxiv.org/abs/1409.0473
   • Effective Approaches to attention NMT: https://aclanthology.org/D15-1166/
   • NMT with subword units: https://aclanthology.org/P16-1162/
2. September 23: Multilingual neural machine translation
   • M2M-100: https://jmlr.csail.mit.edu/papers/volume22/20-1307/20-1307.pdf
   • balancing training data: https://aclanthology.org/2020.acl-main.754/
   • shared parameters in MNMT: https://aclanthology.org/2022.eamt-1.12/
   • zero-shot opt: https://aclanthology.org/2022.acl-long.12/
3. September 30: “No language left behind” MNMT:
   • Translation, NLLB: https://arxiv.org/ftp/arxiv/papers/2207/2207.04672.pdf
4. October 7: Low-resource NMT:
   • Smugri: https://aclanthology.org/2021.nodalida-main.5/
   • Livonian: https://aclanthology.org/2022.acl-short.55/
   • Revisiting: https://aclanthology.org/P19-1021/
5. October 14: Multi-task learning:
   • T5: https://arxiv.org/abs/1910.10683
   • mT5: https://arxiv.org/abs/2010.11934
   • ExT5: https://openreview.net/forum?id=Vzh1BFUCiIX
6. October 21: Text summarization:
   • https://aclanthology.org/2021.acl-long.538/
   • https://aclanthology.org/2022.acl-long.100/
7. October 28: Task-oriented dialogue:
   • https://aclanthology.org/2021.insights-1.9/
   • https://aclanthology.org/2021.emnlp-main.590/
   • https://aclanthology.org/2021.emnlp-main.142/
8. November 4: Question answering:
   • https://aclanthology.org/2022.dialdoc-1.5/
   • https://aclanthology.org/2021.acl-long.239/
9. November 11: Information extraction
   • Text-to-Triple: https://aclanthology.org/2021.emnlp-main.94/
   • Text-to-table: https://aclanthology.org/2022.acl-long.180/
10. November 18: Text-to-image:
    • Dall-e 2: https://arxiv.org/abs/2204.06125
    • 0-shot text-to-image: https://arxiv.org/abs/2102.12092
11. November 25: Text-to-speech:
    • Microsoft’s “human-level” TTS: https://arxiv.org/pdf/2205.04421.pdf
    • Neurokõne: https://www.bjmc.lu.lv/.../10_3_17_Ratsep.pdf
12. December 2: Data-to-text
    • https://aclanthology.org/D17-1239/
    • https://aclanthology.org/2022.acl-long.271/
13. December 11: image-to-text
    • GIT: https://arxiv.org/pdf/2205.14100.pdf
    • ViT+GPT: https://arxiv.org/abs/2201.12723
14. December 18: weird stuff
    • AMR-to-text: https://aclanthology.org/2021.emnlp-main.57.pdf
    • bert2BERT: https://aclanthology.org/2022.acl-long.151/