Institute of Computer Science
  1. Courses
  2. 2025/26 fall
  3. Foundation Models: From Symbolic Reasoning to Deep Learning (LTAT.02.034)
ET
Log in

Foundation Models: From Symbolic Reasoning to Deep Learning 2025/26 fall

  • Pealeht
  • Loengud
  • Assignments&Grading?
    • Homework and Schedule?
      • Information?
      • Submit?
      • Grading?
    • Essays?
    • Projects?
    • Exam?
  • Help?
  • Links

Loengud

Loengute info.

Lecture slides

General information Δ
Lecture 3: Measuring amount of information. Entropy Δ
Lecture 4: Stationary sources. Prefix codes. Huffman code Δ
Lecture 5: Arithmetic coding. Δ
Lecture 6: Off-line universal coding Δ
Lecture 7: On-line adaptive universal coding Δ
Lecture 8: Low-complexity universal coding: Monotonic codes. LZ-77 Δ
Lectures 9: LZW, PPM, BWT. Comparisons. Challenges Δ
Lectures 10: Analog sources. Measuring information Δ

Problem solving session slides

1. Measuring information. Markov chains Δ
2. Instant coding Δ

Matlab scripts

Auxilary

word2bin.m - Representing integer in binary form Δ
bin2word.m - Transforming binary sequence to integer Δ

Entropy

Entropy.m - computing entropy for given p.d. Δ
Problem12.m - Empiric estimate of the entropy rate Δ

Huffman

Huffman.m - Huffman code constructing Δ
Huffman_dec.m - Huffman code single symbol decoder Δ
uniform_enc.m - Huffman coding for uniform distribution Δ
uniform_dec.m - Huffman decoding for uniform distribution Δ

Off-line coding

Huffman_enc_seq.m - Huffman code. Sequence encoding Δ
Huffman_dec_seq.m - Huffman code. Sequence decoding Δ
encode_tree.m - Encode Huffman code tree Δ
decode_tree.m - Decode Huffman code tree Δ
Huffman_dec_seq.m - Huffman code. Sequence decoding Δ
Test_Huffman.m - Huffman code coding test Δ
Off_line_Huffman.m - Demo-program of using Huffman code for universal off-line coding Δ

Arithmetic coding

int_arithm_enc.m - Arithmetic encoder in integer arithmetics Δ
int_arithm_dec.m - Arithmetic decoder in integer arithmetics Δ
test.m - Testing program for arithmetic coding Δ

Online adaptive coding

symbol_encoder.m - Single symbol encoder (for adaptive coding) Δ
symbol_decoder.m - Single symbol decoder (for adaptive coding) Δ
adaptive_arithm_coding.m - Adaptive on-line coding) Δ
adaptive_arithm_decoding.m - Adaptive on-line decoding) Δ

Archivers

LZ77.m Lempel-Ziv algorithm Δ
LZW.m Lempel-Ziv-Welch algorithm Δ

Homework Assignments

Home assignment 1: Entropy. Deadline ... Δ
Home assignment 2: Lossless compression. Deadline ... Δ

Test files

Set of files for the first homework Δ
Set of short phrases for compression experiments Δ

  • Institute of Computer Science
  • Faculty of Science and Technology
  • University of Tartu
In case of technical problems or questions write to:

Contact the course organizers with the organizational and course content questions.
The proprietary copyrights of educational materials belong to the University of Tartu. The use of educational materials is permitted for the purposes and under the conditions provided for in the copyright law for the free use of a work. When using educational materials, the user is obligated to give credit to the author of the educational materials.
The use of educational materials for other purposes is allowed only with the prior written consent of the University of Tartu.
Terms of use for the Courses environment