Loengud
Loengute info.
Lecture slides
Lecture 1.1: Measuring amount of information. Entropy
Lecture 1.2: Prefix codes. Huffman code. Shannon code
Lecture 2.1: Arithmetic coding.
Lecture 2.2: Off-line universal coding
Lecture 3.1: On-line adaptive universal coding.
Lecture 3.2: Low-complexity coding: Monotonic codes. LZ-77.
Lectures 4: LZW, PPM, BWT. Comparisons. Challenges
Lectures 10: Analog sources. Measuring information Δ
Problem-solving sessions slides
Measuring information. Instant coding
Homework Assignments
Home assignment: Entropy. Deadline 07.11.2025
Matlab scripts
Auxilary
word2bin.m - Representing integer in binary form Δ
bin2word.m - Transforming binary sequence to integer Δ
Entropy
entropy.m - computing entropy for given p.d.
HWex.m - Empiric estimate of the entropy rate
Huffman
Huffman.m - Huffman code constructing Δ
Huffman_dec.m - Huffman code single symbol decoder Δ
uniform_enc.m - Huffman coding for uniform distribution Δ
uniform_dec.m - Huffman decoding for uniform distribution Δ
Off-line coding
Huffman_enc_seq.m - Huffman code. Sequence encoding Δ
Huffman_dec_seq.m - Huffman code. Sequence decoding Δ
encode_tree.m - Encode Huffman code tree Δ
decode_tree.m - Decode Huffman code tree Δ
Huffman_dec_seq.m - Huffman code. Sequence decoding Δ
Test_Huffman.m - Huffman code coding test Δ
Off_line_Huffman.m - Demo-program of using Huffman code for universal off-line coding Δ
Arithmetic coding
int_arithm_enc.m - Arithmetic encoder in integer arithmetics Δ
int_arithm_dec.m - Arithmetic decoder in integer arithmetics Δ
test.m - Testing program for arithmetic coding Δ
Online adaptive coding
symbol_encoder.m - Single symbol encoder (for adaptive coding) Δ
symbol_decoder.m - Single symbol decoder (for adaptive coding) Δ
adaptive_arithm_coding.m - Adaptive on-line coding) Δ
adaptive_arithm_decoding.m - Adaptive on-line decoding) Δ
Archivers
LZ77.m Lempel-Ziv algorithm Δ
LZW.m Lempel-Ziv-Welch algorithm Δ
Test files
Set of files for the first homework Δ
Set of short phrases for compression experiments Δ