Source coding

Lossless compression: from the typical set to Huffman, arithmetic, and Lempel-Ziv codes.

Shannon’s source coding theorem: the typical set (1948)

Shannon's source coding theorem: the typical set (1948)

Shannon-Fano coding (1948-1949)

Shannon-Fano coding (1948-1949)

The Kraft-McMillan inequality (1949, 1956)

The Kraft-McMillan inequality (1949, 1956)

Huffman coding (1952)

Huffman coding (1952)

Elias’ universal code for the integers (1975)

Elias' universal code for the integers (1975)

Arithmetic coding (1976)

Arithmetic coding (1976)

Lempel-Ziv compression (1977-1978)

Lempel-Ziv compression (1977-1978)