mathematicskit.information_theory
=================================


.. include:: /_generated/nav/information_theory.rst

Hartley's measure, Shannon entropy, joint/conditional entropy, mutual
information and the Kullback-Leibler divergence via
``scipy.stats.entropy``; the typical set, the Kraft-McMillan
inequality, Shannon-Fano, Huffman, Elias gamma, arithmetic and LZ78
codes; channel capacity (binary symmetric, erasure, Gaussian, and
Blahut-Arimoto for any discrete memoryless channel), random codes and
rate-distortion; and Hamming, convolutional (Viterbi) and Gallager LDPC
codes with their decoders.

.. automodule:: mathematicskit.information_theory
   :members:
   :undoc-members: