Information and capacity#

Signalling rate, entropy and channel capacity.

Nyquist’s signalling rate: 2B pulses per second

Nyquist's signalling rate: 2B pulses per second

Hartley’s law: information grows with the logarithm of the levels

Hartley's law: information grows with the logarithm of the levels

Shannon’s entropy and the binary symmetric channel

Shannon's entropy and the binary symmetric channel

The Shannon-Hartley capacity of a noisy band-limited channel

The Shannon-Hartley capacity of a noisy band-limited channel