Source coding

Source coding represents messages efficiently, with entropy constraining lossless average code length.

Different ways to understand it

No reviewed video yet. Explore the concept in a map or suggest a resource. Suggest a video

Channel capacity
Capacity bounds achievable reliable information rates for a specified channel model.
Hamming distance
Hamming distance counts differing positions between equal-length strings.
Prefix codes
No codeword is a prefix of another, enabling unambiguous immediate decoding.
Shannon entropy
Entropy is expected negative log probability for a discrete distribution.
Conditional entropy
Conditional entropy averages remaining uncertainty after another variable is observed.