Hamming distanceconceptRelated → Linear codesRelated → Error correction boundsRelated → Source codingRelated → ProbabilityLeads to → Error correction bounds
Shannon entropyconceptRelated → Conditional entropyRelated → Relative entropyRelated → ProbabilityRelated → Source codingLeads to → Conditional entropyRequires → Probability
Source codingconceptRelated → Prefix codesRelated → Channel capacityRelated → Shannon entropyRelated → Hamming distance
Conditional entropyconceptRelated → Shannon entropyRelated → Mutual informationRequires → Shannon entropy
Error correction boundsconceptRelated → Parity checksRelated → Hamming distanceRequires → Hamming distance