Understand why↗
Conditional entropy H(X|Y) is bounded by (X|Y) ≤ because learning the value of Y provides information that can only reduce or leave unchanged the average uncertainty about X; it cannot increase it on average.
Conditions: X and Y are discrete random variables.
Conditional entropy H(X|Y) is bounded by (X|Y) ≤ because learning the value of Y provides information that can only reduce or leave unchanged the average uncertainty about X; it cannot increase it on average.
Conditions: X and Y are discrete random variables.