Skip to content
START WITH A QUESTION

What would you like to understand?

Find an answer. See the moment it becomes clear. Follow the idea further.

← Concept directory

Answers for “为什么条件熵 H(X|Y) 总是小于或等于无条件熵 H(X)?”

1 keyword matches

Understanding your question. You can explore the search results below now.

Meet the concept

↗

Conditional entropy H(X|Y) measures the average remaining uncertainty or surprise about a random variable X after another random variable Y has been observed. It is defined as the expected value of the conditional self-information h(x|y) over the joint distribution of X and Y.

Conditions: X and Y are discrete random variables.; The sum is taken over the joint alphabet Ax×AyA_x \times A_y.