Skip to content
START WITH A QUESTION

What would you like to understand?

Find an answer. See the moment it becomes clear. Follow the idea further.

← Concept directory

Answers for “条件熵 H(X|Y) 与联合熵 H(X,Y) 和边缘熵 H(Y) 有什么关系?”

1 keyword matches

Understanding your question. You can explore the search results below now.

Understand why

↗

Joint entropy H(X,Y)H(X,Y) is not equal to H(X)+H(Y)H(X) + H(Y) because adding the marginal entropies double-counts the mutual information I(X;Y) shared between the variables. The correct relationship is H(X,Y)=H(X)+H(Y)−IH(X,Y) = H(X) + H(Y) - I(X;Y).

Conditions: X and Y are random variables that may share information (i.e., they are not necessarily independent).