Skip to content
START WITH A QUESTION

What would you like to understand?

Find an answer. See the moment it becomes clear. Follow the idea further.

← Concept directory

Answers for “条件熵 H(X|Y) 与联合熵 H(X,Y) 和边缘熵 H(Y) 有什么关系?”

2 keyword matches

Understanding your question. You can explore the search results below now.

Meet the concept

↗

Conditional entropy H(X|Y) measures the average remaining uncertainty or surprise about a random variable X after another random variable Y has been observed. It is defined as the expected value of the conditional self-information h(x|y) over the joint distribution of X and Y.

Conditions: X and Y are discrete random variables.; The sum is taken over the joint alphabet Ax×AyA_x \times A_y.

Meet the concept

↗

The exercise asks students to implement a Matlab function conditionalentropy(p) that computes the conditional entropy of X given Y from a 2D joint probability matrix p(x,y)p(x,y). It includes specific test cases to verify correctness, such as deterministic and uniform distributions.

Conditions: Input p is assumed to be a 2D joint probability array p(x,y)p(x,y).; Students may reuse existing entropy() and jointentropy() routines.