Skip to content
← All questions

Why is Bayes' theorem true for events A and B of positive probability?

Bayes' theorem is true because the joint probability of two events can be decomposed in two symmetric ways. The probability that both A and B occur is equal to the probability of A multiplied by the conditional probability of B given A, and also equal to the probability of B multiplied by the conditional probability of A given B. Equating these two expressions and dividing by the appropriate marginal probability yields Bayes' theorem.

Conditions

  • A and B are events in the same probability space.
  • Both A and B have positive probability for the ordinary conditionals used here.

Reasoning, step by step

  1. Identify the joint probability P(A and B).
  2. Express P(A and B) as P(A)PP(A)P(B|A) by first taking the proportion of cases where A is true, then the fraction of those where B is also true.
  3. Express P(A and B) as P(B)PP(B)P(A|B) by mirroring the previous step with the roles of A and B exchanged.
  4. Equate the two expressions: P(A)PP(A)P(B|A) = P(B)PP(B)P(A|B).
  5. Divide by P(B)P(B) to solve for P(A|B), yielding P(A|B) = P(A)PP(A)P(B|A)/P(B).
  6. Alternatively, divide by P(A)P(A) to solve for P(B|A), yielding P(B|A) = P(B)PP(B)P(A|B)/P(A).

Example

The video displays the chain P(B)PP(B)P(A|B) = P(A and B) = P(A)PP(A)P(B|A), then rearranges it to P(A|B) = P(A)PP(A)P(B|A)/P(B) and P(B|A) = P(B)PP(B)P(A|B)/P(A).

Common misconceptions

  • Mistaking the asymmetric-looking product formula for a genuinely asymmetric joint probability; they are equal because both compute the same event probability P(A and B).
  • Overlooking the need for nonzero denominators in the rearranged formulas; to divide by P(B)P(B) or P(A)P(A), one needs P(B)≠0P(B) \ne 0 or P(A)≠0P(A) \ne 0 respectively.

Watch the explanation

Connected concepts

Explore next

Related questions

Find a method

↗
Find a method

↗
Find a method

↗
Understand why

↗
Find a method

↗

Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.