Skip to content
← All questions

Why do we add the equation π(a)+π(b)=1\pi(a)+\pi(b)=1 when solving for a stationary distribution?

We add the equation π(a)+π(b)=1\pi(a)+\pi(b)=1 because π\pi is a valid probability distribution, meaning its elements must sum to 1. This provides the second independent equation needed to solve the underdetermined system created by the redundant balance equations.

Conditions

  • π\pi is a probability distribution over the states.
  • The state space has exactly two states, a and b.

Reasoning, step by step

  1. Derive the balance equations from πP=π\pi P = \pi.
  2. Observe that these equations are linearly dependent and yield only a proportionality relation (e.g., 4π(b)=7π(a)4\pi(b) = 7\pi(a)).
  3. Apply the definition of a probability distribution, which requires the sum of all probabilities to be 1.
  4. Use π(a)+π(b)=1\pi(a) + \pi(b) = 1 as the second non-redundant equation.
  5. Solve the system of two independent equations to find the unique values of π(a)\pi(a) and π(b)\pi(b).

Example

The speaker says, "Well we know that it's a valid probability distribution. So its elements must sum to one." He then calls π(a)+π(b)=1\pi(a)+\pi(b)=1 "the equation that we can use as our second non-redundant equation."

Common misconceptions

  • Thinking that the balance equations alone are sufficient to determine the stationary distribution uniquely.
  • Assuming that the normalization condition is optional or just a convention, rather than a mathematical requirement for a probability distribution.

Watch the explanation

Connected concepts

Explore next

Related questions

Understand why

↗
Find a method

↗
Meet the concept

↗
Meet the concept

↗
Find a method

↗

Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.