Skip to content
← All questions

What is the stationary distribution in a Markov chain and why is it important for MCMC?

The stationary distribution is a probability distribution that remains unchanged as the Markov chain evolves. It is important for MCMC because when the chain reaches equilibrium, the long-run fraction of time spent in each region exactly matches the target probability, allowing the chain to act as a perfect sampler.

Conditions

  • The Markov chain must reach equilibrium.
  • π\pi is a probability vector and PP is the transition matrix.
  • The target distribution is π\pi.

Reasoning, step by step

  1. Define the stationary distribution as the equilibrium state where π=πP\pi = \pi P.
  2. Observe that regardless of the starting point, all chains converge to the same statistical behavior.
  3. Measure the fraction of time each chain spends in different regions.
  4. Verify that these time fractions match the target distribution's probabilities.

Example

The video shows red, blue, and green dots starting at different points on a bimodal curve and eventually settling into proportions matching the peaks (30% and 70%), with the formula π=πP\pi = \pi P displayed.

Common misconceptions

  • Assuming the stationary distribution depends on the initial state of the chain.
  • Believing that the chain stops moving once it reaches the stationary distribution, rather than continuing to fluctuate around equilibrium.

Watch the explanation

Connected concepts

Explore next

Related questions

Understand why

↗
Understand why

↗
Meet the concept

↗
Meet the concept

↗
Understand why

↗

Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.