Why do we add the equation when solving for a stationary distribution?
Conditions
- is a probability distribution over the states.
- The state space has exactly two states, a and b.
Reasoning, step by step
- Derive the balance equations from .
- Observe that these equations are linearly dependent and yield only a proportionality relation (e.g., ).
- Apply the definition of a probability distribution, which requires the sum of all probabilities to be 1.
- Use as the second non-redundant equation.
- Solve the system of two independent equations to find the unique values of and .
Example
The speaker says, "Well we know that it's a valid probability distribution. So its elements must sum to one." He then calls "the equation that we can use as our second non-redundant equation."
Common misconceptions
- Thinking that the balance equations alone are sufficient to determine the stationary distribution uniquely.
- Assuming that the normalization condition is optional or just a convention, rather than a mathematical requirement for a probability distribution.
Watch the explanation
Connected concepts
Explore next
Related questions
The equations derived from are linearly dependent because the rows of the transition matrix sum to 1. This implies that the sum of the equations is identically zero, leaving only independent constraints for states.
Conditions: is a stochastic matrix (rows sum to 1).; is a row vector of probabilities.
To find a stationary distribution for a Markov chain, one solves the system of linear equations given by , subject to the constraint that the probabilities in sum to 1.
Conditions: is the transition matrix of the Markov chain.; is a row vector of probabilities.
The stationary distribution is the row vector .
Conditions: The transition matrix is .; is a row vector satisfying and .
A stationary distribution (also called an invariant distribution) is a probability distribution row vector that remains unchanged when multiplied by the transition matrix of a Markov chain. This means that if the system starts in this distribution, it will remain in this distribution at all future time steps.
Conditions: is a row vector.; is the transition matrix of the Markov chain.; The elements of are non-negative and sum to 1.
By substituting into , we get . Combining the terms yields , and solving for gives .
Conditions: The balance equation gives , which rearranges to .; The normalization equation is .
Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.