What is the initial state vector in this example?
The initial state vector is a column vector that encodes the starting probabilities of the Markov chain. In this specific example, , meaning the system starts in state A with probability 1 and in state B with probability 0.
Conditions
- The system has two states, A and B.
- The components are ordered consistently with the states, here A then B.
- The entries are probabilities describing the initial distribution.
Reasoning, step by step
- Identify the states of the system, which are A and B.
- Write the initial state vector as a column vector.
- Assign the top component to state A and the bottom component to state B.
- Interpret the numerical entries as the probabilities of starting in each respective state.
Example
The formula appears as . The speaker says the top component refers to state A and that 1 means a 100% probability it starts in state A, while the bottom component refers to state B and 0 means a 0% probability it starts in state B.
Common misconceptions
- Thinking that is derived from the transition probabilities rather than being an asserted initial condition.
- Assuming that a Markov-chain state vector always has only two entries, whereas the number of components equals the number of states.
Watch the explanation
1:13 – 1:59Watch this moment ↗
Explore next
Answers are generated from source material and independently checked. Consult the original video or creator if something is unclear.