What does the 0.75 label on the arrow from A to A mean?

Conditions

• The system is in state A at the current step.
• The arrow is a self-loop on state A in the transition diagram.

Reasoning, step by step

1. Locate the arrow that starts at state A and ends at state A.
2. Read the numerical label on this arrow, which is 0.75.
3. Interpret this label as the conditional probability of the next state being A, given the current state is A.

Example

The speaker explicitly reads the 0.75 self-loop on A as the probability that a system currently in A remains in A after one iteration.

Common misconceptions

• Thinking that 0.75 means the system spends 75% of its total time in state A.
• Assuming that the system is guaranteed to stay in state A for 75% of the steps.

Watch the explanation

Explore next

• What is the initial state vector $S_0$ in this example?
• Why introduce matrices and vectors when studying Markov chains?