States of Markov Chain
•
Represent state at time t as vector:
•
w(t) = (P(q(t)=S1), P(q(t)=S2), … P(q(t) = SN))
•
Put transitions, a(ij) into matrix A.
–
A is
Stochastic,
meaning columns sum to 1.
•
Then w(t) = A*w(t-1).
•
•