- Home
Documents
- 15 October 2012 Eurecom, Sophia-Antipolis Thrasyvoulos Spyropoulos / Discrete Time Markov Chains
If you can't read please download the document
15 October 2012 Eurecom, Sophia-Antipolis Thrasyvoulos Spyropoulos / Discrete Time Markov Chains
Embed Size (px)
DESCRIPTION
Thrasyvoulos Spyropoulos / Eurecom, Sophia-Antipolis Assume state space: 0, 1, 2, … P ij : P{S(n+1) = j | S(n) = i} Stationary: P{S(n+1) = j | S(n) = i} = P{S(1) = j | S(0) = i} for any n p ij define a transition matrix P = 3
