21
7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 1/21 MARKOV CHAIN A, B and C are three towns. Each year: 10% of the residents of A move to B 20% of the residents of A move to C 20% of the residents of B move to A 30% of the residents of B move to C 20% of the residents of C move to A 20% of the residents of C move to B Everybody else stays !t. "o one dies. "o one is born.

4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

Embed Size (px)

Citation preview

Page 1: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 1/21

MARKOV CHAIN

A, B and C are three towns. Each year:

10% of the residents of A move to B

20% of the residents of A move to C

20% of the residents of B move to A

30% of the residents of B move to C

20% of the residents of C move to A20% of the residents of C move to B

Everybody else stays !t. "o one dies. "o one is born.

Page 2: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 2/21

A

B

C

A, B, and C are

three towns.

10 eole live in A

1# eole live in C

20 eole live in B

Page 3: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 3/21

A

B

C

Each year10% of the residents of A

move to B

.10

  and20% of the residents

of A move to C 

.20

Page 4: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 4/21

A

B

C

.10

.20

Each year20% of the residents of B

move to A

.20

  and30% of the residents

of B move to C 

.30

Page 5: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 5/21

A

B

C

.10

.20

.20

.30

Each year20% of the residents of C

move to A

.20

  and20% of the residents

of C move to B 

.20

Page 6: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 6/21

A

B

C

.10

.20

.20

.30

.20

.20

Page 7: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 7/21

A

B

C

.10

.20

.20

.30

.20

.20

Page 8: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 8/21

A

B

C

.10

.20

.20

.30

.20

.20

Page 9: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 9/21

B

A

C

.10

.20

.20

.30

.20

.20

1$1$

1

AB

C

1020

1#

This year 

 Next year 

Where will everyone be in 10 years

Page 10: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 10/21

Page 11: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 11/21

A

B

C

.10

.20

.20

.30

.20

.20

Page 12: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 12/21

AB

C

.10

.20

.20

.30.20

.20

An&1 ' .An

Page 13: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 13/21

A

C

.10

.20

.20

.30.20

.20

An&1 ' .An & .2Bn & .2Cn

B

Page 14: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 14/21

A

C

.10

.20

.20

.30.20

.20

An&1 ' .An & .2Bn & .2Cn

Bn&1 ' .1An & .#Bn & .2Cn

B

Page 15: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 15/21

A

C

.10

.20

.20

.30.20

.20

An&1 ' .An & .2Bn & .2Cn

Bn&1 ' .1An & .#Bn & .2Cn

Cn&1 ' .2An & .3Bn & .(Cn

B

Page 16: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 16/21

A

C

.10

.20

.20

.30.20

.20

An&1 ' .An & .2Bn & .2Cn

Bn&1 ' .1An & .#Bn & .2Cn

Cn&1 ' .2An & .3Bn & .(Cn  

  

 

 

 

 

 

  

 

 

 

 =

n

n

n

 B

 A

!"#"$"

$"%"1"

$"$"&"

B

Page 17: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 17/21

An&1 ' .An & .2Bn & .2Cn

Bn&1 ' .1An & .#Bn & .2Cn

Cn&1 ' .2An & .3Bn & .(Cn  

  

 

 

 

 

 

  

 

 

 

 =

n

n

n

 B

 A

!"#"$"

$"%"1"$"$"&"

 Note' "&("1("$ ) 1" This a**o+nts ,or 100- o, those in town A in year n

Cn&1 ' .2An & .3Bn & .(CnCn&1 ' .2An & .3Bn & .(Cn

 Note' "$("%("# ) 1" This a**o+nts ,or 100- o, those in town . in year n

 Note' "$("$("! ) 1" This a**o+nts ,or 100- o, those in town C in year n

Page 18: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 18/21

  

 

 

 

 

 

  

 

 

 

 

 

=  

 

 

 

 

 

+

+

+

n

n

n

n

n

n

 B

 A

 B

 A

!"#"$"$"%"1"

$"$"&"

1

1

1

nn   v M v   =+1

0

/

1

#

$

$

#/

0

#

1

$

$#

0$

1$

01

v M v M v M v M v

v M v M v M v

v M v M v

v M v

====

=====

=

Page 19: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 19/21

  

 

 

 

 

 

  

 

 

 

 

 

=  

 

 

 

 

 

+

+

+

n

n

n

n

n

n

 B

 A

 B

 A

!"#"$"$"%"1"

$"$"&"

1

1

1

nn   v M v   =+1

0v M v   nn =

Page 20: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 20/21

.e*a+se the s+ o, the n+bers in ea*h *ol+n o, M is 1

1 is an ei)enval!e ,or M and

An ei2enve*tor belon2in2 to 1 will des*ribe stable 3ro3ortions"

The n+ll s3a*e o, 1I 4 M ) the n+ll s3a*e o,

   

 

 

 

 

!"#"$"

$"%"1"$"$"&"

   

 

 

 

 

100

010001

5   

 

 

 

 

−−−−−−

/"#"$"

$"%"1"$"$"#"

)

Page 21: 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

7/24/2019 4 MarkovChain ISox upon a time fake pdfSox upon a time fake pdfSox upon a time fake pdf

http://slidepdf.com/reader/full/4-markovchain-isox-upon-a-time-fake-pdfsox-upon-a-time-fake-pdfsox-upon-a-time 21/21

   

 

 

 

 

−−−−

−−

/"#"$"

$"%"1"

$"$"#"

The n!ll sace o,  )

   

 

 

 

 

1#

6

1/

7+33ose there are this year 1/0 3eo3le in A 60 3eo3le in . and

1#0 3eo3le in C" How any will be in ea*h town next year

=

  

 

 

  

 

 

1#0

60

1/0

!#$

$"%"1"

$"$"&"