Kaelbling Reinforcement

Embed Size (px)

Citation preview

  • 7/31/2019 Kaelbling Reinforcement

    1/49

  • 7/31/2019 Kaelbling Reinforcement

    2/49

    a

    T

    s

    i

    rBI

    R

  • 7/31/2019 Kaelbling Reinforcement

    3/49

  • 7/31/2019 Kaelbling Reinforcement

    4/49

  • 7/31/2019 Kaelbling Reinforcement

    5/49

  • 7/31/2019 Kaelbling Reinforcement

    6/49

    Finite horizon, h=4

    Infinite horizon, =0.9

    Average reward

    +2

    +10

    +11

  • 7/31/2019 Kaelbling Reinforcement

    7/49

  • 7/31/2019 Kaelbling Reinforcement

    8/49

  • 7/31/2019 Kaelbling Reinforcement

    9/49

    1 2 3 N-1 N 2N 2N-1 N+3 N+2 N+1

    a = 0 a = 1

    r = 0

    r = 1

    1 2 3 N-1 N 2N 2N-1 N+3 N+2 N+1

    a = 0 a = 1

  • 7/31/2019 Kaelbling Reinforcement

    10/49

  • 7/31/2019 Kaelbling Reinforcement

    11/49

  • 7/31/2019 Kaelbling Reinforcement

    12/49

  • 7/31/2019 Kaelbling Reinforcement

    13/49

  • 7/31/2019 Kaelbling Reinforcement

    14/49

  • 7/31/2019 Kaelbling Reinforcement

    15/49

  • 7/31/2019 Kaelbling Reinforcement

    16/49

    AHC

    RL

    vs

    r

    a

  • 7/31/2019 Kaelbling Reinforcement

    17/49

  • 7/31/2019 Kaelbling Reinforcement

    18/49

  • 7/31/2019 Kaelbling Reinforcement

    19/49

  • 7/31/2019 Kaelbling Reinforcement

    20/49

    . . . . . . . Goal1 2 3 n

  • 7/31/2019 Kaelbling Reinforcement

    21/49

  • 7/31/2019 Kaelbling Reinforcement

    22/49

  • 7/31/2019 Kaelbling Reinforcement

    23/49

  • 7/31/2019 Kaelbling Reinforcement

    24/49

  • 7/31/2019 Kaelbling Reinforcement

    25/49

  • 7/31/2019 Kaelbling Reinforcement

    26/49

  • 7/31/2019 Kaelbling Reinforcement

    27/49

  • 7/31/2019 Kaelbling Reinforcement

    28/49

    G

    Start

    Goal

    (a)

    G

    (b)

    G

    (c)

  • 7/31/2019 Kaelbling Reinforcement

    29/49

  • 7/31/2019 Kaelbling Reinforcement

    30/49

    s b1

    b2

    b3

    g a

  • 7/31/2019 Kaelbling Reinforcement

    31/49

    2/5 1/5

    2/5

    printer

    office

    +100

    hallhall

  • 7/31/2019 Kaelbling Reinforcement

    32/49

  • 7/31/2019 Kaelbling Reinforcement

    33/49

    ib a

    SE

  • 7/31/2019 Kaelbling Reinforcement

    34/49

  • 7/31/2019 Kaelbling Reinforcement

    35/49

  • 7/31/2019 Kaelbling Reinforcement

    36/49

  • 7/31/2019 Kaelbling Reinforcement

    37/49

  • 7/31/2019 Kaelbling Reinforcement

    38/49

  • 7/31/2019 Kaelbling Reinforcement

    39/49

  • 7/31/2019 Kaelbling Reinforcement

    40/49

  • 7/31/2019 Kaelbling Reinforcement

    41/49

  • 7/31/2019 Kaelbling Reinforcement

    42/49

  • 7/31/2019 Kaelbling Reinforcement

    43/49

  • 7/31/2019 Kaelbling Reinforcement

    44/49

  • 7/31/2019 Kaelbling Reinforcement

    45/49

  • 7/31/2019 Kaelbling Reinforcement

    46/49

  • 7/31/2019 Kaelbling Reinforcement

    47/49

  • 7/31/2019 Kaelbling Reinforcement

    48/49

  • 7/31/2019 Kaelbling Reinforcement

    49/49