24
Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Embed Size (px)

Citation preview

Page 1: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Carlos Rodriguezon

Heat, Learning and Prediction

July 10, 2007

(52)

Page 2: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Problem:

I have a brain I observe x I want to understand x I need to predict future x'

How ?

Page 3: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Brain ?

Why ?

Page 4: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 5: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

movement brain

Page 6: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

sea squirtat home

Page 7: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

CNS for navigation

Page 8: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Bio

Phys

Math

Page 9: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 10: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 11: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 12: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 13: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 14: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 15: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 16: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 17: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 18: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 19: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 20: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 21: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

** I G N O R A N C E **

minimized when

Page 22: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

OPTIMALITY OF CONJUGATE PRIORS

minimizes:

provided

Page 23: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Example:

need

Page 24: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)