31
Introduction to Artificial Intelligence COSC 4550 / COSC 5550 Professor Cheney 11/6/17

Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

Introduction to Artificial IntelligenceCOSC 4550 / COSC 5550

Professor Cheney11/6/17

Page 2: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

sample exam posted

2 weeks until project half-way check-in

paper readings

withdraw deadline this week!

Page 3: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

many slides today borrowed from Xavier Giro-i-Nieto

(sorry for lack of pixels… )

Page 4: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

end-to-end differentiable!

Page 5: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 6: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

neural networks have been around for decades – why now?

recent advances in deep learning are due to:

huge labeled datasets

deeper and deeper architectures

some simple, but clever, tricks to better train these networks

Page 7: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

demo! …?

Page 8: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

yosinski.com/deepvis

Page 9: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

huge labeled datasets

Page 10: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 11: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 12: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 13: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

MNIST(Modified National Institute of Standards and Technology)

60,000 training, 10,000 testing

Page 14: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

20 classes. The train/val data has 11,530 images containing 27,450 ROI annotated objects and6,929 segmentations.

Page 15: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

Caltech 256

(256 object categories, 30607 images)

Page 16: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

and many more…

including industrial datasets

(e.g. Netflix Prize – $1,000,000 prize to create rating prediction algorithm better than Netflix's current best)

Kaggle.com

Data.gov

...

Page 17: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl

deeper and deeper architectures

Page 18: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 19: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 20: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 21: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 22: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 23: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 24: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 25: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 26: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 27: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 28: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 29: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 30: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl
Page 31: Introduction to Artificial Intelligence COSC 4550 / COSC 5550 …€¦ · PASCAL2 Pattern Analysis, Statistical Modelling and Computational Learning lcJ'cK on an [mage sec tu anmotattonl