Deep Learning, beyond the hype!

Machine Learning vs Deep learning vs A.I.

What are the different species in the zoo?

Hype or reality?

Performances

What’s the secret sauce of Deep Neural Nets ?

How does it works?

Depth and Performances

What about creativity?

From classification to generationA small yellow bird with a back crown and a short black pointed beak

Which ones are real images, which ones are generated by the algorithm?

From classification to generationA small yellow bird with a back crown and a short black pointed beak

From classification to generation

GANGenerative Adversarial Networks

Ian J. Goodfellow & al, 2014

StackGANText to Photo-realistic Image Synthesis

Han Zhang & al, 2016

Any Limits?

Adversarial examples

“Panda”57.7% Confidence

“Nematode”8.2% Confidence

“Gibbon”99.9% Confidence

Any Limits?Unsurpervised learning

Reinforcement Learning→ predict a scalar reward→ A few bits per samples

Supervised Learning→ Predicting human supplied data→ 10 to 10000 bits per samples

All the rest is unsupervised Learning→ Predicting unknown parts from observation→ Building its own representation→ Millions of bits per samples

Ex: predicting frames in videos, generating images, music...

The race for power

Energy efficiency?

VS

Brain = 20W2.2 billion megaflops

Super Computers =until 10 millions watts

Annexe: Stack GAN