31
Practical TensorFlow Illia Polosukhin, Google Research @ilblackdragon

Big data app meetup 2016-06-15

Embed Size (px)

Citation preview

Page 1: Big data app meetup 2016-06-15

Practical TensorFlowIllia Polosukhin, Google Research@ilblackdragon

Page 2: Big data app meetup 2016-06-15

Why Machine Learning?

★ Allows to solve problems we don’t have exact solution for.○ E.g. recommendations, predictions, clustering.

★ Given y = F(X), where we observe y, we can estimate F.

★ Becomes better with more data ○ when hard coded solution usually becomes worse with more

code :)

Page 3: Big data app meetup 2016-06-15

Google Products Using Machine Learning

Page 4: Big data app meetup 2016-06-15

Big Data Challenges

★Variety of data★Learning many things at once★Small data where matters

Page 5: Big data app meetup 2016-06-15

Deep LearningInput

Out

Page 6: Big data app meetup 2016-06-15

Input

Out

Deep Learning for Perception Tasks

Page 7: Big data app meetup 2016-06-15

Input

Out

Deep Learning for Perception Tasks

Page 8: Big data app meetup 2016-06-15

Input

Out

Deep Learning for Perception Tasks

Page 9: Big data app meetup 2016-06-15

Input

Out

Deep Learning for Perception Tasks

Page 10: Big data app meetup 2016-06-15

Input

Out

Deep Learning for Perception Tasks

Page 11: Big data app meetup 2016-06-15

Deep Learning combines many components

Predictions

GoogLeNet

Recurrent Neural Network

Page 12: Big data app meetup 2016-06-15

Deep Learning: Leverage pre-training

Page 13: Big data app meetup 2016-06-15

What is TensorFlow?

Page 14: Big data app meetup 2016-06-15
Page 15: Big data app meetup 2016-06-15

TensorFlow Ecosystem

Researchers Developers

Data Scientists

Page 16: Big data app meetup 2016-06-15

TensorFlow Core Execution Engine

CPU GPU Android iOS ...

C++ FrontendPython Frontend ...

Page 17: Big data app meetup 2016-06-15

TensorFlow: Google backed

★ Google supported (growing army of engineers are working on improving it).

★ Used in 100s of products across Google

Page 18: Big data app meetup 2016-06-15

How can I use this?

TensorFlow Learn

Page 19: Big data app meetup 2016-06-15

Simple example:

How can I use this?

Page 20: Big data app meetup 2016-06-15

Predictive Example

Going to deep neural network is easy:

Page 21: Big data app meetup 2016-06-15

Understanding Images

Page 22: Big data app meetup 2016-06-15

Image Classification

Page 23: Big data app meetup 2016-06-15
Page 24: Big data app meetup 2016-06-15

Recommendation Example

Page 25: Big data app meetup 2016-06-15

Recommendation Example

Image Description Item User

N layers of convolutions RNN encoder Item

embeddingsUser

embeddings

Concatenate

N fully connected layers Item embeddings P(item)

Page 26: Big data app meetup 2016-06-15
Page 27: Big data app meetup 2016-06-15
Page 28: Big data app meetup 2016-06-15
Page 29: Big data app meetup 2016-06-15

Scaling Out

TensorFlow scales with number of Machines.

You can use Google Cloud ML or Docker containers in VMs.https://arxiv.org/abs/1604.00981

Page 30: Big data app meetup 2016-06-15

TensorFlow Serving: Serving models in production

Open Source project.

Check it out:

http://github.com/tensorflow/serving

Page 31: Big data app meetup 2016-06-15

Questions?

Illia Polosukhin@ilblackdragon

#TensorFlowhttp://github.com/tensorflow/tensorflow

http://tensorflow.org