AI is Coming! Are You Ready? The story of “Self-Driving Datacenter”

AI is coming! Are you ready?

Story of “Self-Driving” Datacenter

Sergey A. RazinCTO, SIOS Technology Corp.

2

Who is SIOS?

Who is SIOS?

3

What is

Machine Learning?“the state of humanity”

Does ML Exist Today?

5

What is Machine Learning?

6

Why

Machine Learning?“ML will save the world”

Productivity

8

IoT - Is a big deal!

9

Internet of Things Kills Internet

10

What is the problem? Why Conventional Tools Can’s Solve It?

• Understanding of Data Semantics because:• Data is Big

• Data is complex

• Data is high-dimensional (with a lot of interrelationships and interplay)

• Data is features rich

• Solution required different type of tool

12

2016 and 2017

ML is HOT!

Let’s look at the IT evolution

14

How did IT started?

15

How did IT started?

16

18

Give me more Data!

19

Operational Scale & Complexity in Virtualized IT

20

0

10,000,000,000

20,000,000,000

30,000,000,000

40,000,000,000

50,000,000,000

60,000,000,000

70,000,000,000

1001,000

3,0005,000

10,000

100 1,000 3,000 5,000 10,000

VMs 100 1,000 3,000 5,000 10,000

# of Objects 2,000 15,000 50,000 100,000 200,000

# of Metrics 604,800,000 4,536,000,000 15,120,000,000 30,240,000,000 60,480,000,000

IT Operations with the Hammer and a Chisel

21

22

API

Conventional Tools

Copyright @ 2015 SIOS Technology Corp. All rights reserved. 23

Data

Still Dealing With Noise

Conventional Tools

State of The Productized Art


Computer Science Approach

State of The Productized Art




What if there was a solution?


Topological Behavior Analysis


Topological Data Analysis (TDA)


TDA

Mathematics (Topology)Data

Shape

Algorithms – How is TBA works?



Algorithms – How is TBA works?

Dynamic K (Deep Learning):- Data scaling- Goal is Gaussian distribution with in the

cluster via PDF- Re-cluster -> # of K- Throw away noise clusters

Semi-Supervised power of Clusters:- Cluster Tagging- Cluster Instrumentation


Algorithms – How is TBA works? (Learned Behavior)

“Shape” of the date.

Algorithms – How is TBA works? (Topology)


Monthly Topology

0

0.2

0.4

0.6

0.8

1

1 2 3 4 5 6 7

Me

tric

0

0.2

0.4

0.6

0.8

1

1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31

Quarterly Topology

Etc.


Algorithms – How is TBA works? (Anomaly)

Dynamic ML Sensitivity Coefficient (Deep Learning)



Topological Behavior Analysis (TBA)

38

What’s Next?

Self-Driving Datacenter

39

What is

Machine Learning

for Real?

What is Machine Learning for Real?

41

- It is science- It is algorithms- It is pattern recognition

and computational learning theory in artificial intelligence

42

Why should

you brush up

on Algorithms?

Expert Knowledge + Machine Intelligence

43

44

Stay Relevant - Education

Machine Learning Course: https://www.coursera.org/learn/machine-learning

https://www.coursera.org/learn/machine-learning

DIY – Machine Learning/Deep Learning

http://www.r-project.org/

http://www.cs.waikato.ac.nz/ml/weka/

https://mahout.apache.org/

https://www.tensorflow.org/

https://madlib.incubator.apache.org/

http://spark.apache.org/docs/latest/ml-guide.html

http://www.r-project.org/



https://mahout.apache.org/

https://www.tensorflow.org/

https://madlib.incubator.apache.org/

http://spark.apache.org/docs/latest/ml-guide.html

Social Graph -> IT Graph

http://neo4j.com/

FlockDB

https://github.com/twitter/flockdb

http://giraph.apache.org/

http://neo4j.com/

http://neo4j.com/

https://github.com/twitter/flockdb

http://giraph.apache.org/

47

Neo4j

https://www.vmware.com/support/pubs/sdk_pubs.html

API

https://www.vmware.com/support/pubs/sdk_pubs.html

48

49

Want to see it

in Action?http://us.sios.com/

SIOS iQ™Machine Learning Analytics for optimizing

VMware environments

51

• Data Scientists

• Back-end and Full Stack

Developers

Job Opportunities @ SIOS

Great People. Exciting and Innovative Projects.