20
The Self-Driving Network™: How to Realize It Kireeti Kompella, CTO, Engineering

The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

The Self-Driving Network™: How to Realize It Kireeti Kompella, CTO, Engineering

Page 2: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

2 © 2017 Juniper Networks, Inc. All rights reserved.

The Self-Driving Network

In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network I drew an analogy with the vision of a self-driving car Ø  There, it took 10 years from vision to prototype Ø  The first attempt (in 2004) failed!

What will it take to realize the Self-Driving Network? 2 © 2017 Juniper Networks, Inc. All rights reserved.

Page 3: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

3 © 2017 Juniper Networks, Inc. All rights reserved.

The Self-Driving Car Journey

2004 2014

DARPA Grand Challenge: build a self-driving car

Page 4: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

4 © 2017 Juniper Networks, Inc. All rights reserved.

The Self-Driving Network: What It Does A self-driving network would

– Accept “guidance” from a network operator – Self-discover its constituent parts – Self-organize and self-configure – Self-monitor using probes and other techniques – Auto-detect and auto-enable new customers – Automatically monitor and update service delivery – Self-diagnose using machine learning and self-heal – Self-report periodically

Page 5: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

5 © 2017 Juniper Networks, Inc. All rights reserved.

1.  TELEMETRY

3.  AUTOMATION

4.  DECLARATIVE INTENT

5.  DECISION MAKING A.  RULE-BASED B.  MACHINE LEARNING

2.  MULTIDIMENSIONAL VIEWS

FIVE TECHNOLOGIES FOR SELF DRIVING

Page 6: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

6 © 2017 Juniper Networks, Inc. All rights reserved.

LiDAR

1. TELEMETRY—CARS

The usual: speedometer, gas gauge, tire pressure sensors More recent: radar (for ACC), sonar (for parking assist), cameras

Page 7: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

7 © 2017 Juniper Networks, Inc. All rights reserved.

1. TELEMETRY—NETWORKS: where we are today

Line Card N

PFE

PFE

uKernel

Provision Sensors

Routing Engine

Line Card 1

Application

Network Element

Sensor Configuration: NETCONF, CLI

In-band telemetry information

Queries Data

Col

lect

or

Query Engine

Database PFE

PFE

Telemetry Endpoint

µKernel

Control Plane

Telemetry manager

Page 8: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

8 © 2017 Juniper Networks, Inc. All rights reserved.

2. MULTIDIMENSIONAL, MULTI-MODAL VIEWS

NETWORK TODAY

•  Neighbors, links •  Exit points, peers •  L0-1 devices • Middle-boxes • Global topology, traffic, flows •  Server and application performance •  Hackers, flash crowds, DDoS

NETWORK (FUTURE)

•  Correlation of information across geographies, layers, peers, clouds

•  Root cause analysis via supervised learning

•  Time-based trending to establish and adapt baselines

• Optimal local decisions based on global state

Page 9: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

9 © 2017 Juniper Networks, Inc. All rights reserved.

3. AUTOMATION—NETWORKS: where we are today

OPERATING SYSTEM

Data Plane (PFE) Chassis

XML-RPC

NETCONF RESTCONF

SNMP RO

PyEZ Framework

Ansible Python Scripts Salt

RubyEZ Library

Puppet Ruby Scripts Chef

Python / SLAX

gRPC

APIs

CLI

jVision Sensor

Page 10: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

10 © 2017 Juniper Networks, Inc. All rights reserved.

SAY WHERE YOU WANT TO GO… Hints:

•  Fastest time •  Lease distance •  Most efficient use of battery

4. DECLARATIVE STATEMENT OF INTENT—CARS

Even better, the car can simply talk to your phone, figure out where you need to be, and take you there

Page 11: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

11 © 2017 Juniper Networks, Inc. All rights reserved.

4. INTENT: “Say What You Want, Not How” – where we are today

service  reqts  

High-­‐level,  declara/ve  specifica-on  of  service  requirements  

Parse  specifica/on  Process  analy/cs  

Device  1  

Device  6  

Device  5  

Device  4  

Device  3  

Device  2  

Network  Analy-cs  

Service  configura-on  lives  here  

Configura-on  is  sent  to  chosen  device    

Process  &  

compile  

A  DB  

S  DB  

Page 12: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

12 © 2017 Juniper Networks, Inc. All rights reserved.

RULE-BASED LEARNING

If X happens, do Y: “avoid big rocks” —“If this then that”

+ Straightforward programming + Easy to predict and refine • Slow, painstaking work • At scale, hard to manage

MACHINE LEARNING

“Essence of artificial intelligence” —Alan Turing

+ Can become “creative” + Fastest way to learn complex behavior • Can come to strange conclusions • Hard to know what it knows

5. DECISION MAKING—RULE-BASED VS. MACHINE LEARNING

Page 13: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

13 © 2017 Juniper Networks, Inc. All rights reserved.

1.  MANUAL (!)

3.  ANALYSIS & PREDICTION

4.  RECOMMENDATION

5.  AUTONOMOUS DECISIONS

2.  VISUALIZATION

Augment

You are here!

Get here!

FIVE STAGES OF SELF-DRIVING

Page 14: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

How Do We Get This Kicked Off?

Page 15: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

15 © 2017 Juniper Networks, Inc. All rights reserved.

THE NETWORKING GRAND CHALLENGE

•  Self-Discover—Self-Configure—Self-Monitor—Self-Correct—Auto-Detect Customers—Auto-Provision—Self-Analyze—Self-Optimize—Self-Report

GOAL

•  TBD

PRIZE

BUILD A SELF-DRIVING NETWORK IMPACT:

•  Free up people to work at a higher-level: new service design •  Agile, even anticipatory service creation •  Fast, intelligent response to security breaches

RESULT

•  Run a datacenter for six months with no human intervention (not even from afar) with no reduction or compromise in functionality

CHALLENGE

POSSIBILITIES

15 © 2017 Juniper Networks, Inc. All rights reserved. JUNIPER NETWORKS

Page 16: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

16 © 2017 Juniper Networks, Inc. All rights reserved.

Analysis

Collector Decision

Tele

met

ry

Act

ion

Need standardized data models

Need easy way to

correlate data

Need standardized set of actions

Need standardized interactions.

Automation/netconf makes this easier!

HIGH-­‐LEVEL  ARCHITECTURE:  (nearly)  Closed  Loop  Control

Intent

Page 17: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

THE SELF-DRIVING NETWORK: GRAND IMPACT (plus)

Picture of a person lounging, sipping a tropical drink in paradise

(i.e., the engineer’s life is made easier)

• Skill set change: 1. Network geeks à service designers 2. BGP policies à AI policies

• The network gets out of the way! • SLAs are automatically met

• Networks adapt, react, anticipate •  Learn behavioral patterns

• Security becomes Good Guy ‘Bot versus Bad Guy ‘Bot

Page 18: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

THE SELF-DRIVING NETWORK: GRAND IMPACT (minus)

Picture of a person lounging, sipping a tropical drink in paradise

(i.e., the engineer’s life is made easier)

•  ”Mad robot” syndrome Ø  Self-driving = loss of control? Ø  Human augmentation rather than full

autonomy? •  Impact on net neutrality, privacy

• How much data is too much? • Tracking behavior patterns à abuse?

•  Job loss … big issue, not just for networking

Page 19: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

THE SELF-DRIVING NETWORK: GRAND POSSIBILITIES

Super Bowl LX in 10 years

IT infrastructure orders and delivers itself, then self-organizes on-site

Page 20: The Self-Driving Network™: How to Realize It · The Self-Driving Network In March 2016, I presented the vision of a Self-Driving Network – an automated, fully autonomous network

20 © 2017 Juniper Networks, Inc. All rights reserved.

We have before us a compelling vision in networking, both meaningful and realizable •  Economic imperative: attack the biggest

cost in networking – operations •  Efficiency imperative: spin up resources

as needed and optimize their use •  Agility imperative: bring up new services

quickly; predict, anticipate and adapt •  Security imperative: quickly diagnose,

isolate and remove or mitigate threats … and do this all with no human intervention

CONCLUSION

Let’s get to work: study, share data, research, prototype, standardize, iterate