Towards a Practical Method for Interactive Traffic Visualizations in Data Centers

.

Mission Statement

M.Zhanikeev -- [email protected] -- ...Interactive Traffic Visualizations in Data Centers -- http://bit.do/marat140523 2/24...

2/24

.

Mission Statement / Goals

1. a holistic method for performance visualizationinDCs

2. a clean slate + there are no rivals

3. a generic design applicable to various kinds of performance data◦ traffic in this paper, but ideally anything


3/24

.

Visualization Primer


4/24

.

Visualization Theory.Visualization Tradition.....

.... is to maximize information density and minimize labeling

• metrics are density and proximity -- proximity packing problem

• Tufte 05 and others 06

.New (proposed) Formulation.....

.... addsmetaphor and enhances the labeling metric

• metaphor is a strict requirement -- 3D/3D charts are not metaphors

• higher number of metrics

05 E.Tufte+0 "The Visual Display of Quantitative Information" Graphics Press (1983)

06 J.Steele+1 "Beautiful Visualization" O'Reilly Media (2010)


5/24

.

Visualization Methods• Waterpipe Model (the proposal) is explained later

• key point: 2D → 3D may actually make things worse!

WaterpipeModel 2D 3D

Metaphor YES NO NOInformation Density HIGH LOW BETTER

Labeling minimization GOOD BAD BETTERPerceptual enhancement GOOD BAD WORSE


6/24

.

Visualization Examples


7/24

.

Viz : Example (1)• Community QoS visualization from 04

0 6400 12800 19200Batch size (bytes)

0

800

1600

2400

3200

4000

OW

D(m

s) +

TX

time

(x0.

1ms)

04 myself+0 "A holistic... for measuring end-to-end QoS at data centres" IJCSE (2014)


8/24

.

Viz : Example (2)

Meter Merger

Analyzer

Analyzer

Analyzer

Buffer 5sTimeout 5sSampling timeout 10s

Buffer 1s

Buffer 10s

Buffer 30s

Lower clusterUpper cluster

47kb

25kb

21kb

12kb

0.6kb

0.3kb

Per secondPer buffer

10kb

7.4kb

32kb

26kb

Differentbuffer size

• also from 04

• Petri Nets are based on thetree metaphor -- simplebut powerful

04 myself+0 "A holistic... for measuring end-to-end QoS at data centres" IJCSE (2014)


9/24

.

Proposal : The Waterpipe Model


10/24

.

Proposal : Waterpipe Model

• Existing (1) : there is already fluid model in traffic simulations◦ differential equations◦ data unit is aggregate flow rather than packets◦ you do not actually run such a simulation -- you take a snapshot at a given point in time

• Existing (2) : Bucket Model in queueing theory -- a bucket of water

• Waterpipe Model is similar, only with a strong visual component --the metaphor

• Data Center is literally viewed as a system of water pipes -- a job for plumbers?

• the metaphor is flexible, can support multiple variants


11/24

.

Waterpipe : Model 1• one tap is one VM/PM/etc.


12/24

.

Waterpipe : Model 2• same, but more focus on in/out balance of goodput, congestion, etc


13/24

.

Implementation


14/24

.

Implementation : Status

• 80% complete• already have all the components from past research -- see below

• the visual part is new but not hard to design

• components:

1. multicore traffic capture and processing2. client-side web aggregator based onWebSockets and WebWorkers

(HTLM5)3. interactive design -- this part is pending but easy


15/24

.

Implementation : Multicore• heavy use of multicore and realtime processing -- recent paper in 07

Global Networks

Data Center Internals

Gateway Switch

Capture Manager

CPU CPU CPU

CPU CPU CPU

… Storage

Mirror

07 myself+0 "A Software Design and Algorithms for Multicore Capture..." ACM ASIA-CCS-SFCS (2014)


16/24

.

Implementation : Sockets• WebSockets -- streaming, native binary support, heavily interactive,client-side aggregation 01

• recent study shows that 900Mbps can be supported using parallel sockets 02

• again, WebWorkers expoit multicore if present

Network

Chrome Browser

Control

…… Media requests

Server

Buffer

Client WebSocket

Apache web server

WebSocket server

WebWorker

WebSocket

WebWorker

Network

Server

Round Robin

Add

01 myself+0 "Multi-Source Stream Aggregation in the Cloud" ADCN Wiley Book (2013)

02 myself+0 "Experiments with application throughput in a browser with full HTML5 support" IEICE ComEx (2013)


17/24

.

Design : Capture/Processing• any level of abstraction: PMs, VMs, storage, etc.• realtime processing and decision-making -- towards interactive visualization 07

WebWorkerWeb

WorkerCPU

Core(s)

….

PM

PM

PM

PM

Switch To Cloud

Split Merge

TrafficMirroring

InteractiveDisplay

07 myself+0 "A Software Design and Algorithms for Multicore Capture..." ACM ASIA-CCS-SFCS (2014)


18/24

.

Design : Interactive Display• aggregation and processing on multicore, highly interactive display• basically, a player (of performance info) plus interaction

• recent study on the most cost effective visualization technologies inbrowser 03

WebWorkerWeb

WorkerWeb

WorkerWeb

Worker Player

1 2 3

….

….Web Socket

Browser Window (GUI)

03 myself+0 "... the Most Cost Effective Method in Browser-Based Visualizations" IIEEJ (2014)


19/24

.

Wrapup


20/24

.

Wrapup

• 80% complete with most important components fully available

• currently testing on a small cloud at Kyutech• only 2 variants shown, but more are possible -- all based on waterpipes

• important: not limited to traffic, can work on any performance data◦ CPU, memory, storage, etc.


21/24

.

That’s all, thank you ...


22/24

.

[01] myself+0 (2013)Multi-Source Stream Aggregation in the CloudADCN Wiley Book

[02] myself+0 (2013)Experiments with application throughput in a browser with full HTML5 supportIEICE ComEx

[03] myself+0 (2014)... the Most Cost Effective Method in Browser-Based VisualizationsIIEEJ

[04] myself+0 (2014)A holistic... for measuring end-to-end QoS at data centresIJCSE

[05] E.Tufte+0 (1983)The Visual Display of Quantitative InformationGraphics Press


22/24

.

[06] J.Steele+1 (2010)Beautiful VisualizationO'Reilly Media

[07] myself+0 (2014)A Software Design and Algorithms for Multicore Capture...ACM ASIA-CCS-SFCS

[08] myself+0 (current)1100+ Examples of Information Visualizationhttp://www.infovis.info/index.php?words=diagrams


23/24

.

Extras : Processing Cost

Hashing

Increasing Per-Unit Cost

Manager

Prefix Matching

Cores that do not match

Process

Stage 1 Stage 2 Stage 3


23/24

.

Extras : Multicore Processing

PF_RING

PF_RING

Time

Manager

Shared Memory

Capture

Capture

…

Core 1

Core 2

Core 3

….

Core X


24/24

Technology

Towards a Practical Method for Interactive Traffic Visualizations in Data Centers