Network Performance and Latency with Omni Distributed Analysis Platform

www.wildpackets.com © WildPackets, Inc. #wp_omni7

Jim MacLeod

Product Manager

WildPackets

jmacleod@wildpackets.com

Follow me @shewfig

Network Performance and Latency

with Omni Distributed Analysis Platform

Show us your tweets! Use today’s webinar hashtag:

#wp_omni7 with any questions, comments, or feedback.

Follow us @wildpackets

Administrivia

• All callers are on mute ‒ If you have problems, please let us know via the Chat window

• There will be Q&A at the end ‒ Feel free to type a question at any time

• Slides and Recording will be available: ‒ Via a follow-up email

Agenda

• Network capture overview

• Real world use cases ‒ WAN SLA validation and link latency measurement

‒ Application vs. network latency

‒ Remote end-user experience measurement

‒ Uncovering wireless issues

• About WildPackets

Network Overview

WAN SLA Validation

and Link Latency Measurement

The Problem

• “Business-class” WAN link ‒ Expensive, but it comes with a SLA

• Results are disappointing ‒ The ISP says the link hasn’t gone down

‒ What about the rest of the SLA? • The ISP only performs latency and loss tests as troubleshooting

• BERT/BLERT/loopback tests take the link offline

• Can you measure the link performance yourself?

The Network

Packets from end-user PC to remote server across WAN

Capturing on the Network

Capture at each endpoint of the WAN link

Multi-Segment Analysis

• Compare simultaneous data from end to end ‒ A single point only tells you flow health

‒ Multiple points measure link quality

Why Multi-Segment Analysis?

• Old way: one capture at a time ‒ Gives direction, but not location

‒ Unplug system, move it, capture different data

‒ No guarantee of finding or reproducing the problem

• New way: multiple simultaneous captures ‒ Track flows along the packet path

‒ “Bullet-time” visibility for data transactions

‒ Packet-level timing for link latency and reliability

• The result: root-cause location ‒ Uncover patterns as flows are forwarded

‒ See where packet latency and loss are injected

‒ Measure quality of links without downtime

What We’ll See

• Multi-Point Capture ‒ From wireless client to server room

‒ Client behind NAT

• Link measurement ‒ Taken at ingress and egress

• Multi-Segment Analysis ‒ Automatic processing of timestamps and routing hops

‒ Shows latency and packet loss

Application vs Network Latency

The Problem

• Users are complaining of a slow server

• Server team says stats look okay ‒ CPU & memory within tolerance

‒ It MUST be the network!

• SNMP & Netflow look okay ‒ CPU, errors, dropped packets within tolerance

‒ It MUST be the server!

• Where is the problem?

The Network

Packets from end-user PC to local server

Capture in-line with TimeLine network recorder at 40Gbps

Latency Graph in Compass Dashboard

• Comparative visualization of latency sources ‒ Allows quick latency troubleshooting

‒ Graphs wait times by application and network

What Compass Latency Solves

• Is there a persistent problem? ‒ Are some segments or apps frequently slow?

‒ Are there occasional “hiccups” in the network?

• Find what needs fixing ‒ Is it the application or the network?

‒ Figure out quickly where to spend time and money

• Baseline information ‒ Are certain nodes slower than others?

• Entire subnets due to old switches/routers

• Certain servers, certain applications.

‒ Are some protocols slower than others? • E.g. HTTP vs SSL

• SMB vs FTP

Why Latency in Compass?

• Single-page visualization ‒ Easy to see “hidden” slowdowns

‒ View per-flow, per-protocol, per-node

• Interactive information ‒ Quick drill-downs

‒ Find the information you want

What We’ll See

• Capture from TimeLine

• Latency graph in Compass

• Proof in the packets

End-User Experience Measurement

The Problem

• Cloud-hosted service ‒ “It will save money if we don’t have to maintain it ourselves”

• Road warriors are complaining about performance ‒ Troubleshooting on-site will eliminate the cost savings

• How can you troubleshoot what you don’t host?

OmniPeek Remote Assistant

• Small agent to capture directly on the end-user PC ‒ Simple user interface: “Start” and “Stop”

‒ Capture exactly what the PC sees

Why OmniPeek Remote Assistant?

• Capture directly from end-user PC ‒ See what the PC sees

‒ No active connection required: diagnose connectivity issues

• Test servers using end-user experience ‒ Client perspective measures how well service is delivering

‒ Capture from multiple different clients for global perspective

‒ Lightweight setup, no special equipment

• Remote troubleshooting ‒ IT helpdesk or vendor tech support

‒ Strong encryption: data isn’t exposed, even at rest

• Send the data, not an engineer!

What We’ll See

• Capture file from OmniPeek Remote Assistant

• Transparent decryption

• Latency source diagnosis of SSL traffic ‒ It’s not always the network…

Troubleshooting Wireless

The Problem

• Users can’t connect to wireless network ‒ Association without IP

‒ Authentication problems

• Wireless network is “slow” ‒ Users complaining about “pauses”

‒ Logs show disconnects, reconnects

• Ever wish you could swap out the cable on wireless?

The Network

Wireless users with unreliable connectivity

Omni Distributed Analysis Platform provides visibility at multiple points

Wireless diagnosis in OmniPeek

• Integrated multi-channel aggregation ‒ Capture on multiple channels using multiple USB adapters

‒ True visibility across the spectrum without sampling / scanning

• Integrated roaming analysis ‒ Latency measurements per roam, even local roaming

‒ Aggregation per AP and per node, even across channels

• Fully integrated 802.11 diagnosis ‒ Expert analysis

‒ Signal strength visualization

• Decrypt WEP, WPA, WPA2-PSK ‒ Full packet data visibility

‒ MSA provides wired/wireless comparisons

Why OmniPeek for Wireless?

• On-site analysis ‒ Walk the floor with OmniPeek

‒ Aggregated capture gives cross-spectrum visibility

‒ Track down weak signal locations

• Remote analysis ‒ Remote adapter turns AP into capture source

‒ Capture with USB over IP hubs

• End-user analysis ‒ OmniPeek Remote Assistant with WildPackets driver

‒ Promiscuous wireless capture shows 802.11 admin packets

What We’ll See

• Roaming

• Signal strength

• Wired and wireless multi-segment capture

• Node DoS attack

Omni Distributed Analysis Platform

• 40G support

• Multi-segment network analysis

• Remote end-user experience analysis with OmniPeek

Remote Assistant

• Enhanced visibility with OmniPeek network analyzer ‒ Compass dashboard now with

• Latency monitoring

• Integrated Expert event analysis

• Flows

‒ Multi-channel and roaming analysis

‒ New and enhanced decodes

Show us your tweets! Use today’s webinar hashtag:

#wp_omni7 with any questions, comments, or feedback.

Follow us @wildpackets

Follow us on SlideShare! Check out today’s slides on SlideShare

www.slideshare.net/wildpackets

WildPackets Corporate Overview

Optimizing Network and Application Performance

Corporate Background

• Experts in network monitoring, analysis, and troubleshooting

‒ Founded: 1990 / Headquarters: Walnut Creek, CA

‒ Offices throughout the US, EMEA, and APAC

• Our customers are leading edge organizations

‒ Mid-market and enterprise lines of business

‒ Financial, manufacturing, ISPs, major federal agencies,

state and local governments, and universities

‒ Over 7,000 customers / 60+ countries / 80% of Fortune 1,000

• Award-winning solutions that improve network performance

‒ Internet Telephony, Network Magazine, Network Computing awards

‒ United States Patent 5,787,253 issued July 28, 1998 • “Apparatus and Method of Analyzing Internet Activity”

Business Opportunity

• Growing $5B network management market (Gartner)

• VoIP, video, and other converged networking

applications are saturating network bandwidth

• Increasing network speeds create a discontinuity ‒ 1 Gig 10 Gig 40 Gig 100 Gig networks

• Users and business will not tolerate downtime

Need for better real-time network visibility in addition to

network forensics and DPI

Unprecedented Network Visibility

ROOT-CAUSE ANALYSIS

OmniPeek network analyzer performs deep packet inspection

and can reconstruct all network activity, including e-mail and

IM, as well as analyze VoIP and video traffic quality.

PINPOINT NETWORK ISSUES ANYWHERE

Omnipliance Portable can rapidly identify and troubleshoot

issues before they become major problems—wired or

wireless—down the hall or across the globe.

UNDERSTAND END-USER PERFORMANCE TimeLine and Omnipliance network recorders monitor

and analyze performance across critical network

segments, virtual environments, and remote sites.

NETWORK HEALTH

WatchPoint can manage and report on key

devices’ performance and availability across

the entire network, from anywhere on the network.

GLOBAL

DISTRIBUTED

PORTABLE

A History of Innovation

2003 Distributed real-time

troubleshooting

2001 • First 802.11

wireless analyzer

• First network

analyzer with

automated expert

analysis

2005 Combined distributed

network and VoIP

network analysis

2008 Enterprise-wide

Monitoring and Reporting

2009 Innovative dashboard

with drill-down for VoIP

and video

2012 • Capture, record, and

analyze from 40G

network segments

• First wireless network

analyzer to support

801.11ac, k, r, u, v, w

2011 • Total visibility with

zero packet loss

• First wireless

network analyzer to

support capture and

analysis of 802.11n

3-stream wireless

2010 First to achieve 11 Gbps

sustained capture-to-disk

Real-World Deployments

Education

Health Care / Retail

Financial

Telecom

Government

Technology

WildPackets Proprietary

Product Line Overview

Omni Distributed Analysis Platform

OmniPeek Enterprise Packet Capture, Decode and Analysis

• Ethernet,1/10 Gigabit, 802.11, and voice and video over IP

• Portable capture and OmniEngine console

• Aggregate analysis data across multiple capture points

Omnipliance / TimeLine Distributed Enterprise Network Forensics

• High-performance packet capture and real-time analysis

• Stream-to-disk for forensics analysis

• Integrated OmniAdapter network analysis cards up to 40G

WatchPoint Centralized Enterprise Network Monitoring Appliance

• Aggregation and graphical display of network data

• WildPackets OmniEngines

• NetFlow and sFlow

Omni Distributed Analysis Platform Software and Turnkey Solutions

• Enterprise monitoring and reporting

‒ WatchPoint Server

‒ OmniFlow, NetFlow, and sFlow Collectors

• Software probes and network recorders

‒ Omnipliance network recorders – Edge, Core

‒ TimeLine network recorders

‒ OmniAdapter analysis cards

• Distributed analysis software

‒ OmniPeek – Enterprise, Professional, Basic, Connect

‒ OmniEngine – Enterprise, Desktop, OmniVirtual

• Portable solutions

‒ OmniPeek network analyzer

‒ Omnipliance Portable

Key New Features in v7

• 40G network support

• Analyze issues from end to end:

Multi-Segment Analysis (MSA)

• Collect data from non-technical end users:

OmniPeek Remote Assistant (ORA)

• Single, interactive dashboard for

utilization, top talkers, top protocols,

latency, Experts, flows, and wireless

signal strength

• New wireless specifications

‒ 802.11ac 802.11k

‒ 802.11r 802.11u

‒ 802.11v 802.11w

OmniPeek Network Analyzer

• Distributed analysis manager

– Connect to and configure distributed OmniEngines, Omnipliances,

and TimeLines

• Comprehensive dashboards present network traffic in real-time

– Vital statistics and graphs display trends on network and application

performance

– Visual peer-map shows conversations and protocols

– Intuitive drill-down for root-cause analysis of performance bottlenecks

• Visual Expert diagnosis speeds problem resolution

– Packet and payload visualizers provide business-centric views

• Automated analytics and problem detection 24/7

– Easily create filters, triggers, scripting, advanced alarms, and alerts

Omnipliance Network Recorders

• Captures and analyzes all network traffic 24x7

– Runs WildPackets OmniEngine software probe

– Generates vital statistics on network and application performance

– Intuitive root-cause analysis of performance bottlenecks

• Expert analysis speeds problem resolution

– Fault analysis, statistical analysis, and independent notification

• Multiple issue digital forensics

– Real-time and post capture data mining for compliance and troubleshooting

• Intelligent data transport

– Network data analyzed locally

– Detailed analysis passed to OmniPeek on demand

– Summary statistics sent to WatchPoint for long term trending and reporting

– Efficient use of network bandwidth

• User-extensible platform

– Plug-in architecture and SDK

TimeLine Network Recorder

• Continuous network recording and comprehensive

real-time statistical display — simultaneously ‒ 12Gbps sustained capture with zero packet loss

‒ Network statistics display in TimeLine visualization format

• Rapid, intuitive forensics search and retrieval ‒ Historical network traffic analysis and quick data rewinding

‒ Several pre-defined forensics search templates making

searches easy and fast

• A natural extension to the WildPackets product line

• Turnkey bundled solution ‒ Appliance + OmniEngine, OmniAdapter, OmniPeek Connect

WildPackets Network Recorders Price/Performance Solutions for Every Application

Portable Edge Core TimeLine

Ruggedized

Troubleshooting

Small Networks

Remote Offices

Datacenter Workhorse

Easily Expandable

Enterprise, Highly-

Utilized Networks

Aluminum chassis / 17” LCD 1U rack mountable chassis 3U rack mountable chassis 3U rack mountable chassis

Dual 2.13 GHz Quad-Core Intel

Xeon L5630 "Westmere"

Quad-Core Intel Xeon X3460

2.80Ghz

Dual Intel Xeon Quad Core

E5530 2.4GHz

Dual Intel Xeon Quad Core

X5560 2.8GHz

24GB RAM 4GB RAM 6GB RAM 18GB RAM

2 PCI-E Slots 2 PCI-E Slots 4 PCI-E Slots 4 PCI-E Slots

2 Built-in Ethernet Ports 2 Built-in Ethernet Ports 2 Built-in Ethernet Ports 2 Built-in Ethernet Ports

6TB SATA storage capacity 1TB SATA storage capacity 8/16TB SATA

storage capacity

8/16/32/48TB SATA

storage capacity

4.5Gbps CTD 1.1Gbps CTD 3Gbps CTD 12Gbps CTD

WatchPoint Centralized Monitoring for Distributed Enterprise Networks

• High-level, aggregated

view of all network

segments

– Monitor per campus, per

region, per country

• Wide range of network

– NetFlow, sFlow, OmniFlow

• Web-based, customizable

network dashboards

• Flexible detailed reports

• Direct link to detailed,

packet-based analysis

Comprehensive Support and Services

Standard Support

Maintenance and upgrades

Telephone and email contacts

Knowledgebase

MyPeek Portal

Premier Support

24 x 7 x 365

Dedicated escalation manager

2 customer contacts per site

Plug-in reconfiguration assistance

WildPackets Training Academy

Public, web-based, and on-site classes

Complete curriculum: technology and product focused

Practical applications and labs covering network analysis,

wireless, VoIP monitoring and advanced troubleshooting

Consulting and Custom Development Services

Deployment, configuration, and assessment engagement

Systems integration and testing

Application integration, driver, decode, interface development

24x7 Network Monitoring,

Analysis, and Troubleshooting

Capture Data • Drivers

• Probes

• Packets

Derived Data • Statistics

• Measurements

• Tracking

Data Mining • Aggregation

• Base-lining

• Correlation

Data Abstraction • Predictive

• Autonomics

• Closed-loop

Long-Term Product Vision Event-driven Application and Network Performance Management

WildPackets Key Differentiators

• Visual Expert intelligence with intuitive drill-down

– Let computer do the hard work, and return results, real-time

– Packet /payload visualization is faster than packet-per-packet diagnostics

– Experts and analytics can be memorized and automated

• Automated capture analytics

– Filters, triggers, scripting, and advanced alarming system combine to provide

automated network problem detection 24x7

• Multiple issue network forensics

– Can be tracked by one or more people simultaneously

– Real-time or post capture

• User-extensible platform

– Plug-in architecture and SDK

• Aggregated network views and reporting

– NetFlow, sFlow, and OmniFlow

Thank You!

WildPackets, Inc.

1340 Treat Boulevard, Suite 500

Walnut Creek, CA 94597

(925) 937-3200

Network Performance and Latency with Omni Distributed Analysis Platform

Technology

Sparrow Distributed Low-Latency Spark Scheduling Kay Ousterhout, Patrick Wendell, Matei Zaharia, Ion Stoica

Banking Case study: Scaling with low latency using …€¦ · · 2014-09-17Banking Case study: Scaling with low latency using NewSQL Jags ... “Write!thru”!Distributed!caching!

Low Latency Stream Processing: Twitter Heron with ...dsc.soic.indiana.edu/publications/low_latency... · 2.2 Intel Omni-Path Omni-Path is a high performance fabric developed by In-tel

Sparrow: Distributed, Low Latency Scheduling - …keo/publications/sosp13-final17.pdf · Sparrow: Distributed, Low Latency Scheduling Kay Ousterhout, Patrick Wendell, Matei Zaharia,

Building Interactive Distributed Processing Applications ...dprg.cs.uiuc.edu/docs/shadi_phd_thesis/defense.pdf · PACELC Latency Throughput Latency Isolation 1. Abadi, ^ onsistency

Low Latency Geo-distributed Data Analytics

Low-Latency Geo-Distributed Data Analytics (Iridium)...Low-Latency Geo-Distributed Data Analytics (Iridium) Qifan Pu, Ganesh Ananthanarayanan, Peter Bodik, Srikanth Kandula, Aditya

Stability and Performance Limits of Latency-Prone Distributed Feedback Controllers

Low Latency Geo-distributed Data Analytics - Yale Universityzoo.cs.yale.edu/.../analytics-geo-distributed.pdfLow Latency Geo-distributed Data Analytics Qifan Pu1;2, Ganesh Ananthanarayanan1,

Sparrow Distributed Low-Latency Scheduling Kay Ousterhout, Patrick Wendell, Matei Zaharia, Ion Stoica

Implementation of Latency by Using Distributed Load

Sparrow: Distributed, Low Latency Schedulingsigops.org/sosp/sosp13/papers/p69-ousterhout.pdf · Sparrow: Distributed, Low Latency Scheduling Kay Ousterhout, Patrick Wendell, Matei

Low Latency Geo-distributed Data AnalyticsLow Latency Geo-distributed Data Analytics Qifan Pu1;2, Ganesh Ananthanarayanan1, Peter Bodik1 Srikanth Kandula1, Aditya Akella3, Paramvir

OMNI: A Distributed, Modular, Closed-Loop Neuromodulation … · 2020-06-11 · OMNI: A Distributed, Modular, Closed-Loop Neuromodulation Device for the Treatment of Neuropsychiatric

Accurate Latency Estimation in a Distributed Event · PDF fileAccurate Latency Estimation in a Distributed Event Processing System Badrish Chandramouli †, Jonathan Goldstein‡,

Accurate Latency Estimation in a Distributed Event Processing System · PDF fileAccurate Latency Estimation in a Distributed Event Processing System Badrish Chandramouli†, Jonathan

Scalability with Omni Distributed Analysis Platform

Minimizing Latency in Fault-Tolerant Distributed Stream Processing …cs.brown.edu/courses/cs227/archives/2015/papers/ds... · 2015-01-21 · Minimizing Latency in Fault-Tolerant

Collage Inference: Achieving low tail latency during ... · Collage Inference: Achieving low tail latency during distributed image ... launch, or a task is replicated on detection

Low Latency Distributed Computing