35
Fundamentals of Network Performance Engineering Dr Neil Davies Predictable Network Solutions Ltd Peter Thompson Predictable Network Solutions Ltd Martin Geddes Martin Geddes Consulting Ltd © 2013 All Rights Reserved PREDICTABLE NETWORK SOLUTIONS

Fundamentals of Network Performance Engineering

Embed Size (px)

DESCRIPTION

Highlights from Geddes/PNSol public workshop on network performance engineering.

Citation preview

Page 1: Fundamentals of Network Performance Engineering

Fundamentals of Network Performance Engineering

Dr Neil Davies Predictable Network Solutions Ltd

Peter Thompson Predictable Network Solutions Ltd

Martin Geddes

Martin Geddes Consulting Ltd

© 2013 All Rights Reserved

PREDICTABLE

NETWORK

SOLUTIONS

Page 2: Fundamentals of Network Performance Engineering

Dr Neil Davies Co-founder, Predictable Network Solutions Ltd

Ex: University of Bristol (23 years).

Former technical head of joint university/research institute (SRF/PACT).

Peter Thompson CTO, Predictable Network Solutions Ltd

Ex: GoS Networks, U4EA, SGS-Thomson, INMOS & Universities of Bristol, Warwick and Cambridge.

Authority on technical and commercial issues of converged networking.

Martin Geddes Founder, Martin Geddes Consulting Ltd

Ex: BT, Telco 2.0, Sprint, Oracle, Oxford University.

Thought leader on future of telecommunications industry.

PREDICTABLE

NETWORK SOLUTIONS

Page 3: Fundamentals of Network Performance Engineering

Dr Neil Davies Co-founder, Predictable Network Solutions Ltd

Ex: University of Bristol (23 years).

Former technical head of joint university/research institute (SRF/PACT).

Peter Thompson CTO, Predictable Network Solutions Ltd

Ex: GoS Networks, U4EA, SGS-Thomson, INMOS & Universities of Bristol, Warwick and Cambridge.

Authority on technical and commercial issues of converged networking.

Martin Geddes Founder, Martin Geddes Consulting Ltd

Ex: BT, Telco 2.0, Sprint, Oracle, Oxford University.

Thought leader on future of telecommunications industry.

PREDICTABLE NETWORK

SOLUTIONS

The only ex-ante network performance engineering company in the world.

• New mathematical performance techniques.

• Performance assessment methodology.

• World’s first network contention management solution.

Consultancy on the future of telecoms and the Internet.

• Business model innovation.

• Technology & product ideation.

• Organisation development.

• Public & private workshops.

Page 4: Fundamentals of Network Performance Engineering

This presentation is taken from the content for

Fundamentals of Network Performance Workshop

For information on locations and timing of public events visit

www.sustainablebroadband.com

PREDICTABLE NETWORK

SOLUTIONS

Page 5: Fundamentals of Network Performance Engineering

Overview

What is “Network

Performance Engineering”?

3 Basic Concepts

G, S and V Implications: Broadband,

LTE, SDN, NFV

PREDICTABLE NETWORK

SOLUTIONS

Page 6: Fundamentals of Network Performance Engineering

What is

networking?

• Networking is inter-process communications – What matters is enabling computation

• We only care about the effects visible to the computation processes – We don’t per se care about

technologies, mechanisms or policies.

• The only visible effect of the network to the computation processes is (paradoxically) to lose and delay data!

Page 7: Fundamentals of Network Performance Engineering

Networking is a

statistical “game of chance”

• We’re sharing a fixed and finite transmission resource through statistical multiplexing

• Good outcomes come from – many “good coincidences”

– few “bad coincidences”

• In the game of chance, networks have some choices over what to lose and delay

PREDICTABLE NETWORK

SOLUTIONS

Page 8: Fundamentals of Network Performance Engineering

What is “Network Performance Engineering?”

• Network performance engineering is about delivering good enough outcomes…

– Acceptable quality of experience (QoE) to user

– Low cost to network operator

• …and managing the trade-offs in achieving these…

• …by tipping the odds in the game of chance in favour of lower cost and higher QoE

PREDICTABLE NETWORK

SOLUTIONS

Page 9: Fundamentals of Network Performance Engineering

Overview

What is “Network

Performance Engineering”?

3 Basic Concepts

G, S and V Implications: Broadband,

LTE, SDN, NFV

PREDICTABLE NETWORK

SOLUTIONS

Page 10: Fundamentals of Network Performance Engineering

Three essential concepts of network performance engineering

1. Loss and delay accumulate along a path

PREDICTABLE NETWORK

SOLUTIONS

Page 11: Fundamentals of Network Performance Engineering

The raw data we want to work with is end-to-end path delay, because that’s what

the computation processes experience.

Page 12: Fundamentals of Network Performance Engineering

Three essential concepts of network performance engineering

1. Loss and delay accumulates along a path

2. What matters is the distribution of loss and delay

PREDICTABLE NETWORK

SOLUTIONS

Page 13: Fundamentals of Network Performance Engineering

This is the simplest view of probability

distribution, but is of limited help managing

performance

Page 14: Fundamentals of Network Performance Engineering

Cumulative view allows (de)composition of loss

and delay along the path. Can isolate performance

issues to specific network elements and links.

Page 15: Fundamentals of Network Performance Engineering

We are most interested in the “tails” and their

structure. These are what cause application QoE failure, and whose mitigation drives cost.

Page 16: Fundamentals of Network Performance Engineering

Three essential concepts of network performance engineering

1. Loss and delay accumulates along a path

2. What matters is the distribution of loss and delay

3. A model of causality: decompose and predict

PREDICTABLE NETWORK

SOLUTIONS

How can you know what kind of intervention will address your QoE or cost issue, and what its effect will be?

Page 17: Fundamentals of Network Performance Engineering

Is there another way of looking at this data that will help us to select the right intervention and predict its effect?

Page 18: Fundamentals of Network Performance Engineering

Overview

What is “Network

Performance Engineering”?

3 Basic Concepts

G, S and V Implications: Broadband,

LTE, SDN, NFV

PREDICTABLE NETWORK

SOLUTIONS

Page 19: Fundamentals of Network Performance Engineering

Sort by packet size: a clear structure

emerges

Page 20: Fundamentals of Network Performance Engineering

Example packet delay: what is it comprised of?

Page 21: Fundamentals of Network Performance Engineering

Look at how there is this boundary line. Packets on the line experienced a network where all buffers were empty; those above

had to wait for other traffic in buffers. Note that the difference in delay along this dotted line is

related only to packet size.

Transit time of hypothetical zero

length packet

Page 22: Fundamentals of Network Performance Engineering

Geographic delay G

Every packet experienced a structural delay due to the

speed of light, routing lookup overheads.

Page 23: Fundamentals of Network Performance Engineering

Serialisation delay S

Packets with bigger payloads experience more structural delay: as they are being duplicated by each network element it takes longer

to turn the packet into a bitstream, and back again into a packet.

Page 24: Fundamentals of Network Performance Engineering

Variable contention delay

V

The remainder of the delay is not structural, but is induced by applying a demand load to

the shared transmission supply. We have choices over

how we allocate this delay.

Page 25: Fundamentals of Network Performance Engineering

Geographic delay

Serialisation delay

Variable contention delay

G

S

V

All delay is (everywhere and always) comprised of these

three basic elements.

Page 26: Fundamentals of Network Performance Engineering

Network technology or design

Link rate

Scheduling

G

S

V

Once we understand their contribution to QoE and cost, we can measure and manage the right thing!

Page 27: Fundamentals of Network Performance Engineering

Ideas like “jitter” conflate delay from V and S, along with loss. Measure the wrong thing, and you manage the wrong thing.

Packets whose delay is on this line are experiencing no contention, even though their delays are varying due to packet size. We would measure “jitter”, but attempts to manage it

would be futile.

Page 28: Fundamentals of Network Performance Engineering

Summary (thus far)

1. Measure paths… not points.

2. Analyse distributions… not averages.

3. Extract structure… for understanding and prediction.

PREDICTABLE NETWORK

SOLUTIONS

Note that these simple principles are not common practise in network performance engineering today.

(That’s why you should do business with us.)

Page 29: Fundamentals of Network Performance Engineering

Overview

What is “Network

Performance Engineering”?

3 Basic Concepts

G, S and V Implications: Broadband,

LTE, SDN, NFV

PREDICTABLE NETWORK

SOLUTIONS

Page 30: Fundamentals of Network Performance Engineering

So what? Broadband

Megabits/second are an insufficient measure: G and V matter too.

The broadband market is not being regulated correctly!

PREDICTABLE NETWORK

SOLUTIONS

Example: Two different ADSL providers in the same location, with same measured “speed”

Great for gaming Useless for gaming

Page 31: Fundamentals of Network Performance Engineering

So what? LTE

• Cellular will never be as good as low-spec ADSL – G and V are too high

– Has implications for real-time media, gaming

• Nothing in 3G/4G standards and networks supports consistent loss and delay (i.e. managing V) – Yet this is needed for real-time

value added services

PREDICTABLE NETWORK

SOLUTIONS

Downstream delay over a 3G connection

Too much variability for TCP to work well.

Page 32: Fundamentals of Network Performance Engineering

So what? SDN and NFV

Software Defined Networking (SDN) resource model is restricted to the arbitrary concept of “bandwidth”.

– So can’t ask for the right G, S and V loss and delay characteristics.

PREDICTABLE NETWORK

SOLUTIONS

Delays measured across UK Internet exchange

Bad virtualisation is likely to be the result!

“Bandwidth” is too weak a proxy for what matters in network performance

Page 33: Fundamentals of Network Performance Engineering

For further information on network performance engineering

download white papers at

www.pnsol.com/publications.html

PREDICTABLE

NETWORK

SOLUTIONS

Page 34: Fundamentals of Network Performance Engineering

For further insight, webinars and workshops

sign up for

Future of Communications email newsletter

www.martingeddes.com

Page 35: Fundamentals of Network Performance Engineering

Neil Davies [email protected]

Peter Thompson [email protected]

Martin Geddes [email protected]

PREDICTABLE

NETWORK

SOLUTIONS