November 10, 2011

Overcoming Latency: The Achilles Heel of Cloud Computing

Adam Weissmuller, Director of Product Management

Internap provides intelligent IT Infrastructure services differentiated by best-in-class performance, availability and support.

Global HQ in Atlanta 2,700+ Enterprise Customers 450 Employees 2010 Revenue: $244M

Our conception of cloud computing has evolved…

Ecofriendlymag.com

In the beginning, we had a nightmare….

ECI.com

Cloud seemed to be the perfect answer…

i.current.com

But now we have some questions…

What it’s really all about…

…Your  End  User.  

A poor web experience results in lost revenue opportunity, a poorer customer perception of your company, and can boost your competitor’s bottom line.

Why they matter

Application performance has become a critical competitive advantage, which has a direct impact on customer satisfaction, top line revenues and the bottom line.

– Equation Research sanctioned by Gomez

Downtime “cuts deep” •  Outages cause immediate negative reaction.

Poor performance is “death by a thousand customer defections”

•  Cumulative impact of poor performance may be greater

Never forget…

Cloud Computing is merely a means to an end…

WARNING:  Demanding  End-­‐user  Requirements  S>ll  Apply  

“One of the most important concerns for many Web businesses is how cloud adoption will impact their customers, the end user.” – Gomez, Cloud Computing and Web Application Performance: The Risks of Adopting the Cloud, 2010

Internet Dedicated

infrastructure environment

The “Cloud” (Public, multi-tenant)

Calculating latency: the big picture

What’s your application or website’s “TSL” and how does it match up to pressures to perform?

CL1 + NL2 = TSL

TSL < End-User Requirements

Don’t  defeat  your  cloud  ini>a>ve  by  failing  to  meet  end-­‐user  expecta>ons  for  performance.  

Web/App Page

Dissecting the user experience

2 The Internet: Performance counts

3 The App: Minimize server roundtrips

1 Location: Position close to end-user

4 The OS: Tailor instances

5 Tiers: Deploy on relevant platform

6 Intra-tier: Minimize latency

Web 1 Web 2 Web 3

Storage

DB 1 DB 2

Most cloud providers

Systemic Element

Internet

Elements 1 & 2: Why network performance is relevant

On average – any one carrier

represents the “Best” available path only 12% of

the time.

On average – any one carrier

represents the “Worst” available path 12% of the

time.

Source: Internap Customer IP-Scope / Customer Portal View – Apr 2010.

88%  of  the  )me  –  any  one  carrier  represents  a  less  than  op)mal  path  across  the  Internet.  

Car

rier P

erfo

rman

ce

0010100111101110101011110110000110011001000110001000110001010111001110011001100101010100111101010101010000011101010101011111010101010100101010100000100010101111010101010001001010111010101010101010010100100100010001000100101011101001010101010110100101010101010101010111101010101010101010101001010111111010001010101010101001001010010001001010010101010011010101010101010010101010101011101000101010101010101010100010100111010101010101 01010011110111010101111011000011001100100011000100011000101011100111001011110111010101111011000011001100100011000100011000101011100111001100110010101010011111010101010100000111010101010111110101010101001010101000001000101011110101010100011001010111010101010101010010100100100010001001101011100101011001001010111011110000010101010101010101001001010101010100100100100000000001010101111010101010000001010101010010111101010101010101000000111010101111111110101010110010101010010111010101101001010110111100010010010001001001010101010100100101001001000101010100101010101010101010101010101001001001010101010111100101010100101111101001001010001010010101111110101010101010101010101010001010101110010101010101010101010111111111000001010101010101010101010101010101010101010101010011000101010101010101011111110000010101010101010101010100111101010101010011111010101000100000100101010101111111111101010101010100000101010101001101010111010101010101010101010010010101111101010101110101010101010100101010101010110000100101010101010101011110101010101001010101011111101010100010111111111101000001010101010101010101010101010101010001001010010101010111111111000000001010101010101111101010101111100000101001010100101010100101010101100100100010101010100010100001001010100101010010101010101010010010101001010101001010101010101010101010100101010100101010101010101010000000010101010111111111111111101000010010100010100101001110100000001001111101000101010001010111111100001010101010100010100101010101010101000100010001001011111010101010101110100100101001010000010111111010010010100101010101010101010101001010010101011101010101010101010101010101010010001010000101011011110010010100101001010010010101011111010101010010101010101010010010101010010010010101010111110100010001001010101011010101010101010101010010010010011101010101010101000010010100101010101010010100010101010100101010100101010010101010111100010111001001010100010011111010010010010010101010100100101010101000101010101110100101101010000001010111110010100100101010010001010101111001000011101001010100000010101111010010010010010111010010010111101010101010101010010100101001010101010101001101010101010010010101001011110100101011111110010101010101000100010100101001010100100101010101001011010100101010101001010010101111101010101010100010010010010101010111111010100100010111100100101001010100111100100100101010111011101010010100100100010010100101111101001000101000101010100010100100

Consumers

Suboptimal connectivity impedes performance

Single threaded, best-efforts connectivity reduces reliability and

accountability

Siloed IT services platforms reduce efficiency and

increase costs

Enterprises

Element 1 & 2: Delivery via the Internet is complicated

0010100111101110101011110110000110011001000110001000110001010111001110011001100101010100111101010101010000011101010101011111010101010100101010100000100010101111010101010001001010111010101010101010010100100100010001000100101011101001010101010110100101010101010101010111101010101010101010101001010111111010001010101010101001001010010001001010010101010011010101010101010010101010101011101000101010101010101010100010100111010101010101 01010011110111010101111011000011001100100011000100011000101011100111001011110111010101111011000011001100100011000100011000101011100111001100110010101010011111010101010100000111010101010111110101010101001010101000001000101011110101010100011001010111010101010101010010100100100010001001101011100101011001001010111011110000010101010101010101001001010101010100100100100000000001010101111010101010000001010101010010111101010101010101000000111010101111111110101010110010101010010111010101101001010110111100010010010001001001010101010100100101001001000101010100101010101010101010101010101001001001010101010111100101010100101111101001001010001010010101111110101010101010101010101010001010101110010101010101010101010111111111000001010101010101010101010101010101010101010101010011000101010101010101011111110000010101010101010101010100111101010101010011111010101000100000100101010101111111111101010101010100000101010101001101010111010101010101010101010010010101111101010101110101010101010100101010101010110000100101010101010101011110101010101001010101011111101010100010111111111101000001010101010101010101010101010101010001001010010101010111111111000000001010101010101111101010101111100000101001010100101010100101010101100100100010101010100010100001001010100101010010101010101010010010101001010101001010101010101010101010100101010100101010101010101010000000010101010111111111111111101000010010100010100101001110100000001001111101000101010001010111111100001010101010100010100101010101010101000100010001001011111010101010101110100100101001010000010111111010010010100101010101010101010101001010010101011101010101010101010101010101010010001010000101011011110010010100101001010010010101011111010101010010101010101010010010101010010010010101010111110100010001001010101011010101010101010101010010010010011101010101010101000010010100101010101010010100010101010100101010100101010010101010111100010111001001010100010011111010010010010010101010100100101010101000101010101110100101101010000001010111110010100100101010010001010101111001000011101001010100000010101111010010010010010111010010010111101010101010101010010100101001010101010101001101010101010010010101001011110100101011111110010101010101000100010100101001010100100101010101001011010100101010101001010010101111101010101010100010010010010101010111111010100100010111100100101001010100111100100100101010111011101010010100100100010010100101111101001000101000101010100010100100

Fully-­‐op)mized  Connec)vity  

Mul)ple  Redundant  Links  with  100%  SLA  

IT  PlaIorm  Flexibility  

Consumers Enterprises

Elements 1 & 2: Multiple approaches to Internet delivery optimization are required

IP Optimization

Content Delivery Network

TCP Acceleration

Elements 3 & 4: Sub-optimal app design impacts the user experience

Web/App Page

Web 1 Web 2

Web 3

Internet

App OS instances can hit CPU, memory, and

storage limits

Application pages are constructed from multiple

server calls

Elements 3 & 4: Thoughtful application design yields better results

Web/App Page

Web 1 Web 2 Web 3

Internet

Don’t make your app “chatty” • Choose web frameworks wisely • Network protocol monitoring is your friend

Analyze your app • Measure memory/swap under load • Virtual OS instances are the cloud

building blocks of applications • Build for horizontal scaling

Elements 5 & 6: Right service for the right tier

Web 1 Web 2 Web 3

Storage

DB 1 DB 2

Cloud infrastructure can yield unpredictable

performance

Application tiers introduce latency

penalty

Internet

Internet

What is the "Right" Tier?

CONFIDENTIAL 16

Colocation Public Cloud

IT Platforms

Managed Hosting

App

licat

ions

Enterprise  IT  

Private Cloud

Applications should be deployed based on the "best" platform, based

on characteristics such as performance and security.

In House

Elements 5 & 6: Right service for the right tier

Web 1 Web 2 Web 3

Storage

DB 1 DB 2

OS workloads balanced in infrastructure • Make your app massively parallel • No over-subscription tax

Don’t be penalized for decomposing tiers • Determine best “natural home” for tier • Must address latency when induced

Consumers Enterprises

Internap provides a complete solution

IP Optimization

Content Delivery Network

TCP Acceleration

Broadest IT deployment platform

Bes

t per

form

ance

to e

nd u

ser

Flexible Cloud Solutions • Dedicated Private Cloud (VMware) • Virtual Private Cloud (VMware) • Custom Public Cloud (VMware) • Open Public Cloud (Open Stack)

We enable the best performance to the end-user with IT Infrastructure platform flexibility. Our entire business model is built on providing the best performance, availability, and support. Our intelligent IT Infrastructure solutions can take your business to a higher level.

If you only had a second, we’d want to tell you this:

Questions?

Come visit us at booth #730