November 10, 2011
Overcoming Latency: The Achilles Heel of Cloud Computing
Adam Weissmuller, Director of Product Management
Internap provides intelligent IT Infrastructure services differentiated by best-in-class performance, availability and support.
Global HQ in Atlanta 2,700+ Enterprise Customers 450 Employees 2010 Revenue: $244M
Our conception of cloud computing has evolved…
Ecofriendlymag.com
In the beginning, we had a nightmare….
ECI.com
Cloud seemed to be the perfect answer…
i.current.com
But now we have some questions…
A poor web experience results in lost revenue opportunity, a poorer customer perception of your company, and can boost your competitor’s bottom line.
Why they matter
Application performance has become a critical competitive advantage, which has a direct impact on customer satisfaction, top line revenues and the bottom line.
– Equation Research sanctioned by Gomez
Downtime “cuts deep” • Outages cause immediate negative reaction.
Poor performance is “death by a thousand customer defections”
• Cumulative impact of poor performance may be greater
Never forget…
Cloud Computing is merely a means to an end…
WARNING: Demanding End-‐user Requirements S>ll Apply
“One of the most important concerns for many Web businesses is how cloud adoption will impact their customers, the end user.” – Gomez, Cloud Computing and Web Application Performance: The Risks of Adopting the Cloud, 2010
Internet Dedicated
infrastructure environment
The “Cloud” (Public, multi-tenant)
Calculating latency: the big picture
What’s your application or website’s “TSL” and how does it match up to pressures to perform?
CL1 + NL2 = TSL
TSL < End-User Requirements
Don’t defeat your cloud ini>a>ve by failing to meet end-‐user expecta>ons for performance.
Web/App Page
Dissecting the user experience
2 The Internet: Performance counts
3 The App: Minimize server roundtrips
1 Location: Position close to end-user
4 The OS: Tailor instances
5 Tiers: Deploy on relevant platform
6 Intra-tier: Minimize latency
Web 1 Web 2 Web 3
Storage
DB 1 DB 2
Most cloud providers
Systemic Element
Internet
Elements 1 & 2: Why network performance is relevant
On average – any one carrier
represents the “Best” available path only 12% of
the time.
On average – any one carrier
represents the “Worst” available path 12% of the
time.
Source: Internap Customer IP-Scope / Customer Portal View – Apr 2010.
88% of the )me – any one carrier represents a less than op)mal path across the Internet.
Car
rier P
erfo
rman
ce
0010100111101110101011110110000110011001000110001000110001010111001110011001100101010100111101010101010000011101010101011111010101010100101010100000100010101111010101010001001010111010101010101010010100100100010001000100101011101001010101010110100101010101010101010111101010101010101010101001010111111010001010101010101001001010010001001010010101010011010101010101010010101010101011101000101010101010101010100010100111010101010101 01010011110111010101111011000011001100100011000100011000101011100111001011110111010101111011000011001100100011000100011000101011100111001100110010101010011111010101010100000111010101010111110101010101001010101000001000101011110101010100011001010111010101010101010010100100100010001001101011100101011001001010111011110000010101010101010101001001010101010100100100100000000001010101111010101010000001010101010010111101010101010101000000111010101111111110101010110010101010010111010101101001010110111100010010010001001001010101010100100101001001000101010100101010101010101010101010101001001001010101010111100101010100101111101001001010001010010101111110101010101010101010101010001010101110010101010101010101010111111111000001010101010101010101010101010101010101010101010011000101010101010101011111110000010101010101010101010100111101010101010011111010101000100000100101010101111111111101010101010100000101010101001101010111010101010101010101010010010101111101010101110101010101010100101010101010110000100101010101010101011110101010101001010101011111101010100010111111111101000001010101010101010101010101010101010001001010010101010111111111000000001010101010101111101010101111100000101001010100101010100101010101100100100010101010100010100001001010100101010010101010101010010010101001010101001010101010101010101010100101010100101010101010101010000000010101010111111111111111101000010010100010100101001110100000001001111101000101010001010111111100001010101010100010100101010101010101000100010001001011111010101010101110100100101001010000010111111010010010100101010101010101010101001010010101011101010101010101010101010101010010001010000101011011110010010100101001010010010101011111010101010010101010101010010010101010010010010101010111110100010001001010101011010101010101010101010010010010011101010101010101000010010100101010101010010100010101010100101010100101010010101010111100010111001001010100010011111010010010010010101010100100101010101000101010101110100101101010000001010111110010100100101010010001010101111001000011101001010100000010101111010010010010010111010010010111101010101010101010010100101001010101010101001101010101010010010101001011110100101011111110010101010101000100010100101001010100100101010101001011010100101010101001010010101111101010101010100010010010010101010111111010100100010111100100101001010100111100100100101010111011101010010100100100010010100101111101001000101000101010100010100100
Consumers
Suboptimal connectivity impedes performance
Single threaded, best-efforts connectivity reduces reliability and
accountability
Siloed IT services platforms reduce efficiency and
increase costs
Enterprises
Element 1 & 2: Delivery via the Internet is complicated
0010100111101110101011110110000110011001000110001000110001010111001110011001100101010100111101010101010000011101010101011111010101010100101010100000100010101111010101010001001010111010101010101010010100100100010001000100101011101001010101010110100101010101010101010111101010101010101010101001010111111010001010101010101001001010010001001010010101010011010101010101010010101010101011101000101010101010101010100010100111010101010101 01010011110111010101111011000011001100100011000100011000101011100111001011110111010101111011000011001100100011000100011000101011100111001100110010101010011111010101010100000111010101010111110101010101001010101000001000101011110101010100011001010111010101010101010010100100100010001001101011100101011001001010111011110000010101010101010101001001010101010100100100100000000001010101111010101010000001010101010010111101010101010101000000111010101111111110101010110010101010010111010101101001010110111100010010010001001001010101010100100101001001000101010100101010101010101010101010101001001001010101010111100101010100101111101001001010001010010101111110101010101010101010101010001010101110010101010101010101010111111111000001010101010101010101010101010101010101010101010011000101010101010101011111110000010101010101010101010100111101010101010011111010101000100000100101010101111111111101010101010100000101010101001101010111010101010101010101010010010101111101010101110101010101010100101010101010110000100101010101010101011110101010101001010101011111101010100010111111111101000001010101010101010101010101010101010001001010010101010111111111000000001010101010101111101010101111100000101001010100101010100101010101100100100010101010100010100001001010100101010010101010101010010010101001010101001010101010101010101010100101010100101010101010101010000000010101010111111111111111101000010010100010100101001110100000001001111101000101010001010111111100001010101010100010100101010101010101000100010001001011111010101010101110100100101001010000010111111010010010100101010101010101010101001010010101011101010101010101010101010101010010001010000101011011110010010100101001010010010101011111010101010010101010101010010010101010010010010101010111110100010001001010101011010101010101010101010010010010011101010101010101000010010100101010101010010100010101010100101010100101010010101010111100010111001001010100010011111010010010010010101010100100101010101000101010101110100101101010000001010111110010100100101010010001010101111001000011101001010100000010101111010010010010010111010010010111101010101010101010010100101001010101010101001101010101010010010101001011110100101011111110010101010101000100010100101001010100100101010101001011010100101010101001010010101111101010101010100010010010010101010111111010100100010111100100101001010100111100100100101010111011101010010100100100010010100101111101001000101000101010100010100100
Fully-‐op)mized Connec)vity
Mul)ple Redundant Links with 100% SLA
IT PlaIorm Flexibility
Consumers Enterprises
Elements 1 & 2: Multiple approaches to Internet delivery optimization are required
IP Optimization
Content Delivery Network
TCP Acceleration
Elements 3 & 4: Sub-optimal app design impacts the user experience
Web/App Page
Web 1 Web 2
Web 3
Internet
App OS instances can hit CPU, memory, and
storage limits
Application pages are constructed from multiple
server calls
Elements 3 & 4: Thoughtful application design yields better results
Web/App Page
Web 1 Web 2 Web 3
Internet
Don’t make your app “chatty” • Choose web frameworks wisely • Network protocol monitoring is your friend
Analyze your app • Measure memory/swap under load • Virtual OS instances are the cloud
building blocks of applications • Build for horizontal scaling
Elements 5 & 6: Right service for the right tier
Web 1 Web 2 Web 3
Storage
DB 1 DB 2
Cloud infrastructure can yield unpredictable
performance
Application tiers introduce latency
penalty
Internet
Internet
What is the "Right" Tier?
CONFIDENTIAL 16
Colocation Public Cloud
IT Platforms
Managed Hosting
App
licat
ions
Enterprise IT
Private Cloud
Applications should be deployed based on the "best" platform, based
on characteristics such as performance and security.
In House
Elements 5 & 6: Right service for the right tier
Web 1 Web 2 Web 3
Storage
DB 1 DB 2
OS workloads balanced in infrastructure • Make your app massively parallel • No over-subscription tax
Don’t be penalized for decomposing tiers • Determine best “natural home” for tier • Must address latency when induced
Consumers Enterprises
Internap provides a complete solution
IP Optimization
Content Delivery Network
TCP Acceleration
Broadest IT deployment platform
Bes
t per
form
ance
to e
nd u
ser
Flexible Cloud Solutions • Dedicated Private Cloud (VMware) • Virtual Private Cloud (VMware) • Custom Public Cloud (VMware) • Open Public Cloud (Open Stack)
We enable the best performance to the end-user with IT Infrastructure platform flexibility. Our entire business model is built on providing the best performance, availability, and support. Our intelligent IT Infrastructure solutions can take your business to a higher level.
If you only had a second, we’d want to tell you this:
Questions?
Come visit us at booth #730