Upload
ipexpo-online
View
268
Download
0
Embed Size (px)
Citation preview
Zeus Technology
Connecting Your Users to Your Applications
Owen Garrett, Director of Cloud Solutions
• Setting the scene: Why performance matters
• “The cloud has infinite resource. Why should I care about performance?”
• Industry Solutions
• What is an „Application Delivery Controller?‟
• Three case studies:
• How Zeus customers have built high-performance cloud applications
• Solutions to Application Delivery
• Consistent delivery of applications from a combination of physical, virtual
and cloud datacenters.
© Zeus Technology 20102
Agenda
• “Virtualization creates new sources and destinations for traffic
in a moment's notice. Network managers in the past didn't have
to worry about that rate of change. It's [now] a much more
dynamic environment.”
Jim Frey, research director at Enterprise Management
Associates
• You must ensure the availability of applications in fluid cloud and
virtual environments
© Zeus Technology 20103
What is the problem?
A delicate balancing act
4 © Zeus Technology 2010
Availability
Performance
Cost
Revenue
0
2
4
6
8
10
12
1997 1998 1999 2000 2001 2002 2003 2004 2005 2006
0
2
4
6
8
10
12
1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010
The „N‟-second rule...
• 10-second rule (Jakob Nielsen, March 1997)
• 8-second rule (Zona Research, June 2001)
• 4-second rule (JupiterResearch, June 2006)
Latency problems impact revenue
• 10-result page: 0.4 seconds load time
• 30-result page: 0.9 seconds load time
• Google Maps
• Home page down from 100KB to 70-80KB
• Amazon.com
• Experimented with page load times:
• Microsoft Bing
• Search results slowed by 1 second:
• Search results slowed by 2 seconds:
Traffic and ad revenues
down 20%
Traffic up 10% in week
1, 37% in weeks 2, 3, 4
Queries down by 1.0%;
Revenue down by 1.5%
Queries down by 2.5%;
Revenue down by 4.4%
Every 100 ms increase
revenue down by 1%
Aberdeen Report: The Performance of Web Applications
7 © Zeus Technology 2010
-11%
-7%
-16%
-20%
-18%
-16%
-14%
-12%
-10%
-8%
-6%
-4%
-2%
0%
Page Views Conversions Customer Satisfaction
Average impact of 1 second delay in response time for Web users
The Performance of Web Applications: Customers Are Won or Lost in One Second
Bojan Simic, Aberdeen Group
Gomez average performance metrics
Industry Response Time (sec) Availibility (%)
Retail 2.31 99.88
Banking 3.30 99.85
Media 4.98 99.88
Travel (Airlines) 3.55 99.90
• Poor site performance costs:
• Lost Revenues
• Brand Damage
• More customer support calls
• Increase in service delivery costs
8 © Zeus Technology 2010
Data based upon Gomez November 2009 U.S. Benchmark Data
• Cloud Computing services reduce costs …
…but…
• Cloud Computing may make it more difficult to deliver
the performance and reliability your customers are
used to.
© Zeus Technology 20109
The conundrum many IT managers face
• Application Delivery Controllers
© Zeus Technology 201010
The industry solution
“I would rather my IT team spent time developing our services, rather than
dealing with performance, clustering and other application delivery problems.”
Application Delivery Controllers
11 © Zeus Technology 2010
Traffic Managers /
Application Delivery Controllers
• Traffic Management Rules
• Full Traffic Manipulation
• Additional Functionality
Advanced Load
Balancers
• Traffic Shaping
• Optimization
• Acceleration
Basic Load
Balancers
• High Availability
• Scalability
• Load Balancing
1998 2003 2008
12 © Zeus Technology 2010
• “By 2013, SoftADCs will account for nearly one third of all ADC
units shipped”
Joe Skorupa, Gartner
Zeus Traffic Manager
SSL Decryption
Service Protection
TCP Offload
Rate Shaping
Application Firewall
request
response
Web and Application
Servers
Pool
(server
connections)
Content Compression
HTTP Caching
TCP Offload
Service Level Monitoring
Bandwidth Shaping
Transaction Logging
Application Firewall
Virtual Server
(client connections)
Monitors
Request Rules
RuleBuilder
TrafficScrip
t
Java
Web-based Admin Interface
Real-Time and Historical analytics and reporting
TrafficCluster traffic sharing and fault tolerance
SOAP and Command Line APIs
SNMP and SOAP interfaces for real-time status
Event Handling interface
Response Rules
RuleBuilder
TrafficScrip
t
Java
Load Balancing
Session Persistence
Bandwidth Shaping
SSL Encryption
HTTP Multiplexing
Concurrency Control
Application Auto-
Scaling
Zeus Traffic Manager: Architecture
• “Virtualization creates new sources and destinations for traffic
in a moment's notice. Network managers in the past didn't have
to worry about that rate of change. It's [now] a much more
dynamic environment.”
Jim Frey, research director at Enterprise Management
Associates
• An Application Delivery Controller abstracts away the network
connection between the sources and destinations and manages the
transactions
© Zeus Technology 201014
Our original problem
• Mozilla Foundation
• “Strategically get content closer to users where it makes sense.”
• YottaServe
• „Virtual‟ does not have to mean „slow‟.
• Seamless upgrade of applications
• No downtime, no loss of sessions.
© Zeus Technology 201015
Three examples of applications in Cloud
environments
• http://blog.mozilla.com/mrz/2008/12/01/christmas-load-balancers/
© Zeus Technology 201016
Strategically get content closer to users where it makes
sense
• http://blog.mozilla.com/mrz/2008/12/01/christmas-load-balancers/
© Zeus Technology 201017
Mozilla
• http://blog.mozilla.com/mrz/2009/09/18/2-seconds/
© Zeus Technology 201018
Mozilla – the “Amsterdam reboot”
• http://blog.mozilla.com/mrz/2009/09/18/2-seconds/
© Zeus Technology 201019
Mozilla – the “Amsterdam reboot”
• http://blog.mozilla.com/mrz/2009/09/18/2-seconds/
© Zeus Technology 201020
Mozilla – In Singapore
• http://blog.mozilla.com/mrz/2009/09/25/where-in-the-world-is-amo-part-vi-we-did-it-
again/
© Zeus Technology 201021
Mozilla – In Singapore
„Virtual‟ does not have to mean „slow‟
22
Find the case study on www.zeus.com.
Initial application tests show that response times
rose sharply - up to over 100 seconds for a page
request - as the number of users were ramped
up.
After application acceleration and traffic
optimization, response times were less than 100
milliseconds - a complete performance
transformation!
YottaServe
23
“We were able to demonstrate that placing Zeus Traffic Manager in
front of the application transformed the number of concurrent users
from ten into thousands – with no application modifications needed.”
Jeff Rhys-Jones, Founder, YottaServe
© Zeus Technology 201024
Cloud Bursting necessary to deliver content at realistic cost
http://www.zeus.com/resources/
case_studies/comic-relief.html
No downtime, no loss of sessions
• In the cloud, your „app‟ becomes an infinitely divisible quantity
25 © Zeus Technology 2010
Smooth application upgrade process...
• Three application instances running
26 © Zeus Technology 2010
Smooth application upgrade process...
• Clone one and direct developer users to it
27 © Zeus Technology 2010
Smooth application upgrade process...
• Ready to deploy... Clone the new application version
28 © Zeus Technology 2010
Smooth application upgrade process...
• Smoothly migrate users from „old‟ to „new‟
29 © Zeus Technology 2010
Smooth application upgrade process...
• Reap the old application once all sessions are complete
No downtime
No interruption in service
No time pressure during
testing
Fully process controlled
Can roll-back at any point
30 © Zeus Technology 2010
Migrating users
How do you migrate users
from one generation of an application
to another, seamlessly?
$cookie = http.getCookie( "MyPool" );
if( $cookie ) {pool.select( $cookie );
}# If no cookie, Zeus will use the default pool
TrafficScript
$cookie = http.getCookie( "MyPool" );
if( !$cookie ) {http.setResponseCookie( "MyPool", connection.getPool() );
}
TrafficScript
31 © Zeus Technology 2010
• Several techniques are evident:
• Global Traffic Management
• Local Application Acceleration
• Intelligent Traffic Control
• Other techniques used by cloud and virtualized applications:
• AutoScaling
• Orchestration of workload bursting
• Application staging
• Monitoring and deep analytics
© Zeus Technology 201032
What techniques have these
case studies illustrated?
• Cloud is just one of the technologies an enterprise may use when
hosting and delivering applications and services.
• Enterprises require consistent delivery of applications from a
combination of physical, virtual and cloud datacenters.
© Zeus Technology 201033
When delivering your services to a
global audience becomes strategic
• Where do current solutions fall short?
© Zeus Technology 201034
Enterprise Solutions to Application Delivery
US
Europe
Japan
Development
• Management
• Consistency
• Global Traffic Direction
• Cross-platform support
• Visualization
• ROI measurement
Zeus Product Portfolio
35
Any Combination of Platforms
36
One Application Delivery Fabric
US
Single-site
deployment
Wide-area (global) load balancing
(traffic directed across multiple locations)
Disaster recovery
(US fails over to Europe)
Developme
nt
environmen
t
Auto-scaling in any
„elastic‟ location
Europe
Japan
Development
Elastic Application Delivery platform use cases
37
• Cloud is a journey. It‟s probably not even the endpoint. However,
even if you‟re not going to use the cloud, there are benefits in taking
a „cloud-ready‟ approach
• Application Delivery Controllers are key to assuring the successful
delivery of applications from datacenter to user
• They are not your Grandad‟s load balancer
• Multiple customer successes achieved using ADCs to manage user
interactions
• If delivering services is strategic to your business, look towards the
emergence of strategic solutions – Application Delivery platforms
© Zeus Technology 201038
Closing observations
© Zeus Technology 201039
About Zeus
• Application Delivery software vendor based in San Mateo and Cambridge UK
• Delivering Traffic Management solutions to:
• 7 of the top 10 Global Telcos
• Major Broadcasters and Media companies
• eCommerce sectors, spanning retail, game and leisure businesses
• Demanding Cloud and Service Providers
Over
1,300customers worldwide
AT&T, Verizon Communications, Nippon Telegraph and Telephone, Telefonica, France Telecom, Vodafone, Telecom
Italia, BT , BBC, Sky, Direct TV, ITV, C4, BT Vision, Virgin Media, Amazon
EC2, Rackspace, Joyent, 3Tera, Terremark, EMC, GoGrid, Play.Com, Gilt Groupe, Virgin
Media, PKR, Skybet, Iwantoneofthose.com, Disney, Whitepages, NASA
Other
MediaTelco Hosting & Cloud eRetail
Keeping Key Brands Online
© Zeus Technology 201040 Confidential40 © Zeus Technology 2010
• Come and see us on stand 670
• Visit us: www.zeus.com
• Get in touch: [email protected] or [email protected]
• Try it out: run Zeus application delivery solutions in EC2 or in the
cloud of your choice, or on physical or virtual servers
© Zeus Technology 201041
Find out more