Best Practices in Performance Testing Webinar Series

In This Webinar:!Here come the holidays!  

I.  The Top 5 Keys to Web & Mobile Performance Readiness II.  Real World CloudTest Case Studies with the SOASTA Performance

Team III.  Discussion & Q&A

TODAY’S PRESENTERS

Dan Bartow: VP Product Management, Evangelist Amit Patel: Sr. Performance Engineer Brad Johnson: VP Product Marketing

Questions: Submit in the question box during event

#1 - Use The Cloud for Realistic Results!Low cost, unlimited scale & global availability deliver…

Testing on your schedule

Meaningful scale & appropriate concurrency

Most accurate models of real user behavior

Control to start, stop & modify tests without delays

#2 Measure across the entire application !Measuring user response time may indicate a problem!

User Experience

Web Applications

Constrained Load Scenarios

! slow

#2 Measure across the entire application !Measuring everything captures the source of delays !

User Experience

Complex Web Applications : AJAX, HTML5, video, mobile, web services

Accurate Scale Load & Business Flows

Deployment Infrastructure

(Internal)

Deployment Infrastructure

(External) Network

Application Component &

Code

Why Slow?

#3 Correlate in real-time during test execution!Drill down into the cause while issues are occurring

#4 Compress Test Build & Execution!More tests, less time, high coverage = less risk

Traditional Approaches

TIME

Cloud Test

#5 Test for Failure!Broaden the scope of coverage to worst cases

Failover Scenarios

Chaos Monkeys

Success Disasters

SOASTA Case Studies

Dan Bartow and Amit Patel

-  Current Engagements – -  Fresh Data –

-  Leading Companies -

CloudTest Live!Production Testing Veterans, Year Round

Company Profile Company Retailer

Size Top 10 Retailer

Project Profile Environment Stage and Production

Application Java, ATG, Oracle

Location Multiple Dedicated Private Data Centers

Objective 150,000 Concurrent

Project Length Year Round

CloudTest Live!Production Testing Veterans, Year Round

•  Comprehensive Test Cases

•  Two Datacenters, Thousands of Servers

•  Mobile App Testing

•  Geographically Relevant Load Generation

•  Near Daily Production Testing Across 7 Properties

•  The CDN is a Big Player

Discipline and Rigor

CloudTest Live!Success Through Constant Testing and Improvement

CloudTest Live!Comprehensive Testing Plan

Company Profile Company Toy Manufacturer

Size Fortune 500

Project Profile Environment Production

Location Hosted Private Data Center

Objective Test Multiple Web Properties

Project Length < 1 Month

CloudTest Live!Comprehensive Test Plan

•  Fairly High Level Test Cases

•  One Datacenter, Handful of Servers

•  Baseline, Spike, Failover, Stress

•  Flex Based Apps, Browser Based Games

•  Cloud Based Load Generation

•  Executed in About Three Weeks

•  The CDN is a Big Player

Thorough Coverage

CloudTest Live!Thorough Coverage – Great Results

CloudTest Live!Large Testing Initiative

Company Profile Company Retailer

Size Fortune 50

Project Profile Environment Stage and Production

Application Java, Oracle

Location Multiple Dedicated Private Data Centers

Objective 30,000 Concurrent

Project Length Ten Months

CloudTest Live!Large Testing Initiative

•  Two Work Load Models

•  Two Environments

•  Infrastructure Testing

•  Application Testing

•  24/7 Testing

Testing, Testing, Testing!!!!

CloudTest Live!Large Testing Initiative

Success!

CloudTest Live!Real-world Issue Resolution

Company Profile Company Music Retailer

Size Fortune 1000

Project Profile Environment Stage

Location Hosted Private Data Centers

Objective Test Multiple Web Properties

Project Length < 1 Month

CloudTest Live!Real-world Issue Resolution

•  Scaling Issues •  High Response Times •  Timeout Errors

Q&A

Contact SOASTA: www.soasta.com/cloudtest/

info@soasta.com 866.344.8766

Follow us:

About SOASTA •  Founded in 2006, privately held •  Silicon Valley HQ: EMEA & N/A offices •  1 Platform: 6 CloudTest Editions:

–  Lite: Free performance testing at any stage –  Mobile: Mobile performance testing –  Standard: Internal performance testing –  Pro: External & internal testing to any scale –  Enterprise: Multi-division solution

–  On-Demand: Complete testing service