© 2014 SOASTA. All rights reserved. January 30, 2015 1 CONFIDENTIAL – Not for Distribution

© 2014 SOASTA. All rights reserved. January 30, 2015 2 CONFIDENTIAL – Not for Distribution

o  Overview

o  Top 10 Mobile and Web Performance Lessons from 2014

o  Demo

o  Q&A

© 2014 SOASTA. All rights reserved. January 30, 2015 3 CONFIDENTIAL – Not for Distribution

According to the IBM Black Friday Report 2014

o  Thanksgiving Day traffic from mobile (smartphones and tablets) was 52% of all online traffic •  First time mobile devices have outpaced PC for online browsing •  People don’t typically bring their PC to Thanksgiving dinner but they don’t

want to miss a sale!

o  Black Friday mobile traffic was 49.6% of all online traffic •  Increased 25% over last year

o  Black Friday mobile sales were 27.9% of all online sales •  Increased 28.2% over last year

© 2014 SOASTA. All rights reserved. January 30, 2015 4 CONFIDENTIAL – Not for Distribution

o  Thanksgiving online sales were up 14.3% compared to 2013

o  Black Friday online sales were up 9.5% YoY •  Mobile devices accounted for 25% of all online purchases

© 2014 SOASTA. All rights reserved. January 30, 2015 5 CONFIDENTIAL – Not for Distribution

o  And Tablets lead SmartPhones

© 2014 SOASTA. All rights reserved. January 30, 2015 6 CONFIDENTIAL – Not for Distribution

o  BestBuy site failed: “A concentrated spike in mobiletraffic triggered issues that led usto shut down BestBuy.com inorder to take proactive measuresto restore full performance.”

© 2014 SOASTA. All rights reserved. January 30, 2015 7 CONFIDENTIAL – Not for Distribution

o  4G Coverage is covering the map

© 2014 SOASTA. All rights reserved. January 30, 2015 8 CONFIDENTIAL – Not for Distribution

o  WiFi is Everywhere, too •  Xfinity Connect modems •  Every airport, hotel, even stores (e.g. Kohl’s, Target) •  Levi’s Stadium, home of the 49ers •  1200 Access Points, 1 for every 100 seats •  40 Gb/s capacity •  Mobile app for video replays,

food ordering, wayfinding

o  More access from mobile web, mobile apps

© 2014 SOASTA. All rights reserved. January 30, 2015 9 CONFIDENTIAL – Not for Distribution

o  Number of users accessing from mobile devices will continue to grow

o  A customer can be in a store and in multiple mobile apps and sites

© 2014 SOASTA. All rights reserved. January 30, 2015 10 CONFIDENTIAL – Not for Distribution

o  2.5M Likes on Facebook

o  75k followers on Twitter

o  Flash sale on Nov. 11 •  Just three hours long!

© 2014 SOASTA. All rights reserved. January 30, 2015 11 CONFIDENTIAL – Not for Distribution

o  Site down

© 2014 SOASTA. All rights reserved. January 30, 2015 12 CONFIDENTIAL – Not for Distribution

o  Customer Service burden

o  Customer Retention Cost •  Email: “Our apologies and $10 off.

How lucky can you get if the site is down?”

© 2014 SOASTA. All rights reserved. January 30, 2015 13 CONFIDENTIAL – Not for Distribution

o  DSW site has clean history for site failures

Except:

o  Coupon code processor was not able to scale to traffic •  For second year in a row

o  It’s not enough to load test the site without testing the scenarios

© 2014 SOASTA. All rights reserved. January 30, 2015 14 CONFIDENTIAL – Not for Distribution

o  Include testing time in your schedule •  Seasonal events don’t move!

o  Make time for testing twice, or thrice! •  If first test fails, when will you test again? •  Can you tweak things quickly to run more than one test per window?

o  Even with Continuous Testing, you should leave extra time for load testing. Passing functional tests doesn’t mean your app will pass load tests

© 2014 SOASTA. All rights reserved. January 30, 2015 15 CONFIDENTIAL – Not for Distribution

Don’t let your site go down in your high season!

o  Super Bowl Sunday – commercials drives high demand to your site

o  Chinese New Year – retail load for new clothes

o  Valentine’s Day – candy, gifts, flowers

o  Tax Day – most online filers submit on April 15

o  Healthcare enrollment – many filing for coverage in November

o  Singles Day – Largest online shopping day in the world!

o  Christmas season – Thanksgiving Day, Black Friday, Cyber Monday

© 2014 SOASTA. All rights reserved. January 30, 2015 16 CONFIDENTIAL – Not for Distribution

o  At least they could have been honest!

© 2014 SOASTA. All rights reserved. January 30, 2015 17 CONFIDENTIAL – Not for Distribution

o  Add capacity when you know you’ll need it

o  Reduce the amount of content your are trying to deliver •  Lower bytecount means faster delivery

o  Simplify Your Pages •  Remove extra third-party features that slow your site down

o  Optimize for different devices •  Don’t send high-res images to low-res devices •  Users don’t want their data allowance hogged by your site

© 2014 SOASTA. All rights reserved. January 30, 2015 18 CONFIDENTIAL – Not for Distribution

o  Valentine’s spending:

o  Test from the same locations as your customers

© 2014 SOASTA. All rights reserved. January 30, 2015 19 CONFIDENTIAL – Not for Distribution

o  See how Target monitored their site from the users’ perspective on Black Friday:

o  Synthetic monitoring doesn’t collect real users’ experience

© 2014 SOASTA. All rights reserved. January 30, 2015 20 CONFIDENTIAL – Not for Distribution

o  Possible areas for failure: •  Payment processing engine •  Social media content plug-in •  CDN •  Analytics plug-in •  Synchronus vs. Asynchronus calls

o  Build your site to handle third party content failures •  Why let another site’s problem ruin your user’s experience?

© 2014 SOASTA. All rights reserved. January 30, 2015 21 CONFIDENTIAL – Not for Distribution

o  Test in pre-production but don’t only test there

o  Test in production – the only way to know the true capacity •  Test off-hours •  Better to find issues before the user volume •  Test at 100% anticipated load, then 125%, then 150%, even 200% •  Good way to find weak spots to put in budget for next season •  Maybe your competitors site will fail and your site will get extra load

o  Monitor the production site at system and user level •  Watch CPU, memory, IO, throughput, etc. •  Measure real user metrics to determine a real user’s experience •  Monitor in real-time so you can modify the test, down or up

© 2014 SOASTA. All rights reserved. January 30, 2015 22 CONFIDENTIAL – Not for Distribution

o  Best Buy failed on Black Friday after running an online promotion

o  Cost of Downtime calculator •  https://www.serverdensity.com/cost-of-downtime

© 2014 SOASTA. All rights reserved. January 30, 2015 23 CONFIDENTIAL – Not for Distribution

o 

© 2014 SOASTA. All rights reserved. January 30, 2015 24 CONFIDENTIAL – Not for Distribution

o  Facebook and Instagram go down on January 26 •  Facebook said: “Earlier today many people had trouble accessing Facebook

and Instagram. This was not the result of a third party attack but instead occurred after we introduced a change that affected our configuration systems. We moved quickly to fix the problem, and both services are now back to 100% for everyone.”

•  The dating app Tinder, which relies on Facebook to provide its service, was also affected.

© 2014 SOASTA. All rights reserved. January 30, 2015 25 CONFIDENTIAL – Not for Distribution

Expertise

© 2014 SOASTA. All rights reserved. January 30, 2015 26 CONFIDENTIAL – Not for Distribution

o  mPulse: Real User Monitoring (RUM)

o  CloudTest: Load testing from the public cloud

o  Data Science Workbench: analytics

Also Available:

o  TouchTest: functional testing of mobile apps and websites

© 2014 SOASTA. All rights reserved. January 30, 2015 27 CONFIDENTIAL – Not for Distribution

o  Sign up for mPulse Lite, CloudTest Lite, TouchTest Lite

o  Always Free, no time-out •  http://goo.gl/jWEX56 or Soasta.com/free •  Free access to CloudLink forums, videos, docs: http://cloudlink.soasta.com

o  Read our blog •  Soasta.com/blog

o  Third-party sites •  PerfBytes: perfbytes.com podcast •  PerfPlanet: perfplanet.com

o  Keep in touch: @TomChavez