What You Don't Know About 3rd Party Scripts Can Hurt You!

Preview:

Citation preview

What You Don’t Know About 3rd Party Scripts

Can Hurt You

About the Speakers

Scott D. Lowe, vExpertPartner and Co-Founder

ActualTech Media

Buddy BrewerSVP, Products

SOASTA

Jason TresterSenior Director of Site

EngineeringCBS Interactive

The Problem

A typical web page today can contain requests with upward of 75% happening via 3rd party scripts

Do you really know what kind of experience your visitors are having?

How do you manage the risk and the ROI of the tools provided by these parties?

The Needs

Measure 3rd party scripts to make sure they’re not driving your customers away

Truly understand the impact that every script has on your visitors

Provide decision-makers with critical, simple, and actionable metrics

SOASTA Customer Case Study

Jason TresterSenior Director of Site

EngineeringCBS Interactive

CBS Interactive Key Metrics

200 Million+Page views per month

350-400 RequestsPer page load

50 Million+Unique visitors per month

2 SecondsTarget page load time

CBS Interactive Key Metrics

QuestionHow does CBS Interactive optimize the user experience and support

massive traffic patterns while adhering to performance

requirements?

CBS Interactive Key Metrics

AnswersIt starts by knowing your numbers (Ensure

adherence to business objectives)Leverage tools to enable actionable

intelligenceDevelop data-driven optimization

processes

CBS Interactive Key Metrics

Actionable IntelligenceLeverage tools to enable actionable intelligence

SOASTA mPulse enables CBS Interactive staff to put site metrics in front of a non-technical audience so they can easily see what their page load times look

likeSOASTA SpeedCurve has also allowed CBS

Interactive to automate a lot of their manual web page tests

SOASTA mPulse – Actionable Metrics

SOASTA mPulse – Actionable Metrics

SOASTA SpeedCurve – Actionable Metrics

SOASTA SpeedCurve – Actionable Metrics

Actionable Intelligence

Every third party must go through an A/B test to see how they perform SOASTA enables these efforts

Actionable Intelligence

12/7 RUM Performance Results (Article Page)3.65s Control9.73s Sample Tool267% Increase in Page Load TimeNote: Document Complete = time it takes for page to become usable (required CSS, JS, and Images)

Actionable Intelligence12/7  Synthetic Performance Results

1. Delayed visual start render by 15%-31%2. Increased our doc complete size by 49% and time by 113%-150%3. Sample Tool makes ~31 requests

• 5 Sample Tool requests (30% time; 78% size)• 27 third-party requests (70% time; 22% size)• Bandwidth consumption does NOT include Ad creatives

4. Bandwidth consumption 3x > Visual Revenue, Qualtrics, and DW link5. Bandwidth consumption 3x > CNET Site JS

Example resource comparison

Group Request CountTime(ms)

Size(KB)

CNET JS 19 1,504 168

Sample Tool 33 4,528 210

Excludes ad/tracking services and video player

Actionable Intelligence

1/26 RUM Performance Results (Article Page)3.01s Control8.17s Sample Tool271% Increase in Page Load TimeNote: Document Complete = time it takes for page to become usable (required CSS, JS, and Images)

Operationalizing IntelligenceDevelop data-driven optimization

processesUse the results of performance metrics to make decisions based on performance cost of 3rd party

scriptsUse the information to make critical decisions, such as

priority load order of requestsKey takeaway: It’s easy to glean relative importance of

scripts based on the order in which they load

Operationalizing Intelligence

Operationalizing Intelligence

The Details Matter!

CBS Interactive spent 6 months making sure that fonts load quickly They established certain requirements on the font

vendor They try to keep all 3rd party scripts under 1000 ms

SOASTA enables these efforts

The Tools Matter! SOASTA

mPulse SpeedCurve

Grafana, Sitespeed.io, PhantomJS Tealium

Helps CBS Interactive control the order in which items load on their sites

RequireJS

GENERAL GUIDANCE

Figure Out How Fast You Need To Be

Use the Activity Impact Score• Tells media companies which pages are most important so they can prioritize their efforts

Define the ROI• If you were going to make an investment to speed things up, what would that mean for the business? (add revenue at expense of performance?)

Try SOASTA for Yourself!

https://www.soasta.com/performance-monitoring/sign-up/

Plans start at just $99/month!

Recommended