Varnish ExtendBuilding a content delivery network in four hours

Per BuerProduct Strategist, Varnish Software

What is it?• Bundled software and services

• Varnish Plus - intelligent caching

• Cedexis - global load balancing and purging

• Allows users to control content delivery

• Can be applied to “private CDN” or “hybrid CDN”

• Caching proxy capable of caching 100TB+ of content per server

• Advanced functionality such as cache-to-cache replication

• TCP Acceleration ad-on for higher performance on mobile

• Real time statistics collection from the traffic that flows through the network

• Easily managed through graphical UI

Cedexis OpenmixCLOUD-BASED GLOBAL LOAD-BALANCER

• Automated Traffic Management • Multi/Hybrid-Cloud, Data-Centre, CDN, Server

• Multiple Data Streams can be used • Designed for Custom Routing Strategies

BENEFITS

• Real-User Telemetry embedded in platform • Advanced Control possible • Highly Distributed and built for purpose

What is the problem Varnish Extend is trying to solve?

• Removes the need for “all or nothing” CDN strategy

• Directs global traffic to the right servers

Varnish Extend and capacity planningRe

ques

t per

sec

ond

0

15000

30000

45000

60000

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Origin DC Datacenter 2 CDN

Geo-distribution of trafficOrigin DC

West Coast DC

East Coast DC

Traditional content delivery through CDN

CDNLocation: London, UKISP: BT

Location: London, UKISP: BT

Location: Hong KongISP: PCCW Ltd

Inspiration

• Tesla Motors were distributing huge amounts of contents to 100k+ vehicles and users across the globe

• Set up a PoC in a few hours

• Leveraged existing global server infrastructure

Advanced Caching Software

• Intelligent Caching Server

• VCL provides full manipulation of request/response

• Content Control

CedexisAdvanced Routing Technology• SaaS based Software Defined GSLB

• DNS (CNAME/A Record) or HTTP API based

• Multi Platform Purge

• Real-Time 3rd Party Monitoring

• Clouds

• CDN’s

• Date Centre’s

• Servers

Varnish

Cedexis GTM - Configure through JavaScript or Prebuilt Applications

All the JS Language features.

• ECMA 5 Supported

• Write for corner cases

• Build automated intelligence into your Traffic management.• Cost, Load, Availability and

Performance and much more

• Pre-Written JS Apps in developers.cedexis.com

Basic Pre-Built Applications in Portal• Basic Performance and

availability application.

Intelligent Cross-Pop Traffic Management.

Normal Routing Under Weight Routing Remove From Routing

NORMAL routing weightings:

▪ Route based on best “server” for the end-user.

▪ Costs weighted, RUM Performance, Geo and more..

Under or overweighting:

▪ Divert traffic to nodes based on load.

▪ Weight nodes (and performance) based on loading of the server.

▪ Use metrics such as Server metrics CPU steal-time, RAM or I/O capacity utilization

Remove from routing:

▪ Interface down/instance down

▪ CPU/RAM or I/O exhaust

▪ Availability monitoring says node is down.

▪ Fast failover traffic to other nodes.

How does Extend help?

• Strengthen the origin to server traffic

• Add a mechanism to direct incoming traffic

• Allows for secondary active-active datacenter

• Leverage CDNs to handle traffic peaks and capacity problems

Supported content

• Everything that can be carried over HTTP

• Static web, dynamic web

• Linear and on demand video (HLS, DASH et al).

• API Content

Varnish Extend deployed

Strengthen the origin• Install Varnish Plus on origin to increase capacity

• Both direct traffic and CDN traffic will burden the origin

• Origin typically has good connectivity - you can leverage it

• DC capacity is typically cheaper than CDN delivery

Add a secondary DC

• A secondary DC can add capacity to handle everyday peak traffic

• Multiple Varnish servers can leverage Varnish High Availability to increase capacity and offload origin

• Route incoming traffic through OpenMix

Add a CDN to OpenMix

• You might not want servers all across the globe

• A CDN already provide this

• CDNs typically scale very, very well

• Only applied when serving out of your servers are not ideal

Components used in Varnish Extend

• Varnish Cache Plus w/Massive Storage Engine used for caching - scales up to 100TB per cache

• VHA for increased performance and resilience in each location

• Cedexis Openmix for Global Load Balancing

• Cedexis Global Purge

Intelligent delivery platform

Varnish

Varnish Varnish

Big global CDN

Latin CDN Inc.

Q & A

Varnish High Availability

varnish plus 1 varnish plus 2

Client requests

Replication streams

Enable TLS

• Varnish Extend comes with full TLS support

• Client facing TLS

• Origin facing TLS

Q & A