Real-time Workloads Demand Real Performance: Aerospike on ... · Scale up and Scale out - Upgrade cpu/ram/disk in place - Bare Metal Nodes provisioned in 2-4 hours - Hardware upgrades/maintenance

AERO SPIKE USER SUM M IT 2018

Real-time Workloads Demand Real Performance:

Aerospike on IBM Cloud

JD Wells

[email protected]

Cloud Design Architect

IBM Cloud

2 A E R O S P I K E U S E R S U M M I T | Proprietary & Confidential | All rights reserved. © 2018 Aerospike Inc

▪ A very brief history of IBM

▪ Storage and CPU Trends

▪ Aerospike on IBM Cloud TCO

▪ Real-time workload example

▪ Adtech Stack on IBM Cloud▪ Network Layer Load Balancing

▪ Bare Metal on IBM Cloud

▪ High Performance Hybrid Cloud Approach

▪ Aerospike on IBM Cloud

▪ Cloud Object Storage▪ Data Persistence and Exploration

▪ Aerospike Backup and Recovery

Agenda


A very brief history of IBM

1969Apollomission

1971Floppydisk

1973 UPCbarcode

1973 ATM machines

1911Scales

1931Translator system

1957FORTRAN1928

IBM 80 Column punchcard

1944Mark 1 calculator

1962 SABRE

1964System/360

1961Selectric typewriter

1993Blue Gene

1997e-business

2008SmarterPlanet

2011 Watson Jeopardy

2000IBM eServer

1992IBM Consulting Group

2006IBM Information Server

1996IBM Net.Commerce

1997Deep BlueWorld ChessChampion

1981 PC

1981 ExcimerLaser Surgery

Mainframe Era PC Era Services Software

Incorporated

1924IBM BrandEst.


4

Tabulation Machines


The

Mainframe

was the

Original

Cloud


Cloud & Cognitive


CPU Trends over timeSource: Karl Rupp

https://www.karlrupp.net/2015/06/40-

years-of-microprocessor-trend-data/


Storage growth over timeSource:: Patrick Cheesman

https://www.eetimes.com/author.asp?section_id=3

6&doc_id=1330462


CPU Frequency PlateauSource: Karl Rupp

https://www.karlrupp.net/2015/06/40-

years-of-microprocessor-trend-data/


Aerospike TCO

- Predictable Linear TCO scale

- Purpose built to cost effectively

scale up and out

- Automatic data replication and fail

over across the cluster, rack and

data centers

IBM Cloud delivers on performance

and lowers TCO

- Eliminate Hypervisor Tax

- Dedicated Network Interfaces

- SSD / NvME / Optane

- Unmetered private network

backbone

Reduce Compute Sprawl and Complexity


“The ability to access IBM’s global

network of cloud data centers, which

are all connected by a high-speed fiber

network, is extremely attractive to

us.”

-Rob Platzer, CTO


Data Centers: Globally local

Choose where to deploy

from nearly 60 locations

in 19 countries

Scale locally or globally

with all sites connected

privately via the

unmetered/free IBM

Cloud Backbone

Unmetered in region

private network peering

via Direct Link service


Bare Metal, Virtual, Containers all deployable in the same DC/AZ network segments

- Minimize latency

- Maximize throughput

- Reduce hops

- Simplify security

Customer Announced Subnet / Prefix service

Network Architecture

- Juniper Networks backbone infrastructure

- Cisco and Arista datacenter architecture

Recent upgrade of multipath diverse 100G backbone across US and EU, extending into APAC

IBM Cloud Network Highlights


“We’re able to provide our services at a

lower cost than other cloud-based

competitors. That’s an important part of the

IBM Cloud solution for us.”

-Tim Koschella, CEO and Cofounder


Example Real-time Ad-tech Stack on IBM Cloud


“DataXu built its platform on top of the IBM

Bluemix Cloud… IBM was able to offer very

high end CPUs on a very low latency network,

that's important because were observing on a

global basis 25 billion digital touch points

every day… from a price performance point of

view only the IBM Cloud was able to provide

that””

-Dr Bill Simmons, Founder & CTO


US-EAST (WDC) REGION

Website/Publisher

Ad Exchange

Fixed IP/Prefix

- Some exchanges/networks ignore DNS TTL

- Bring your own IPv4 or IPv6 - Custom controlled BGP Announcement

- Anycast

- Dynamic DDoS mitigation

TCP Pass Through

- Terminate SSL traffic directly to server instance

SSL Off Loading

- Reduce server load and SSL distribution points

- Optimize connections / second

Wide Selection of Dedicated Options

- NetScaler MPX

- Build/Bring your own HW or SW LB- F5 / A10 / ArrayNetworks / HAProxy / Nginx

Network Layer Load Balancing



Website/Publisher

Ad Exchange

Dedicated, high throughput, low latency

API Provisioned in 2-4 Hours

- Hourly instances available

Numerous Processor Options & Architectures

- Intel Xeon, OpenPower

- Single, Dual, Quad & Octo Proc

On Server Storage

- SATA, SSD, NvME, Optane

On Server GPU

- Nvidia M60, K80, P100, V100

Multiple 100M - 10G Network Interfaces

Scalable RAM Configurations

- 8GB - 3TB+

Bare Metal on IBM Cloud


VMs, K8s Containers and Bare Metal all on Cloud

- All deployable into the same same DC/AZ network segments

- Precision deploy and optimize service instance type to fit workload

- Programmatically Provisioned

- Portal / API / Terraform IBM Cloud Provider

VMs

- SAN and SSD storage instances

- Fully Dedicated Host option

Kubernetes / K8s Containers

- Multi-tenant Virtual

- Dedicated Virtual

- Bare Metal

High Performance Hybrid Cloud Approach


“Bluemix (IBM Cloud) infrastructure has

helped put us in a position where we now

process billions of post-ad click events,

support over 16 million purchase events each

day and help our customers track over 1.5

billion user profiles.”

-Ben Tregoe, SVP of Business Development


Shared nothing philosophy

Bare Metal and Dedicated Virtual Hosts remove “Instance Pause” concern

Predictable low latency at high throughput

XDR Cross Datacenter Replication

- IBM Cloud Network makes it simple and cost effective to globally scale

- Unmetered Global Private backbone

- Free in region Direct Link ingress/egress private peering

On Server Storage

- SSD (Intel / Micron), NvME Optane

Precision Deployment

- In same vlan / subnet / server room / row / rack

- Rack aware, rack location is available via API / Portal



Aerospike auto-tuning optimizes performance

and TCO with every generational refresh

Scale up and Scale out

- Upgrade cpu/ram/disk in place

- Bare Metal Nodes provisioned in 2-4 hours

- Hardware upgrades/maintenance in 2-4 hours

Take the guess work out of cloud computing

- Most cloud competitors don’t/can’t guarantee

processor architecture

- Consistent performance and build specs

Refresh with no capex commit

- V3 > v4 > v6 / Sky Lake



“Data will be your basis of

competitive advantage.”

Ginni Rometty, President and

CEO, IBM

Source: If applicable, describe source origin



Website/Publisher

Ad Exchange

Built on Cleversafe

- Founded in 2004, acquired by IBM in 2015

- Innovation Leader Software-defined. 400+ patents

- Market Leader IDC 20161Gartner 20162

- Scale Leader only vendor with multiple 100-petabyte customers deployed

S3 API Support

Available Globally on Public and Private Network

- Regional- High Availability, data dispersed across multiple regions

- Cross Region- Lower latency, data dispersed across multiple DCs/AZs in region

Cloud Object Storage SQL

- Run SQL queries (SELECT statements) to analyze, transform, or clean up data

IBM Cloud Object StorageSources:

1.IDC Object Storage Marketscape, 2014, and 2016 reports.

2.Gartner Critical Capabilities for Object Storage Report, 2016


IBM Cloud Object Storage flexibility, scalability and simplicity

On-premises

• Single tenant

• Design specific to client needs

• Total control of system

• Single tenant (compliant)

• No datacenter space required

• Flexible configuration options

• OPEX versus CAPEX

• Multi-tenant

• Usage-based pricing

• Elastic capacity

• No data center space

required.

• Fully managed

• OPEX versus CAPEX

Hybrid

Consistent, uniform, and open technology across on-premises,

hosted and public cloud makes it simpler and more efficient to

manage data, workloads, and business processes.

Dedicated

S3 API


IBM Cloud Object Storage unparalleled availability and durability

SecureSlice and information dispersal technology redefine

availability, security and economics of cloud storage

Encrypts data

Transforms,

expands, slices

data

Decrypts data

Decodes data

Our technology ensures:

• Data is available, even in the face of a regional outage

• Data is protected with no external key management

required, even in the face of regional outage

Disperses

slices of data

across regions

Retrieves

data with a

subset of the

slices

*

*All-Or-Nothing transform

EncryptionDecryption

* *

2

1

3 4

6

5X

X


IBM Cloud Object Storage for Data Persistence and Exploration

Persist

Analyze

Ingest Deploy

Projects | Data | Assets | Pipelines | APIs

Intelligent governance | Policy enforcement

CollaborateFind Share

Data steward Data engineerData scientist DeveloperBusiness Analyst

IBM Cloud Object Storage

Cloud Object Storage delivers:

• Data persistence

• Data exploration

• Data governance


IBM Cloud Object Storage and Aerospike Backup and Recovery

Cluster Backup

- Server Disk / Mount

Initial back up location

IBM Cloud SAN offers snapshots and remote replication for automated incremental backups

- Cloud Object Storage

Backups initially stored to server disk/mount then pushed Object Storage via S3 API

Example using s3cmd: asbackup [...] --output-file - | gzip -9 | s3cmd put - s3://BUCKET/FILE

Cluster Restore

- Download the backup file from Object Storage / File Store onto a system with asrestore. Use asrestore to restore the data back into a cluster.

cat BACKUP.GZ | gunzip | asrestore [...] --input-file -


“So IBM is not just "back"— IBM's now one of

the big dogs in the new high-stakes world of

modern enterprise IT centered on how cloud,

AI, blockchain, machine learning, and

advanced cybersecurity can help businesses

get, manage and exploit data to make better

decisions, dazzle customers and trounce

competitors.”

-Bob Evans, Forbes, 19 January 2018

AERO SPIKE USER SUM M IT 2018

Real-time Workloads Demand Real Performance:


JD Wells

[email protected]

Cloud Design Architect

IBM Cloud

Documents

Real-time Workloads Demand Real Performance: Aerospike on ... · Scale up and Scale out - Upgrade cpu/ram/disk in place - Bare Metal Nodes provisioned in 2-4 hours - Hardware upgrades/maintenance