What you need to know to successfully run Kubernetes Master … Master Class Series/How to... · Containers are different than VMs DYNAMIC You’ve outsourced ops to K8s. Your pets

1© 2019 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE

Kubernetes Master Class:

What you need to know to successfully run databases in production on Kubernetes


Michael Ferranti,VP, Product & Market Strategy

STATEFUL CONTAINERS SINCE BEFORE IT WAS COOL

CLOUD/SAAS PRODUCT & MARKETING BACKGROUND

PASSIONATE ABOUT DISTRIBUTED SYSTEMS

EX-CLUSTERHQ (FLOCKER), MAILGUN, RACKSPACE




An (incomplete) timeline of stateful containers

Flocker launches

Docker 1.8 w/

volume plugins

July 2014

Aug 2015

Docker launches

March2013

K8s launches

June 2014

K8s CSI GA

Dec2018

K8s CSI Alpha

Jan2018

K8s in-tree volume drivers

April 2016

CNS DayKubeCon

Dec2018


Containers are differentthan VMs

DYNAMIC

You’ve outsourced ops to K8s. Your pets WILL be lost.

MACHINES ARE NO LONGER UNIT OF ANALYSIS

You can’t count on machine based processes for security, backup, DR, HA, etc

HEAVILY MULTI-TENANT ENVIRONMENTS

It’s not just your cloud that is multi-tenant, it is your cluster.

WITH GREAT POWER….

Individual devs empowered for speed...and increased risk.


So why is it so hard to run databases in containers?



‣ Persistence, PVs. PVCs, etc

Storage for containers





‣ Security‣ DR‣ App consistency

Data management for apps







Mos t oc be re







Whi m bu s eq e n g i n


You are building an app runtime platform with Kubernetes

APP 1 APP 2 APP 3 APP 4

AWS AZURE ON-PREM

YOUR GOALS

► DevOps Agility

► Automation

► Infrastructure Optimization

► Innovate Faster

► Low Touch Ops


But Kubernetes alone cannot meet your business requirements

► Sensitive user data

► Apps with strict SLAs

► Business transactions

► Strict compliance requirements

► Revenue generating apps

► Strict DR protocols


AWS AZURE ON-PREM


80% of enterprises list data management, persistent storage and disaster recovery as top barriers limiting container adoption

* The New Stack, Multicloud Now a Chief Driver for Containers, 12/2018


Many traditional storage products lack container native data services, are not closely tethered to orchestrators and are expensive on a total cost of ownership (TCO) basis. Many continue to use complex LUN/volume management. Mounting of block devices is time-consuming.

An I&O Leader's Guide to Storage for Containerized Workloads, Gartner, Jan 29, 2019


Choose storage solutions aligned with microservices architecture principles and adhere to the requirements of container-native data services

Select products closely aligned with the dev workflow tools that can be directly integrated with the application layer for portability, scaling and data protection.

Gartner’s take

Download at: https://portworx.com/gartner

Select vendors that have closer integration with Kubernetes and support standard interfaces

https://portworx.com/gartner


Why can’t you simply do this?


Connectors to legacy storage


How do you allocate infrastructure to your users?

APP 1 APP 100

SERVER 1 SERVER 2 SERVER 5

APP 2

Statically assign resources?


How do you scale your infrastructure for your users?

APP 1 APP 1000’s

SERVER 1 SERVER 2 SERVER N

APP 2

Have IT provision more hardware?

Dedicate many admin hours?


How do you handle Day 2 failures at scale?

APP 1 APP 1000’s

SERVER 1 SERVER 2 SERVER N

APP 2

HOW WILL YOU RECOVER FROM

► storage failures

► server or software failures

► upgrades


Snapshot one Consistency Group

What about application consistency?


Server 1 Server 2 Server 5

Have your users work it out with IT?


How do you ensure high availability across zones?

AWS AZ 1 AWS AZ 2

APP 1 APP 1


How do you manage application performance?


Server 1 Server 2 Server 5

What if one prod deployment interferes with another production deployment?

Production 2 Deployment

Prod 1 Deployment


Namespace A Namespace B

PVC1 PVC2 PVC3

Vol 1 Vol 2 Vol 3

How do you secure your customer’s data?

What is the best way?

User A User B


PX-Store

PX-Central

PX-Security PX-Data Mgmt PX-DR

The Portworx Platform

Solving the critical problems of running data-rich apps on k8s


PX-Store

PX-Central



Container-granular

Scalable

Tuneable

HA

PX-Store


PX-Store

PX-Central



User interface

Monitoring

Metrics

PX-Central


PX-Store

PX-Central



PX-Security

Authentication

Authorization

Encryption

Ownership


PX-Store

PX-Central



PX-Data Mgmt

Migrate App & Data

App consistent snaps

Backup to cloud

Copy-data-mgmt


PX-Store

PX-Central



PX-DR

Zero RPO failover

Failover across WAN

App & Data DR

Container granular


DEMO

https://www.youtube.com/watch?v=-7pVC6ocF3k

https://www.youtube.com/watch?v=-7pVC6ocF3k


Portworx brings a unique mix of cloud native expertise

STORAGE &DATA SERVICES

Years of expertise in enterprise storage

Invented storage orchestration for K8s

APPLICATION & ORCHESTRATION

INTEGRATION

Deep and early Kubernetes expertise

Co-led the founding of CSI

MULTI-CLOUD DNA

1st to offer multi-cloud Kubernetes storage

1st to offer migration across environments

THIS IS A PARTNERSHIP AND WE ARE HERE TO ENSURE YOUR SUCCESS



AWS AZURE ON-PREM

Focus on the right problem

Run application and data management from within Kubernetes

ON-DEMAND APPLICATION DATA MANAGEMENT SERVICES

Portworx is the market leading cloud native storage and data

management software solution that is fully managed from within Kubernetes

and also gives you the security, reliability and performance you’d expect

from enterprise class traditional infrastructure


Portworx is part of a modern cloud native stack

Portworx allows you to move this stack across various infrastructure types

NETWORK COMPUTE STORAGE (EBS)

AWS

NETWORK COMPUTE STORAGE (MD)

AZURE

NETWORK COMPUTE STORAGE (G-PD)

GOOGLE

NETWORK COMPUTE STORAGE (V-SAN)

BARE METALVMWARE

YOUR PORTABLE CLOUD STACK

Runs on any interchangeable infrastructure

Multi Cloud

...

Cloud Native Scheduling

OCI - Cloud Native Execution Runtime (ex. )

CSI CNI

Cloud native networking vendor

Pro

met

heus


PORTWORX: MOST BATTLE-TESTED

Enterprise-ready Application Data Management

Extremely high application density

Bare metal performance, on-demand

Massive scale beyond SAN or cloud block devices

Multi-faceted data security

“Portworx provides infrastructure-agnostic features — such as volume persistence, high availability, data security and automation — that are valuable to a business like GE Digital.”


“We chose Portworx because it is a stable, mature, container-native storage option with one of the most responsive engineering and support organizations I’ve ever worked with.”

PORTWORX 100% CLOUD NATIVE

Application-aware data orchestration, Kubernetes style

HA of Kubernetes: Failover in seconds

Seamless backup & recovery w/RPO zero

Run data and storage operations from Kubernetes

DevOps native workflows auto-scaling & blue-green releases


ONLY FROM PORTWORX

Complete automation for multi-cloud operations

Automate everything, even mission critical data

Non-disruptive upgrades - deploy 10x a day

Easily run your apps on any environment(s)

Migrate 100% in minutes across multiple clouds, zones, & DCs

“We looked for a partner that would provide us a stable performing environment for critical data on Kubernetes and Portworx checked all those boxes. ”


Multi Cluster Workflows

Application Aware, Kubernetes Aware


Cluster Migration and Burst

x86 x86 x86 x86

CLUSTER 1 CLUSTER 2

Cloud


Multi Cloud Workflows

Built for a Multi Cloud World


PX-DR - Metro area Stretch Cluster

x86 x86 x86

DC1 DC2

x86 x86 x86

OPENSHIFT CLUSTER 1 OPENSHIFT CLUSTER 2

1 2 3

TWO SEPARATE OPENSHIFT CLUSTERS

SINGLE STRETCHED PX OVERLAY


PX-DR- Metro area Stretch Cluster

x86 x86 x86 x86

DC1 DC2

Cloud

► Separate k8s Clusters with contiguous PX cluster

► Common Data Underlay

► PVCs available immediately

MODULE REPLICATION TYPE RPO/RTO

▶ Kubernetes ▶ Manual ▶ User Triggered

▶ Portworx ▶ A single multi cloud PX cluster ▶ Current Data, Seconds

▶ Replication Strategy ▶ Continual Synchronous Replication


Feature Details


Install Data Automation thru Kubernetes

Fingerprints, aggregates, tiers, and monitors storage media

(elastic)

Any Scheduler

Kubernetes

Mesos

Swarm

Integrates provisioning, control, and cluster scale (up to 1000’s of servers)

SSD

HDDEBS SAN

x86 x86 x86

AND ENABLES SELF-SERVICE IT FOR

STATEFUL CONTAINERS

Dynamically creates volumes with schedulers, resizes,

encrypts, and moves across clouds

STATEFUL + STATELESS

PORTWORX TAKES EXISTING

INFRASTRUCTURE

INTEGRATES WITH ANY

SCHEDULERS

SSD EBS SAN

VOLUMES


Data orchestration for K8’s

► Placement(ensures optimal compute scheduling with storage)

► Scalability(1000’s Nodes or $100,00+ volumes)

(dat

a pl

acem

ent,

rac

k in

fo, m

edia

hea

lth)

x86 x86 x86 x86


High Availability

FEATURES

► HA in seconds, cross-AZ

► Auto-backup, quick restore

► BYOK encryption …

BENEFITS

► Increase app density, lower TCO

► Reduce risk of data loss/leakage

► Flexibly resize compute/storage

► Faster app turnaround … x86 x86 x86 x86

Rack 1 / Availability Zone 1 Rack 2 / Availability Zone 2

Object Storage

CloudSnap Backup


Multi-Writer Availability

x86 x86 x86 x86

Object Storage

FEATURES

► Multi-writer storage volumes

► Microsvc app-consistency groups

► Storage-less servers support

BENEFITS

► Enables file workloads (applies to ML)

► Scale compute/storage independently

► Repack, migrate apps without DBAs


App Consistent Snapshot and Restore

CURRENT TIME

TIME - 1

ID1

ID2

ID1

ID2

CURRENT TIME

TIME - 1

Triggeredsnapshot

FEATURES

► Example 1

► Example 2

► Example 3

► Example 4

BENEFITS

► Example 1

► Example 2

► Example 3

► Example 4


SECURITY

Potworx offers RBAC + Quotas + BYOK Encryption

K8 RBAC + Quota Enforcement

Namespace A Namespace B

PVC1 PVC2 PVC3Quota DefinitionUser A: 2TBUser B: 1TB

Vol 1 Vol 2 Vol 3

KMS


and manages the full data lifecycle.

x86 x86 x86 x86

Object Store

BACKUP

RESTORE

► Synchronous & Asynchronous Replication – Protected

► Snapshots - Protected

► CloudSnap for Backup – Protected


Multi-Cloud Portability

x86 x86 x86 x86

ON-PREM DATACENTER

x86 x86 x86

PUBLIC CLOUD

AVOID VENDOR-LOCK-IN

► Monitoring trigger move

► Augment capacity to any datacenter


Non-disruptive Infrastructure Upgrades

x86 x86 x86

PortworxOperator

RESCHEDULE APP THEN UPGRADE PORTWORX

KEY IDEAS

► Portworx Upgrade in-place

► Speeds-up operations at scale


Monitoring Full Stack from Application down to Storage

Elasticsearchinstance 9

Cluster-wide view

Drill into offending volume


Learn more about how to run databases on RKE

MongoDB MySQL Postgres

https://portworx.com/run-ha-mongodb-rancher-kubernetes-engine/

https://portworx.com/run-ha-mysql-rancher-kubernetes-engine/

https://portworx.com/run-ha-postgresql-rancher-kubernetes-engine/

Documents

What you need to know to successfully run Kubernetes Master … Master Class Series/How to... · Containers are different than VMs DYNAMIC You’ve outsourced ops to K8s. Your pets