DEV2133BU Designing an Application-Centric or distribution€¦ · Designing an Application-Centric...

Preview:

Citation preview

Michael Gasch – Application Platform ArchitectMartijn Baecke – Cloud Evangelist & Strategist

DEV2133BU

#VMworld #DEV2133BU

Designing an Application-Centric Infrastructure Platform: Experience from the Field

VMworld 2017 Content: Not fo

r publication or distri

bution

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Designing an Application-Centric Infrastructure Platform:

Experience from the Field

3#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

4#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

5#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

6#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

7#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

8#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

9#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.

10#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

“It is not the strongest of the species that survive, nor the most intelligent, but the one most responsive to change”

Charles Darwin

11#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Not Too Long Ago Life Was Easy…

12

Apps!

Access to

virtual machine

for coding!

Users Developers

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Digital Transformation Changes IT Demands…

13

Apps!

Access to

virtual machine

for coding!

Users Developers

Apps! Apps! More

Apps! Apps!

New features!

Apps! NOW!

APIs! DevOps!

Containers!

Control the

infrastructure!

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

DevOps

Digital Transformation

14

Business Applications Infrastructure

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

15

Business Applications Infrastructure

Build New Functionality

Deploy New Functionality

Monitor Applications

Provide Feedback /

Input

New App / Features

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Disruptor

Innovators

Followers

Do nothing

Diamond of Innovation

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Digital Business Driving Software Development

Source: Gartner

75%of application development

supporting digital business will

be built not bought by 2020

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Developers’ Pyramid of Needs

Performance

Scalability

Availability

Security

Manageability

Functional Differentiation What the Developer cares about

What should be provided as a service

18#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

DevOps From an Infrastructure Perspective

19

APP

APP

Developer Code Repository

CI/CD

Which infrastructure to use?

How tomanage

this?

DevOps in a nutshell

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

20

Rethink OperationsRethink Infrastructure

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Rethink Infrastructure

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

``

DeveloperMindset

22

DevOps Ready Application Centric Platform #DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Programmable

Self-Service

On-Demand#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Virtualize

Automate, like crazy!#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

CONFIDENTIAL25

Infrastructure as Code

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

OOTBDIY

Unstructured

Components

approach

maximizes

flexibility, but at

cost of integrating

and maintaining

platform

infrastructure.

Structured

Packaged product

for deployment of

Cloud Native apps.

Simplifies

experience for both

Developers and

Operations.

Best Practice : How to Build a Platform

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Rethink Infrastructure

Mission

Critical Apps

Virtual

Desktops

Data Analytics/

Hadoop

Traditional

Apps

Container

AppsIoT

Private cloud Public cloud

Cross

Cloud ServicesvRealize

Container Services

VMware SDDC

vSANvSphere NSX

Application Platform

VMworld 2017 Content: Not fo

r publication or distri

bution

Rethink Operations

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

A Typical Discussion in the Enterprise Today

29#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Operations Also Needs To Evolve

30

Developers

Platform Engineers

IT Operations

Serv

ices

Co

ns

um

es

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Developers’ Pyramid of Needs

Performance

Scalability

Availability

Security

Manageability

Functional Differentiation What the Developer cares about

What should be provided as a service

31

RESPONSIBILITY OF PLATFORM

ENGINEERING

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Platform Engineering (PE) Responsibilities

32

Application Platform(e.g. Kubernetes, Pivotal Cloud Foundry)

Service 1

Service 2

Service "n"

Service 1

Service 2

Service "n"

Service

Boundary

Service

Boundary

CI/CD Tooling & Processes

Resiliency

Resource Optimization

Communication

Observability

Enterprise Developers

Security

State Management

App Runtime

Platform Management

VMware Software-Defined Data Center (SDDC)

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Learn From The Disruptors

34#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Disruptor

Innovators

Followers

Do nothing

Learn From The Disruptors

1%

99%“The Rest”

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Rethink Operations

36#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Tales from

the Field

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

From vSphere Operations to Platform Engineering

38

Developers

Platform Engineers

IT Operations

Se

rvic

es

Co

ns

um

es

vSphere Operators are best positioned to become Platform Engineers.

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Platform Engineering Responsibilities

39

VMworld 2017 Content: Not fo

r publication or distri

bution

Some Background on the following Examples

• Developers could tackle all Platform Engineering Responsibilities in each Service

– Analogy: Microsoft Exchange DAGs or SQL Server Always-on Group

– Downside: Complexity and Sprawl

• Alternative: let the Platform handle non-functional Service Requirements

– Analogy: vSphere HA

– Advantage: Common Knowledge and Methodology (Standardization)

• Examples show various Platform Engineering Approaches and simple but powerful Patterns

40#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Example #1 – Health Checks & Rolling Updates

42

Distributed Application Runtime (Kubernetes)

Instance

(Container)

v1.0

Client

Requests

Loadbalancer (VIP)

Instance

(Container)

v1.0

Instance

(Container)

v1.0

myA

pp

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

http Endpoints: /prestop & /ready

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Example #2 – Logging and the Non-12-Factor App

43

Pod (Single Container)

web

/var/vendor/ABC

/custom.log

Console

~# kubectl logs <ID>

~# <empty_reply>

std

out

Pod (with Sidecar)

web

/var/vendor/ABC

/custom.log

tailf

<stdout>

Console

~# kubectl logs <ID>

~# <log_reply>

std

out

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Example #3 – App Auto-Scaling

44

Client

Requests

Loadbalancer (VIP)

Distributed Application Runtime (Kubernetes)

Worker

Message Queue

Worker Worker WorkerWorker Worker Worker

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Example #3 – App Auto-Scaling

45

Client

Requests

Loadbalancer (VIP)

Distributed Application Runtime (Kubernetes)

Worker

Message Queue

Worker Worker WorkerWorker Worker WorkerAuto-

Scaler

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Example #3 – App Auto-Scaling Integration in vRealize LogInsight (vRLI)

• Uses vRLI REST API

• Auto-Scaler (“Custom Controller”) emits Events from Kubernetes to vRLI API

• Note: not a supported Integration by VMware today (Proof of Technology)

46

LogInsight Custom DashboardRabbitMQ UI

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

Wrapping Up

VMworld 2017 Content: Not fo

r publication or distri

bution

49#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

50

The vSphere Operator of Today, is the Platform Engineer of Tomorrow!

#DEV2133BU CONFIDENTIAL

VMworld 2017 Content: Not fo

r publication or distri

bution

VMworld 2017 Content: Not fo

r publication or distri

bution

VMworld 2017 Content: Not fo

r publication or distri

bution

Further Resources

• VMware Cloud-Native Applications

• Site Reliability Engineering (Free Google eBook)

• Dockerfile Best Practices

• Kubernetes Pod (Container) Mechanics for Application Integration (ff.)

• Pid 1, Zombie Processes and handling graceful Shutdowns/ SIGs

• The 8 Fallacies of Distributed Computing – Explained

• The Datacenter as a Computer

• Github Repo (Sources & READMEs)

53

VMworld 2017 Content: Not fo

r publication or distri

bution

Recommended