POSIX for the Datacenter

© 2016 Mesosphere, Inc. All Rights Reserved. 1

POSIX FOR THE DATACENTER


KARL ISENBERG

WHERE?- Mesosphere- Pivotal- Williams-Sonoma

WHAT?- DC/OS- Kubernetes- CloudFoundry- BOSH- Spring Ecommerce Platform

- github.com/karlkfi

- twitter.com/karlkfi

- linkedin.com/in/karlkfi

- karl.isenberg.us


INFRASTRUCTUREEVOLUTION



ONLINE

AWS Simple IconsBy Amazon Web Services, Inc., CC BY-SA 3.0

https://aws.amazon.com/architecture/icons/




ONLINELOAD BALANCED






ONLINELOAD BALANCED

DATA REPLICATION






ONLINELOAD BALANCED

DATA REPLICATIONMULTI-REGION

LATENCY ROUTEDAUTO-SCALEDMULTI-CLOUD

HYBRID CLOUD





INFRASTRUCTURE EVOLUTION

MAINFRAME PHYSICAL (x86) VIRTUAL HYPERSCALEMACHINE




CLOUD- Internet-connected datacenters- Shared systems management- On-demand resource allocation- Risk tolerance zones- Data collocation controls- Node-based cost controls

HYBRID/MULTI CLOUD- Internet-connected clouds- Federated systems management- On-demand load relocation- Increased risk tolerance- Data privacy controls- Cloud-based cost controls



ARCHITECTUREEVOLUTION


MAINFRAME PHYSICAL (x86) VIRTUAL HYPERSCALEMACHINE

hardware

LAYERS

?FUTURE TECH

CLI/GUI

MICROSERVICES

MOBILE

COMPONENTS

WEARABLE

APPS DEVICES

IOT

software

human

social

environmentARCHITECTURE EVOLUTION(Credit Mark Richards)


DATA PROCESSING AT HYPERSCALE

EVENTS

Continuous data streams from connected devices

INGEST

Apache Kafka

STORE

Apache Spark

ANALYZE

Apache Cassandra

ACT

Akka

Ingest millions of events per second

Distributed & highly scalable database

Real-time and batch process data

Visualize data and build data driven applications

Sensors

Devices

Clients


CONTAINER ORCHESTRATIONMarathon, Kubernetes, ECS

STREAMING DATA PIPELINESKafka, MapR, Spark, Flink

SELF-HEALING SYSTEMSApplication level, System level, Hardware level

FUNCTION AS A SERVICEAWS Lambda, Google Cloud Functions, Azure Functions, Iron.io, IBM OpenWhisk

CUSTOM SCHEDULERSCassandra, Kafka, Spark

DAY-TWO OPERATIONSRolling upgrades, Audits, Flow control, Permission Management, Chargeback

FUTURE TECH


FUTURE TECH PLATFORM

SERVICES, JOBS, FUNCTIONS, PIPELINES

PLATFORM

INFRASTRUCTUREPhysical and/or virtual machines, networks, and hardware

Distributed kernel, orchestration, and systems management

User tasks managed as higher order abstractions


CONTAINER PLATFORM LAYERS

© 2016 Mesosphere, Inc. All Rights Reserved.

Plat

form

Machine Machine Machine

Infrastructure

17

Services, Jobs, Functions, Pipelines

Container Orchestration

System Manager

Custom Schedulers, FaaS, PaaS

CONTAINERPLATFORM

System Agent System Agent

Container Runtime Container Runtime Container Runtime


Machine OS Machine OS Machine OS

Machine Machine Machine

18

User Services


System Manager

System Services

DATACENTEROPERATING SYSTEM



Data

cent

er O

S


DISTRIBUTED OPERATING SYSTEM- Custom microkernel- Distributed system management- Resource invisibility- Native workloads- Rewrite your applications- Custom programming language- UNIX-like, POSIX-like- Application self-healing

DATACENTER OPERATING SYSTEM- BYO container & machine OSs- Centralized system management- Resource transparency- Native & Containerized workloads- Containerize your applications- BYO Programming Language- POSIX machines- Application & system self-healing

DISAMBIGUATION



System Manager

System Services



Data

cent

er O

S

20

User ServicesDATACENTEROPERATING SYSTEMINTERFACE

Standard Client Library

System Call Interface

DOSI

X


FROM POSIXTO DOSIX

POSIX ® is a registered Trademark of The IEEE.


- Shells (scripting interface)- Tools (awk, echo, etc)- I/O (file, terminal, network)- Streams (stdout/stderr/stdin)- Pipes- Signals- Files & Directories- Errors & Exceptions

- System Call Interface- C standard library- Clocks & Timers- Scheduling (priority)- Shared memory- Message queues- Regex (BRE, ERE)- cgroups

PORTABLE OPERATING SYSTEM INTERFACE (POSIX)


GNU C LibraryBy Shmuel Csaba Otto Traian, CC BY-SA 3.0

https://commons.wikimedia.org/w/index.php?curid=31368855

https://commons.wikimedia.org/w/index.php?curid=31368855


- IEEE Std 1003.1-1988- IEEE Std 1003.1b-1993- IEEE Std 1003.1c-1995- IEEE Std 1003.2-1992- IEEE Std 1003.1-2001- IEEE Std 1003.1-2004- IEEE Std 1003.1-2008- IEEE Std 1003.1, 2013 Edition

POSIX EVOLUTION


STANDARDS

StandardsBy Randall Munroe, CC BY-NC 2.5

https://xkcd.com/927/



DESIGN BY COMMITTEE- Suboptimal traits- Political feasibility > technical quality

COMPROMISE- Literal bias- Conceptual inarticulation

INCREASED COMPETITION- Lower barrier to entry- Wasted effort

SCOPE CREEP- If you give a mouse a cookie- Lack of change control

PLURALISTIC IGNORANCE- Bystander apathy- Commitment ambiguity

BIG DESIGN UP FRONT- Agile conflict- Analysis paralysis

THE STANDARD DILEMMA


INTEROPERABILITY- Plug and play- Investment security

RELIABILITY- Testability- Maintainability

SAFETY- Level of rigor- Known failure modes

CUSTOMER SATISFACTION- Quality- Consumer choice

MARKET ACCESS- Uncultivated users/integrations- Certification

ECONOMIES OF SCALE- Lower production costs

INNOVATION ENGAGEMENT- Diversification- New layers

SHARED ADVOCACY- Bigger loudspeaker- Marketing boost

THE STANDARD RETURN


- ISO time and date format- ISO country codes- ANSI/ISO C++- IETF TCP/IP- IETF HTTP- W3C HTML 4, XHTML, HTML 5- JCP JDBC, JMS- IEEE VHDL- IEEE POSIX

THE STANDARD STANDARDS

ISO 8601By Randall Munroe, CC BY-NC 2.5




DATACENTER OPERATING SYSTEM ARCHITECTURES

KUBERNETES DOCKER DATACENTER DC/OS


KUBE

RNET

ES


KUBE

RNET

ES


DOCK

ER D

ATAC

ENTE

R


ENTE

RPRI

SE D

C/OS


ENTE

RPRI

SE D

C/OS


CLUSTER MANAGEMENTNodes, Components, Version, Capabilities, Namespaces, Admin Proxy

CONTAINER ORCHESTRATIONApps, Pods, Services, Jobs, Tasks

PACKAGE MANAGEMENTCreate/Delete, Install/Uninstall, Search/Filter, Templates, Deployment Groups, Dependencies

CUSTOM SCHEDULERSPlacement, Replication, Scaling, Resurrection, Rolling Updates, Daemons, Stateful, Stateless

IAM & SECURITYUsers, Groups, Permissions, Roles, Permission Sets, Hierarchy, Revocation, Access Requests, Image Signing

STORAGE & VOLUMESEphemeral Volume, Persistent Volume, Host Mount, Storage Classes, Volume Drivers

VIRTUAL NETWORKINGDNS, Overlay, Subnets, Isolation Groups, IP-per-task, VIPs

LOGGING & METRICSPush, Pull, Stream, Tail, Aggregation Pipelines

DOSIX API CONCEPTS



System Manager

System Services



Data

cent

er O

S

36

User ServicesUSEREXPERIENCE EVOLUTION



DOSI

X


USEREXPERIENCE EVOLUTION



DOSI

X


USEREXPERIENCE EVOLUTION



DOSI

X

Operators Developers


USER EXPERIENCE EVOLUTION

APIS CLIENT LIBS STDLIB SDK


HYPERSCALE API PROTOCOLS

REST GRPC GRAPHQL


WHERE ARE WE NOW?

OCI CNI CVI


Use an open platform

Do your due diligence

Expect interoperability

Contribute

Participate in standardization

WHAT CAN I DO?


KARL ISENBERGkarlkfi

Technology

POSIX for the Datacenter