Software, Agility, Mission and Survival - James Watters

A NEW PLATFORM FOR A NEW ERA

2 Pivotal Confidential–Internal Use Only  

Software, Agility, Mission and Survival Powered By Pivotal Cloud Foundry

James Watters VP, Cloud Foundry

Software is the Weapon of Disruptors

So$ware  is  Changing  Industries  

$6B  valua8on  Financial  Services    

$12B  valua8on  Travel  &  Hospitality    

$19B  valua8on    Transporta4on  

$3.2B  Acquisi8on  by  Google  Home  Automa4on  

$28B  valua8on    Entertainment    

$32B  Evalua8on    Automo4ve  

Traditional IT is Being Disrupted

Process Revolution Is Coming to IT

Colonel  John  Richard  Boyd  

hHp://en.wikipedia.org/wiki/John_Boyd_(military_strategist)  

Boyd's  key  concept  was  that  of  the  decision  cycle  or  OODA  loop,  the  process  by  which  an  en8ty  (either  an  individual  or  an  organiza8on)  reacts  to  an  event.  According  to  this  idea,  the  key  to  victory  is  to  be  able  to  create  situa8ons  wherein  one  can  make  appropriate  decisions  more  quickly  than  one's  opponent.  

OODA loop

Time  is  the  dominant  parameter.    The  pilot  who  goes  through  the  OODA  cycle  in  the  shortest  8me  prevails  because  his  opponent  is  caught  responding  to  situa8ons  that  have  already  changed.  

-­‐-­‐  John  Boyd  

Agile Matters in Security Too

Inability to Rapidly Adapt is A Security Problem

“The  people  with  knowledge  of  the  inves8ga8on  said  it  would  take  months  for  the  bank  to  swap  out  its  programs  and  applica4ons  and  renego8ate  licensing  deals  with  its  technology  suppliers,  possibly  giving  the  hackers  8me  to  mine  the  bank’s  systems  for  unpatched,  or  undiscovered,  vulnerabili8es  that  would  allow  them  re-­‐entry  into  JPMorgan’s  systems.”  

Innovation takes more than just using AWS

Netflix Admires Boyd & PaaS

“PaaS  brings  down  the  4me  it  takes  to  put  in  and  assess  new  features  to  just  days”  

Netflix Cloud Evolution: First Step IaaS

Netflix Cloud Evolution: Next Step PaaS

Jonathan Rosenberg CTO & VP, Collaboration

“PaaS  is  the  opera4ng  system  for  the  cloud.  As  the  set  of  APIs  and  services  for  PaaS's  grow,  the  choice  of  PaaS  becomes  more  crucial  as  the  costs  of  por8ng  go  up.  This  is  one  of  the  benefits  of  open  source  PaaS  offerings  like  Cloud  Foundry.”  

Industry Voting: ‘Cloud Foundry’ is the standard

in PaaS

Cloud  Foundry  Founda8on:  Industry  Standard  

Pla8num  $500k  /  year  

Gold  $100k  /  year  

Silver  $5-­‐30K  /  year  

DataStax  Fidelity  Mongo  

Piston  Cloud  CloudCredo  BlueBox  Docker  

Stark  &  Wayne  Anynines  AppDirect  

AppDynamics  CloudFlare  

 •  GE  Predix  plagorm  powered  by  Cloud  

Foundry  and  Pivotal  Hadoop  •  41  diverse  applica8ons  from  across  GE  

divisions  targeted  for  2014  produc8on  deployment  

•  Bringing  the  disrup8ve  “Nest”  paHern  to  every  GE  industrial  division  with  Cloud  Foundry  

GE Invests $105M Into Pivotal Platform

10x+  Increase  in  Speed  and  Agility  Old  World:  

App  Deployment  in  Days/Hours  Pivotal  Cloud  Foundry  

App  Deployment  in  Minutes/Seconds  

IT  configures  complex  

middleware  

App  deployment  waits  for  8+  manual  steps  

Target  <my  cloud>  

Push  <my  app>  

1-­‐Click  to  Scale  

PaaS is Crucial for Mobile

�  Mobile has resulted in exponential workload increases and highly dynamic loads

�  User expectation is no downtime for upgrades / maintenance

�  Mobile device / OS speed iteration is faster than ever before

Client  /  Server  OS    5  year  cycle  

Mainframe  OS  10+  year  cycle  

Mobile  OS    1  year  cycle  

Language,  Service  and  IaaS  Agnos8c  

…  

…  

…  

Technology Demo: Cloud Foundry ‘Diego’

�  Deploy Application files, or Docker images: <20 seconds

�  Scale 300x: <40 seconds

�  Recovery from 20% hardware loss: <5 seconds

�  Requests dropped during recovery: 0

�  Core scheduling, routing, log aggregation, health management Go code: <45MB!

Is Your Organization Ready for the Change?

Rapid Innovation Requires a New Approach

�  Dramatically improve developer experience

�  Agile teams, rapid iteration �  Ingest and incubate open source

advancements and new data services

�  Continuous delivery, no planned downtime

�  Instant scaling of apps and data services

�  Automation and deployment consistency at every step

DEVELOPERS   OPERATORS  

From Data Center to Software Factory

Pivotal CF: Containers surrounded with services

Application Containerization & Cluster Scheduling

Native and Extended Data

Services

Automatic App Server & OS Configuration with

Buildpacks

Policy, Identity and Roles Management

App Health Management, Load Balancing, Rapid Scaling, Availability Zones

IaaS Provisioning, Scaling & Configuration

Application Network

Security Groups

Application to Services Binding and

Access

Logging as a service, Application metrics & performance, Metric based scaling

A Multi-Cloud 3rd Platform: Pivotal CF

Elas8c  Run8me  

Agile    Microservices  

Elas8c  Hadoop  

Jenkins Service

(CI)

Google  

Redis

PCF Operations Manager (CF-BOSH)

KV

Store

VMware   EC2    OpenStack  

Multi-Cloud Declarative Service Deployment, Operations

Elastic managed runtime service integrated into leading data services; all scaled and managed by CF BOSH

Rabbit  MQ  

4 Levels of High Availability

1.  Application Failure = Reboot in new container

2.  PaaS Process Failure = Reboot component in new VM

3.  Operating System Failure = VM Monitor

4.  Rack Failure = Availability Zones

Application patterns are changing

Reference Customers: Spoke at #CFSummit

 •  GE  Predix  plagorm  powered  by  Cloud  

Foundry  and  Pivotal  Hadoop  •  41  diverse  applica8ons  from  across  GE  

divisions  targeted  for  2014  produc8on  deployment  

•  Bringing  the  disrup8ve  “Nest”  paHern  to  every  GE  industrial  division  with  Cloud  Foundry  

GE Invests $105M Into Pivotal Platform

Savings From IAAS and PCF

PAAS  DEV   PAAS  OPS  IAAS  

How to Get There With IAAS + PAAS

PAAS  DEV   PAAS  OPS  IAAS  

�  Better SLAs �  Flexibility �  Speed

�  Availability

�  Faster Time To Market �  Mobile + Data Services �  Agile and Iterative

�  Leverage OSS

�  Continuous Delivery �  No Downtime �  Instant scaling

�  Consistency & Automation

Cloud Foundry: Ideal Federal OSS Community

�  Multiple commercial vendors –  Pivotal, IBM, HP, many set-aside partners

�  Multiple form factors –  Public multitenant cloud –  Community (government-only) clouds –  Hosted private PaaS –  On-premise managed services –  Software-only licensing

�  Simple engagement model for existing partners

PaaS Is Just Getting Started

Failure without Consequence

Adapting the “Fail Fast” millennium mindset to agency realities

�  Keep it portable (by using an IaaS-agnostic platform)

�  Gold-plate the sandbox (use the same tools for dev & prod)

�  Trust, but verify (comprehensive monitoring and logging)

Resolving an impossible tension

Security  •  APT  reali8es  •  SSP  expenses  •  Legacy  obliga8ons  

Agility  •  Go  fast  •  Be  transparent  •  Provide  APIs  

Unified Functionality Possibilities…..

�  Deployment risk reduction

�  Application health management

�  Extreme auditability and analytics

�  Globally distributed clouds, CF Everywhere

Cloud Foundry: Ideal Federal OSS Community

�  Multiple commercial vendors –  Pivotal, IBM, HP, many set-aside partners

�  Multiple form factors –  Public multitenant cloud –  Community (government-only) clouds –  Hosted private PaaS –  On-premise managed services –  Software-only licensing

�  Extreme productivity, mission and service centric