16
CONTINUOUS DELIVERY IN THE ENTERPRISE LEVERAGING DOCKER Henk Kolk, Chief Architect ING Domestic Bank, The Netherlands DockerCon, December 3 rd 2014

Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

Embed Size (px)

DESCRIPTION

Docker doesn't only revolutionize your application hosting, it also revolutionizes your development pipeline. ING has over 250DevOps teams, thousands of applications and a complex application landscape. ING is simplifying its application landscape in record time while introducing a webscale architecture based on anti-fragility patterns. Speed is vital in this transformation and one of ING’s key assets is it Continuous Delivery Pipeline. In this talk, we will show how ING uses test containers for confidence checks, integration testing on up and downstream services, creating dev/test environments for every feature branch, reverse proxy and CI servers. As a result, we are able to automate test processes and reduce our integration testing costs.

Citation preview

Page 1: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

CONTINUOUS DELIVERY IN THE

ENTERPRISE LEVERAGING DOCKER

Henk Kolk, Chief Architect ING Domestic Bank, The NetherlandsDockerCon, December 3rd 2014

Page 2: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

1

Software

Eating the Worldis

http://online.wsj.com/articles/SB10001424053111903480904576512250915629460

Page 3: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

2

Speed

Market Shareis

http://www.slideshare.net/adriancockcroft/monktoberfest-fast-delivery

Page 4: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

3

Technology companies use military strategies like the “OODA

loop” to move with speed and agility

Observe

Orient

Decide

Act

http://www.fastcompany.com/44983/strategy-fighter-pilot

Page 5: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

4

Landgrab opportunity = Friction for customers

Enterprises need to remove friction from their product

development process leveraging OODA

Strategic Capabilities

- Feedback loop based on data

- Microservices platform for agility

- Continuous Delivery Pipeline for speed and resilience

Technology companies focus on “removing friction” for customers

in industries they attack

Page 6: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

5

Legacy Complexity

- Formal Systems & Skills

- Legacy Way of Working, complicated processes

- IT Landscape, both infra systems and software systems

Legacy belief systems (culture)

• From “IT is a cost center” to “IT is the value driver”

• From “IT enables the business” to “IT drives the business”

• From “procuring Engineering Services for the lowest price” to “hiring the best

talent”

• From “package before build” to “building is the only way to understand software”

The challenge for existing enterprises is to radically reduce legacy

complexity, and radically changing legacy belief systems

Page 7: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

INGs agile journey so far has been based on 4 ideas

6

Continuous delivery in all our teams

Nothing beats engineering talent

Partners are welcome, outsourcing is not

We distinguish by building great software

Page 8: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

7

ING has been re-organizing for agility at scale on many levels

Start of our own Java community

Engineering culture

May 2010 Google IO

Full reorganization i.e. 180 full DevOps teams

Engineers hunger to take responsibility

May 2013

Oct 2009

New IT Mgt team

The will to change

Nov 2011

Discussion – who runs production.

Clear demarcation responsibilities infra and appl

Sep 2014

Need full automation infra & scalable systems

Build private cloud

Start full automation of IT processes

Continuous delivery pipeline – Jez Humble

May 2011

Oct 2010

Start of Mobile app development

1st Scrum team and start agile development

Page 9: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

8

ING is pursuing speed, and the global continuous delivery pipeline

is one of four pillars to accelerate

8

Embedded practices AgileDevOpsOpen Source

Constantly improving• Data Platform, enabling BusDevOps• API Platform, enabling micro services• Private Cloud Platform, enabling auto provisioning and rapid deployment• One Continuous Delivery Pipeline, reducing cycle time

Page 10: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

9

Big

• Hadoop

• DWH - RDBMS

Fast

• Akka

• Scala

• Spray

• Spark

• Cassandra

Our data platform is enabling BusDevOps, based on data and

direct customer feedback

akkaHadoop

Cassandra

Spray

Millions of customers Billions of messages

• Distributed computing and storage

• Open Source based

• Near Realtime + Big Data

Page 11: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

10

Our API Platform removes the friction for product teams to create

and maintain micro services

• API Trust; secure access of APIs

• Service Discovery; dynamic discovery

• API Directory; single source API definitions

• Content Portal; info about APIs

• LLDS; a distributed low latency data store

• Toolkit; a toolkit for building APIs

All components will evolve independently but will stay aligned on their interfaces

Page 12: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

11

Our Continuous Delivery pipelines will now be harmonzid by

platform team while remaining open to distributed innovations

code build test deploy operatedefine code build test deploy operatedefine code build testdeploy operatedefine

CD Pipeline Team X

administration

Private cloud

CD administration for a team

Development and Operations

Collaboration across teams

Reporting within and over teams

Providing input to a team

1 2 3 4 5

Page 13: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

12

Build servers

Every build is isolated in its own container

Testing

Provision clean system test subjects

Testing

Publish test process as a container

Deployment automation

Deploy to private cloud in containers

Functional integration testing

Across potentially 180 teams by being able to spin up an integrated T

environment

To make the CD Pipeline even faster, we are introducing Docker in

specific CD stages

Page 14: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

• <build server provisioning and execution with Docker>

• <running tests from Docker>

2 Docker movies

13• Kudos Adriaan Gollings and Wouter Danes

Page 15: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

14

• Software is eating the world & the future is really bright for programmers

• Existing enterprises need to radically shift gears and change their belief system

• Speed is market share and Continuous Delivery is one of the pillars of speed

• Docker is one of the Open Source technologies that help speed up the Continuous

Delivery Pipeline

Summary

Page 16: Revamping Development and Testing Using Docker – Transforming Enterprise IT by Henk Kolk (ING Bank)

15

Questions and answers

[email protected]

We are hiring!