27
Copyright © 2015 Splun Inc. Digital Transformation: The role of machine data in DevOps: Increase velocity, improve quality and drive impact

Computing DevOps Summit, London, July 5, 2016

Embed Size (px)

Citation preview

Page 1: Computing DevOps Summit, London, July 5, 2016

Copyright © 2015 Splunk Inc.

Digital Transformation: The role of machine data in DevOps:Increase velocity, improve quality and drive impact

Page 2: Computing DevOps Summit, London, July 5, 2016

COBOLPL/1

AssemblerFORTRANJava

JavaScript

I wrote them all badly – which may be why I’m now in marketing…

A disclaimer…

Page 3: Computing DevOps Summit, London, July 5, 2016

DevOps Workflow Is Complex

3

Build(Jenkins, Bamboo)

Code(Git,

MS-TFS)

Plan(JIRA, Rally)

Test/QA(Cucumber, SonarQube)

Stage(Pivotal,

AWS)

Release(Jenkins, Octopus)

Datacenter

Device Data

Engagement Data

Config(Puppet, Ansible)

Monitor(New Relic, Dynatrace)

Cloud Services Network Services

www/HTTPData

Social Sentiment

Wire Data

Application Data

Continuous Integration (CI)/Continuous Delivery (CD)

Site Reliability Engineering

Business Impact Monitoring

API ServicesSecurity/Compliance

Page 4: Computing DevOps Summit, London, July 5, 2016

Risk of Failures Increased

Slower Speed

Longer MTTR

Lower Quality

Reduced Agility

Poor Visibility

Impaired Collaboration

Page 5: Computing DevOps Summit, London, July 5, 2016

CAMS - The Core Value of DevOps?

Culture

Automation

Measurement

Sharing

What do we

measure?

Page 6: Computing DevOps Summit, London, July 5, 2016

Some DevOps Metrics that Might Matter

Culture

• Retention• Satisfaction• Callouts

Process

• Idea-to-cash• MTTR• Deliver time

Quality

• Tests passed• Tests failed• Best/worst

Systems

• Throughput• Uptime• Build times

Activity

• Commits• Tests run• Releases

Impact

• Signups• Checkouts• Revenue

Page 7: Computing DevOps Summit, London, July 5, 2016

From every tool, every process, every component, on-prem or off

Machine Data Is A Critical Source Of DevOps Metrics

Page 8: Computing DevOps Summit, London, July 5, 2016

Machine data gives us the feedback loop & metrics across

DevOps

Page 9: Computing DevOps Summit, London, July 5, 2016

Code Repository

Automation Systems

Application Monitoring

CI/Build Servers

Project & Issue Tracking

Dev/Test/Staging Servers InfrastructureCloud

..

9

Explore Visualize Customize ShareAnalyze

Data Driven DevOps

Page 10: Computing DevOps Summit, London, July 5, 2016

VERTU – DIGITAL TRANSFORMATIONROB CHARLTON – CLOUD DEVOPS ARCHITECT

Page 11: Computing DevOps Summit, London, July 5, 2016

AGENDA

• About Vertu• Presenters’ background•Digital Transformation: Cloud, DevOps & Data• Summary of key messages• Contact details

Page 12: Computing DevOps Summit, London, July 5, 2016

ABOUT VERTU CORPORATIONBritish manufacturer and retailer of handmade luxury phones

Page 13: Computing DevOps Summit, London, July 5, 2016

ABOUT VERTU CORPORATIONBuilt by a single craftsman

Page 14: Computing DevOps Summit, London, July 5, 2016

ABOUT VERTU CORPORATION

Exclusive services

Page 15: Computing DevOps Summit, London, July 5, 2016

VERTU TIMELINE

1998 2002

Signature –First phone

Foundedby Nokia

2010

FirstSmartphone

2012

PrivateEquity

2013

Vertu Ti (Android)

2014

Vertu Aster

2015

SignatureTouch

PrivateOwner

2016

Page 16: Computing DevOps Summit, London, July 5, 2016

YOUR PRESENTERS

• Rob Charlton• A Cloud DevOps Architect currently managing an Amazon Cloud based

consumer services platform for Vertu using leading edge technology. Prior to this he founded and worked for a series of startups as CTO and Chief Architect.

Page 17: Computing DevOps Summit, London, July 5, 2016

OVERVIEW: VERTU’S DIGITAL TRANSFORMATION

Cloud On-premises & managed IT

Ops culture

Data and IoT

On the path to DevOpsNo Ops function

Page 18: Computing DevOps Summit, London, July 5, 2016

TRANSFORMATION: CLOUDBack in 2011 we worked with multiple managed

service providers in multiple data centres.

We started the process of automation early though, adopting Puppet even at

this stage.

2011 2012

In 2012 we consolidated and

migrated everything to a single VMware

private cloud. We used automation and built

tools to ensure customers didn’t even

notice.2015

import botoec2 = boto.connect_ec2() reservation = ec2.run_instances( image_id='ami-bb709dd2', key_name='ec2-sample-key')

In 2015 we completed a full migration from VMware to Amazon

Web Services – using EC2, VPC, RDS, ELB

and allowing us access to all their

features from Python!

Page 19: Computing DevOps Summit, London, July 5, 2016

TRANSFORMATION: CULTURE & DEVOPSWe’re climbing up the pyramid:IaaS

Amazon!

RepeatabilityAnsible!

ToolingJenkins, Packer, Consul.io

The Pinnacle?http://wp.me/

p6k7pa-l

Page 20: Computing DevOps Summit, London, July 5, 2016

TRANSFORMATION: DATA & IOT - CHALLENGE

How to become more data led when productizing a phone?Hundreds of mobile devices under test with individualsWho has tested what, for how long?How many phone / modem / system crashes?Can we launch?

Page 21: Computing DevOps Summit, London, July 5, 2016

HOW TO MAKE AN ANDROID MOBILE PHONE

Drivers

Qualcomm provide a layer of drivers to work with their

hardware.Power Management, Camera, Modem, Security, Sensors etc.Linux

The Linux layer consists of the kernel as well as boot code“Android” - AOSP

Google’s Android actually only makes up this part – the

“Android Open Source Project” and “Google Mobile Services”

Apps

Vertu adds its own Apps, to support the services which

come with our phones. Other Apps from the play store form

this layer too.System

Integration

Partner

As with most Android phone manufacturers, we use a

System Integration Partner to help us make all these layers

of software work optimally together. This involves tuning

settings, making custom changes and applying thousands of patches.

Tackling quality issues in this layer is well supported and

understood. Splunk’s MINT can help here!

App providers will fix their own apps.

This is where the big challenge lies! There is a lot of software

here, with many parties working on it. If it goes wrong it means your phone resets, runs out of battery, misses

calls, takes fuzzy photos etc.The phone can reset silently

too!

Page 22: Computing DevOps Summit, London, July 5, 2016

TRANSFORMATION: DATA & IOT – OUR SOLUTION

Metrics collation agent

During the productization phase,

we run an agent on our phones to collect metrics: uptime,

crashes, battery stats and other product health information

The phones regularly upload metrics to a web service running in our

Amazon cloud

A Splunk Forwarder feeds the data into our

Splunk Enterprise

clusterSplunk will send out email alerts to our crash analysis team whenever

a phone reset is detected

The project management team will use Splunk dashboards to assess the state of

the software

Page 23: Computing DevOps Summit, London, July 5, 2016

CRASH ALERT!

Cause of the crash

Which tester has the phone

When the crash

happened

What phone software version

Page 24: Computing DevOps Summit, London, July 5, 2016

SUMMARY

• Vertu has undergone a Digital Transformation on 3 fronts• Cloud – from physical to virtual to cloud, without any customer noticing• DevOps – from zero to DevOps focussing on automation with Ansible• Data – taking a data-driven approach to product quality with Splunk

• The future• Serverless & NoOps -> AWS Lambda and API Gateway• Splunk latest features, Splunk Cloud?

• If you are interested in finding out more, please get in touch!

Page 26: Computing DevOps Summit, London, July 5, 2016

INCREASE APP DELIVERY VELOCITY

IMPROVE CODE

QUALITY

INCREASE BUSINESS

IMPACT

Data Driven DevOps

26

Page 27: Computing DevOps Summit, London, July 5, 2016

FreeCloud Trial

Free SoftwareDownload

FreeEnterprise Security

IT Service IntelligenceSandbox

Easy to Try & Get Started

1 32