Continuous Delivery - Any need for testers? - Scania Connected Services - Talentum Finland 2014

Preview:

DESCRIPTION

Presentation about testers in Continuous Delivery of software. By Anders Lundsgård and Peter Sandberg from Scania Connected Services. The presentation was held in Helsinki the 8th of October on Talentum Events 2014.

Citation preview

Continuous Delivery - Any need for testers?TESTING FORUM 2014

October 8 2014, Talentum Events, Helsinki Finland

?

Scania engineers

• Anders Lundsgård– 4 years as Consultant– 6 years at Scania

• Release Responsible• Integrator• Architect

• Peter Sandberg– 7 years at ABB & Ericsson– 3 years at Scania

• Test Leading• Test Automation• Scrum Master

Agile to us

theleanstartup.com

Why is it a competitive advantage to iterate fast?

Improve the ability to respond to changeKill bad idéas – FAST

It is fun!

Agile to us

Agile what?

Waterfall”Agile”

Continuous IntegrationContinuous Delivery

DevOps

Scrum equals Agile?

© Bestoutcome Ltd 2014

Scrum not always equals Agile

Project planning

Last mile

Agile what?

Waterfall”Agile”

Continuous IntegrationContinuous Delivery

DevOps

Agile teams within the Enterprise An Agile Enterprise

Continuous Delivery ReleaseQuality

Key concepts for Continuous Delivery

• Test Driven Development• Deployment Pipeline• Continuous Integration• Feature Toggles • Configuration Management• A/B tests• Always On

• Tear the walls

Cultural changes

Technical patterns

QAQuality Assurance

Unit Tests

Integration Tests

GUI Tests

Manual Regression

Test ice-cream cone

Quality AssuranceQuality Assistance

Test Pyramid

Unit Tests

Integration Tests

GUITests

Manual ”inspection”

Our test movement

Communication via error reports Communication face to face

Tests executed in desktop environment Tests into the Deployment Pipeline

GUI-oriented tests Tests towards service layer

Test specific dev environment Same dev environment as developers

Separated test teams Embedded testers

Requirements Usability

What gives quality?

I’m Done!We are Done, Done!

Deployment Pipeline

Commit Stage Acceptance Stage Load Stage Deploy Stage

Compile Unit Test Analysis Packaging Acc. Deploy

Acc. Tests Exploraty Tests

Load Tests

Perf Tests

Staging Deploy

Prod Deploy

.....

…..

Deployment Pipeline

Commit Stage Acceptance Stage Load Stage Deploy Stage

Compile Unit Test Analysis Packaging Acc. Deploy

Acc. Tests Exploraty Tests

Load Tests

Perf Tests

Staging Deploy

Prod Deploy

.....

…..

Claim culture

Continuous Integration

• Maintain a Single Source Repository• Automate the Build• Make Your Build Self-Testing• Everyone Commits To the Mainline Every Day• Every Commit Should Build the Mainline on an Integration

Machine• Keep the Build Fast• Test in a Clone of the Production Environment• Make it Easy for Anyone to Get the Latest Executable• Everyone can see what's happening• Automate Deployment

Configuration Management

Dev Ops

Config file here and there…

Click here and there …

First script #1 and then script

#2…

Failover this and that…

Register key here and there …

First alias #1 and then alias

#2…

Release plans

Single source of truthVCS

Feature Branch

Dev Branch #1

Main

Release Branch #1

Dev Branch #2

Feature Toggle

Main

GUI

Business Logic

Database

A/B tests

A/B tests

20%of users

Always On

We are down for maintenance

Our biggest obstacle

I want change!!

I want stability.

At the end of the day it is the person who writes the code who is

responsible for whether or not it works.

CodeTest

Design Deploy

Implemented CD i 2 months!

The Software Revolution Behind LinkedIn’s Gushing Profits

- We wanted to be at the point where… as soon as they were checking in their code… it was qualified and releasable…

- We were able to scale the team to hundreds of developers.

- It was a pretty big risk the business took, to say to its engineering team, you’re going to run across a bridge and burn it behind you.

2011

Kevin Scott

Google Trends

DevOps

Continuous Delivery

The Lean Startup

Continuous Integration

Automate – All The Things

Peters tests in CI environment

Any need for testers

No! (Not as a role but as a competence)

?

Resources

ISBN-13:978-0321601919

www.continuousdelivery.eu

Contact

• Peter Sandberg– peter.sandberg@scania.com – @patelikestotalk

• Anders Lundsgård– anders.lundsgard@scania.com– @anderslundsgard

Recommended