T17  DevOps  &  The  Cloud  2019-­‐05-­‐02  13:30              

A  Practical  Guide  to  Testing  in  DevOps    

Presented  by:      

Katrina  Clokie  Bank  of  New  Zealand  

‘      

Brought  to  you  by:        

   

   

888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.stareast.techwell.com/      

     

 

Katrina  Clokie    Katrina  Clokie  leads  a  team  of  around  a  hundred  testers  as  a  test  practice  manager  in  Wellington,  New  Zealand.  Katrina  is  an  active  contributor  to  the  international  testing  community  as  the  author  of  A  Practical  Guide  to  Testing  in  DevOps,  an  international  keynote  speaker,  a  cofounder  of  the  WeTest  New  Zealand  testing  community,  the  founder  of  Testing  Trapeze  magazine,  and  a  frequent  blogger  and  tweeter.  Her  complete  professional  profile  is  available  on  LinkedIn.  

16/03/2019

1

DEV OPSDEVOPS

DAN ASHBY

16/03/2019

2

DAN ASHBY

ONCE UPON A TIME

#1. GRID GROUP

JENKINS SLAVE

NODE SERVER - MOCK TEST DATA

WEB SERVER - APPLICATION UNDER TEST

SELENIUM WEBDRIVER TESTS

JENKINS SLAVE

NODE SERVER

WEB SERVER

WEBDRIVER TESTS

SELENIUM GRID

16/03/2019

3

REFACTOR SELENIUM WEBDRIVER TESTS

CHANGE JENKINS BUILD CONFIGURATION

PROVISION NEW VIRTUAL INFRASTRUCTURE via PUPPET

TEST SELENIUM GRID

IN THE BOOK

BLAZING A TRAIL

PLATFORM EVOLUTION

ENVIRONMENT MANAGEMENT

INFRASTRUCTURE TESTING

#2. CALL ME MAYBE

WORKFLOW

16/03/2019

4

WORKFLOW WORKFLOW

WORKFLOW A/B TESTING

16/03/2019

5

IN THE BOOK

A/B TESTING

BETA TESTING

MONITORING AS TESTING

EXPOSURE CONTROL

#3. THE PIPELINE THAT WASN’T

16/03/2019

6

HYPOTHESISWE BELIEVE THAT VISUALISING THE RELEASE BUS IN A WAY THAT SHOWS

STATUS OF THE CURRENT RELEASE

IS ESSENTIAL FOR OUR RELEASE MANAGEMENT AND DELIVERY TEAMS

ACTIVELY INVOLVED IN RELEASING TO PRODUCTION

THIS WILL ACHIEVE SHARED UNDERSTANDING OF RELEASE STATUS, CLARITY IN WHERE TIME IS SPENT IN THE RELEASE BUS, AND GIVE US THE ABILITY TO

IDENTIFY COMMON BLOCKERS

WE WILL HAVE DEMONSTRATED THIS WHEN WE HAVE USED A PIPELINE TOOL MORE THAN ONCE TO DRIVE AND MANAGE RELEASES

IN SCOPE

SHOW STEPS OF RELEASE

AUTOMATED & MANUAL STEPS

TIMING OF EACH STEP

TRENDS IN RELEASE BLOCKERS

AUDITABILITY

OPTION TO FALLBACK

OUT OF SCOPE

CUSTOM NOTES

FULL REPLACEMENT OF GOVERNANCE

FIXING ENVIRONMENTS DURING DEPLOY

PROJECT-SPECIFIC ENVIRONMENTS

ROLLBACK PIPELINE

IN THE BOOK

PIPELINES

FEATURE TOGGLES

BUG BASH

CROWDSOURCED TESTING

#4. BUTTERFLY BUGS

16/03/2019

7

16/03/2019

8

IN THE BOOK

RISK WORKSHOP

FINDING BALANCE IN EXPLORATION

TESTING VS TESTER

VISUAL TEST STRATEGY

AND THEY ALL LIVED

HAPPILY EVER AFTER

KATRINA CLOKIE

@katrina_tester

leanpub.com/testingindevops

katrina-clokie