Testing Traps to Avoid in Agile Testing - EuroSTAR Conference · The 5 Traps .. again Testing Traps...

Testing Traps to Avoid in Agile Testing

Janet GregoryWith material by Lisa Crispin

Dublin, 2014

Agile Testing; 2009

More Agile Testing: Oct 2014

Website:

www.agiletester.com www.agiletester.ca

DragonFire Inc.

www.janetgregory.ca

@janetgregoryca

janet@agiletester.ca

The Format

• Clues to identify 5 traps

• The associated risks

• Tips & techniques for avoidance

Testing Traps to Avoid on Agile Teams – Janet Gregory

The Traps

1. Waiting for Tuesday’s build

2. Testers aren’t “really” part of the team

3. Maintaining a “Quality Police” mindset

4. Trying to test everything manually

5. Forgetting the big picture

#1 – Waiting for Tuesday’s Build

• Testing tasks are stacking up ‘to do’

• Stories cannot be marked DONE

• Testing is done the next iteration

• Deployments aren’t tested regularly

The Risk: The Mini-Waterfall (ketchup effect)

More Risks

• Stories aren’t tested completely

• Testers lose credibility

• Technical debt increases

• Team changes meaning of ‘DONE’

Tip – Make CI Mandatory

• Understand your CI (continuous integration) tool

• Know your build pipeline

• Plan for your test infrastructure

Tip - Collaborate

• Include testing tasks in the velocity

• Get your developers used to immediate feedback

• Test where it makes sense

Instead of saying NO,

or being the gatekeeper

Be the information provider so business can make the decisions

Questions… about waiting …

#2 – Testers Aren’t ‘Really’ Part of the Team

Testers don’t actively

participate

• Testing isn’t included in team velocity

• Testers test ‘only’ what the developers code

• Testers don’t understand the stories

The Risks

• Wrong assumptions are made

• Impacts to the system are found late

• Everyone’s skills are not utilized

• The team becomes divided

Tips for Early Tester Involvement

More Tips to Avoid Team Division

• Help customers develop stories

Or Better Yet ….

Questions about whole team?

#3 – Maintaining a Quality Police Mindset

• All bugs are entered into the DTS (Defect Tracking System)

• Testers are part of a separate test team

• The test team sits apart

• The test team can stop production

The Risks

• Project team doesn’t buy the ‘build quality in’ concept

• Communication is through the defect tracking system

• Developers use testers as a safety net

• The team never ‘gels’

Tips to Change the “QP” Mindset

• Define DONE to include testing

• Use a consulting mindset;

− share testing expertise

• Become more technically aware

• Have all members pick up testing tasks

• Develop relationships with programmers

20Testing Traps to Avoid on Agile Teams – Janet Gregory

Can you change your mindset?

Think◦What can we do to help deliver

the software successfully?

Instead of◦We’re here to break the software!

Questions… Agile Tester’s Mindset?

#4 – Trying to Test Everything Manually

• Making excuses to miss meetings

• Regression suite not run regularly

• Spending time retesting features already tested

• Not testing new features

• Not contributing to implementation / design discussions

The Risks

• Testing cannot keep up with new stories

• Features that used to work, are broken and not noticed

• Testers don’t learn new technology

• Testers get stuck in a rut

Techniques to Increase Automation

• Automate as you go

• Include automation time in your estimates

• Design for testability

• Chose tools that encourage collaboration

• Understand the power & risks of automation

Tip: Make the Automation Maintainable

• Tests pass all the time

• Don’t Repeat Yourself (DRY)

• Tests reveal intent – create good names

• Keep tests small with a clear purpose

• Manage your tests – be able to find them

**Automation does not exclude the need for exploratory testing*

Questions… Automation?

• Testing only individual stories

• Finding integration bugs late

• Testing is based on what developers code

• Testing finds requirements type bugs

• Developers add extra code after they are finished

#5 – Forgetting the Big Picture

We only see the tip of the IcebergWe don’t think of big systemsWe only looking at our own team.

The Risks

More Risks

• Workflow isn’t smooth

• Decisions made during coding aren’t aligned with the end goal

Tips to Avoid Missing the Goal

• Understand the story before coding starts

• Think system impacts

• Draw pictures / workflows

• Test data to reflect real world◦ Use examples ◦ Exploratory test

Think – Levels of Detail

Acceptance Test Driven Development

Agile Testing Quadrants (Brian Marick)

Think Feature Complete

• Define “Feature (or epic) DONE”

– Acceptance tests for bigger picture

– GUI automation on workflow

– Quadrant 3 & 4 tests (from agile testing quadrants)

• Define “story DONE”

– API level automation by story

– Quadrant 1, 2, 3 tests (maybe some Q4)

Questions… Remembering the Big Pic?

The 5 Traps .. again

1. Waiting for Tuesday’s build− Not keeping up with developers

2. Testers aren’t really part of the team− No input into requirements

3. Quality police mindset− Ignoring the whole team approach

4. Trying to test everything manually− Not taking advantage of automation

5. Forgetting the big picture− Not delivering the right thing

Testing in agile projects is full of traps

• Be aware, and watch for them, but don’t let them scare you

• Problems happen faster so impact is felt faster

• Make them visible so you can learn

• Be courageous – be a change agent

Mostly, have fun and enjoy the

challenge!

Agile Testing: A Practical Guide for Testers and Agile Teams

By Lisa Crispin and Janet Gregory

More Agile Testing: Learning Journeys for the Whole TeamBy Janet Gregory and Lisa Crispin

www.agiletester.ca www.agiletester.com

Contact info

www.janetgregory.ca

Email: janet@agiletester.ca

Twitter: janetgregoryca

• www.lisacrispin.com

• Elisabeth Hendrickson, Explore It, 2013

• Gojko Adzic, Specification by Example, 2011, Bridging the Communication Gap, 2009

• http://www.exampler.com - Brian Marick’s web site

• Ester Derby and Dianne Larsen, Agile Retrospectives

• Agile Manifesto: http://agilemanifesto.org/

• Mary Poppendieck and Tom Poppendieck, Lean Software Development, Addison-Wesley (series of 3)

• agile-testing@yahoogroups.com

• Photos – Janet’s vacations or Microsoft office

Testing Traps to Avoid in Agile Testing - EuroSTAR Conference · The 5 Traps .. again Testing Traps...

Documents

Avoid traps, pitfalls, and learn what professional Real ...cdn1.media.zp-cdn.com/68638/LAB-COAT-AGENT-PUBLICATION-8ed… · Avoid traps, pitfalls, and learn what professional Real

Focus on Fair Lending… Tips to Avoid the Traps!

TRAPS TO AVOID WHEN SELLING YOUR HOME...TRAPS TO AVOID WHEN SELLING YOUR HOME W hen considering the sale of your home, there are several traps, or pit falls to be aware of. In many

Karl Wiegers -- Software Requirements -- 10 Traps to Avoid

Testing traps to control lovely but destructive lionfish

The Top Ten Malpractice Traps and How to Avoid Them

How to Avoid Traps and Fallacies: The Multilevel Issue in ... · How to Avoid Traps and Fallacies: The Multilevel Issue in b Educational Researc Hans Oosthoek and ... In research

Bear Traps: Can Russia Avoid the Pitfalls on the Road to …crifes.psu.edu/papers/bearcrifes.pdf · 2014-04-10 · Bear Traps: Can Russia Avoid the Pitfalls on the Road to Sustainable

6 Traps to Avoid When Choosing a Digital Press€¦ · It’s easy to fall in love with the wrong press. 6 TRAPS TO AVOID WHEN CHOOSING A DIGITAL PRESS WE’VE ALL BEEN THERE BEFORE:

10 common compliance traps and how to avoid them final kk

Review Barriers - Traps to Avoid

Spam Traps: Avoid the Blacklist and Protect Your Digital Reputation

Avoid the Worst Thinking Traps - CRC Press Online€¦ · Avoid the Worst Thinking Traps Engineering should be about doing things right. A system such as a bridge, ... elementary

2 Traps To Avoid In Car Rental

10 Common Compliance Traps and How To Avoid Them

Steam Traps - Armstrong Flowarmstrongflow.com.au/.../uploads/2017/04/Section-1-Steam-Traps.pdf · Installation and Testing of Armstrong Steam Traps CG-47 Steam Traps SECTION 1. S

The Worst Weight Loss Traps To Avoid

Beware of telemarketing 12 common traps to avoid

DevOps day 10 traps to avoid

Small Business Opportunities in a Down Market : How to Avoid 7 Common Traps !