Alex Schwartz
How to Brew a Tasty Agile Test Strategy?
Agile Development/Testing andBrewing/Kitchen Analogies
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Nice Cookbooks
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
In our agile pantry..
contains many...
•books• ingredients• tools•cookbooks•restaurants• styles
www.flickr.com/photos/52192754@N00/220946716/
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Why Cooking/Brewing Analogy?
•Examples can help
•Analogies from a different (known) context can help
• It’s fun
Sonntag, 10. Oktober 2010 KW
Alex Schwartz www.flickr.com/photos/28549294@N05/4273275734
Analogy #1: The Definition of Done (DoD) in a Kitchen
Assume a professional cook in a restaurant kitchen is asked to create a nice meal for a customer.
When it’s DONE?
NO
Sonntag, 10. Oktober 2010 KW
Alex Schwartz http://www.flickr.com/photos/28549294@N05/4273275734/sizes/l/in/photostream/
Analogy #1: The Definition of Done (DoD) in a Kitchen
Assume a professional cook in a restaurant kitchen is asked to create a nice meal for a customer.
When it’s DONE?
YES
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
What we find in a cookbook
• Ingredients
• Techniques
• Tools
• Mindset
• Skills
• Recipes
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
What we find in a cookbook
• Ingredients
• Techniques
• Tools
• Mindset
• Skills
• Recipes
This talk....
(META-)Recipes to create a Test Strategy
Spikes into details
recipe recipe
with some e
xamples
from our
kitchen
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
La Cuisine• mobile.de - e-Commerce, selling vehicles
• belongs to eBay Classifieds Group
• Marketplaces France, Italy, Poland and Romania
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Our Agile Transition
•first Scrum pilot project 3.5 years ago
•3 years Scrum with multiple teams
- 70+ people
- 6+ teams, 2 distributed teams
- parallel development on same product
•1.5 million LoC
•1 year Kanban for maintenance
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Votré chef de cusine
• programming background (20 years)
• Agile from 2004, Scrum Master
• my current role:
Team Lead “Engineering Support Group”
supporting agile project teams with...
- Release Management- Test Automation- Build Management- Tools- Configuration Management
holis
tic
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
What I mean by “Agile Test Strategy”?
•What to test? What not to test?
•Which kinds of tests?
- Test categories / taxonomy
- Tools
•When to test (what)?
•How to introduce/improve?
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
The Recipe
•Which kind of restaurant?
•Get to know your craft
•Try to use ... adapt & learn
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Step 1: What kind of restaurant?
- Who are your clients? - Your style?- Competitors, market?- Your team
Quality is a business requirement
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Step 2: Get to know your craft...
• Ingredients
•Tools
•Techniques
•Principles
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Principle: Visibility
www.flickr.com/photos/shannonsturgis/4274202367Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Principle: Care about your tools
Sharpen your knifes.
www.flickr.com/photos/st3f4n/3641653927
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Principle: Care about your tools
Sharpen your knifes.
www.flickr.com/photos/st3f4n/3641653927
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Principle: Whole team approach
•... not very kitchen-like?
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Question: Use instant ingredients or not?
www.flickr.com/photos/vegetarian/2292620706
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Example from our kitchen: Principles
•Early feedback
•From risk to test strategy
• Test as low as possible
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Recipe: From Risk to Test
Criteria
• Incident prio
• Change frequency
• Bug density
• Overhead for manual tests
• Complexity of requirements
• Maintenance overhead for automated tests
• Known domain
Test Automation ROI Radar Chart
Incident prioWhat is the prio of a
possible incident?
Bug densityHow many bugs in the past?
Overhead of manual test
Maintenance overhead for
automated tests
Change frequencyHow many changes in the
future?
high
often
high
ComplexityHow complicated is the
feature?
high
low
high
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Source: Lisa Crispin & Janet GregoryAgile Testing: A Practical Guide for Testers and Agile Teams
.
Ingedients - Test Categorization / TaxonomyOverhead / Complexity
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Source: Lisa Crispin & Janet GregoryAgile Testing: A Practical Guide for Testers and Agile Teams
.
Ingedients - Test Categorization / Taxonomy
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Recipe: The “Tetris Principle” - Test as low as possible
Story: As a customer I can contact the seller of an interesting ad.
Risk/aspect 1Mail is not sentdue to config
problems
Risk/aspectLayout of mail
is crap
Risk/aspect:Wrong maillanguage
Risk/aspect:Javascript problem
in contact form
no automated tests
automated tests
Story Test / UI(Integration)
Manual tests
Story testbelow UI
Story Test / UI(Browser)
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Analogy #2: QA or When do you flip a pancake?
thecleancoder.blogspot.com/2010/08/ qa-or-when-do-you-flip-pancake.html
Robert “Uncle Bob” Martin
www.flickr.com/photos/mrlerone/106039369/
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Test Automation
Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Goal: A happy kitchen crew
www.flickr.com/photos/fractalv/1341923133Sonntag, 10. Oktober 2010 KW
Alex Schwartz
Thanks for your attention.
Sonntag, 10. Oktober 2010 KW