LESSONS LEARNT LESSONS LEARNT IN MY TEN YEARS OF AGILE TESTING IN MY TEN YEARS OF AGILE TESTING

Baiju Joseph

Director QE , Yahoo!

baiju@yahoo-inc.com

08 May 2012

AGENDAAGENDA

• Agile Testing

• One size Doesn’t fit all

• QE : Quality Enabler

• Play like a Team

• Continuous Deployment

• Value added automation

• Lightweight practices

• Continuous Learning

• Agile Testing in modern age

Disclaimer: The opinions expressed herein are my own personal opinions and do not represent my employer's view in anyway.

INTRODUCTIONINTRODUCTION

Baiju Joseph is working with the Yahoo! Search & Marketplaces team as Director – Quality Engineering. He has around 18+ years of IT experience. Baiju has delivered talks on Scrum, Agile testing, Test Automation etc… in conferences, universities and industry forums. He has published articles on Agile Testing in leading IT magazines. Prior to Yahoo!, Baiju has experience working with Ariba Inc QA, Novell Inc System test team and the Ministry of Information & Broadcasting. He has shipped major software titles at Yahoo!, Ariba and Novell in domains like Cloud , Mobile , Search , eCommerce, Directory Services etc…Baiju has experience in Agile methodologies (XP, Scrum), test automation, test management, and in setting up distributed Agile testing teams. He holds a B Tech in Electronics and Communication Engineering, Diploma in Management and an M.S. in Software Systems from BITS, Pilani.

Email : baijuglad@yahoo.com

“The job of tests, and

the people that develop and

AGILEAGILE TESTINGTESTING

the people that develop and run tests,

is to prevent defects,

not to find them”

Mary Poppendieck, Implementing Lean Software Development

NO SPECIALIST TESTER ROLE NO SPECIALIST TESTER ROLE …at some of our modern era companies.

"One of the things that annoys me is

PUSH QUALITY UPSTREAM MOVEMENTPUSH QUALITY UPSTREAM MOVEMENT

"One of the things that annoys me is

the whole “push quality upstream”

movement. That’s like taking all your

vitamins when you are a baby and

then expecting a long healthy life.

Obviously upfront debugging is good,

but quality is an ongoing endeavor. “

James Whittaker @ TestNewsOnline

LESSON 1 : ONE SIZE DOES NOT FIT ALLLESSON 1 : ONE SIZE DOES NOT FIT ALL

Mobile Internet

Enterprise Cloud

Mission Critical SaaS , PaaS

OS Storage

Individuals and interactions over processes and tools

Fine tune & iterate based on type of product , your team…

OS Storage

Networking Virtualization

LESSON 2 : QE :LESSON 2 : QE : QUALITY ENABLERQUALITY ENABLER

quality is everybody's responsibility

• Enable agile team to move fast to deliver good quality , high customer value code

• Help to prevent defects• Light weight Tools , Automation

frameworks for team• Story test automation

Lesson 3 : Play like a Team

LESSON 4 : CONTINUOUS DEPLOYMENTLESSON 4 : CONTINUOUS DEPLOYMENT

The key to fixing problems quickly is finding them quickly.

– (Fowler, 2006)

• Automation is not just a NUMBER in the coverage

L 5 : VALUE ADDED TEST AUTOMATIONL 5 : VALUE ADDED TEST AUTOMATION

• Automation is not just a NUMBER in the coverage dashboard (ex: Unit Test Code Coverage)

• Understand the “WHY” of doing automation

• Automate tests• Which add value• Help team to build

confidence in their code

LESSON 6 : LIGHT WEIGHT PRACTICESLESSON 6 : LIGHT WEIGHT PRACTICES

• Mind Maps for test case brainstorming• Orthogonal Array Test Strategy• Big visible charts …run scrum team like an

aquarium

LESSON 7 : CONTINUOUS LESSON 7 : CONTINUOUS LEARNINGLEARNING

It's ultimately an answer to the question

How can we learn more quickly what works, and discard what doesn't?

• Retrospective• A/B Testing aka

Bucket Testing• Root Cause Analysis• Continuous Integration

AGILE TESTING IN MODERN ERAAGILE TESTING IN MODERN ERA

quality is everybody's responsibility

• Polish tech stack knowledge (cloud , mobile etc…)

• Tool building skills • Fine tune our mindset