31
6 Myths of Software Testing www.osmanit.co m

6 myths of Software Testing (As I have seen during my testing journey)

Embed Size (px)

DESCRIPTION

This is a talk I gave at a TPN (Test Professionals Network) group in Wellington, New Zealand in December 2012. These 6 myths are six of many that surround Software Testing (and in particular what I have found here in Wellington, New Zealand) particularly the myth that Test Leadership is dead! This is completely untrue - New Zealand abounds with some really good, thinking leaders!

Citation preview

Page 1: 6 myths of Software Testing (As I have seen during my testing journey)

6 Myths of Software Testingwww.osmanit.com

Page 2: 6 myths of Software Testing (As I have seen during my testing journey)

Whom am I?

Tester Software testing trainer See…

www.osmanit.com Conference speaker – StarWest 2012 Mostly, its been about helping others …

Page 4: 6 myths of Software Testing (As I have seen during my testing journey)
Page 5: 6 myths of Software Testing (As I have seen during my testing journey)

OZWST

TPNHello Test World

Articles and Interviews

Conferences

WeTest Workshops

Mentoring

Page 6: 6 myths of Software Testing (As I have seen during my testing journey)

Leadership

Leadership has been described as “a process of social influence in which one person can enlist the aid and support of others in the accomplishment of a common task".

Chemers M. (1997) An integrative theory of leadership. Lawrence Erlbaum Associates, Publishers. ISBN 978-0-8058-2679-1

Page 7: 6 myths of Software Testing (As I have seen during my testing journey)

A true leader has the confidence to

stand alone,

the courage to make tough decisions

and the compassion to listen to the needs of others.

They do not set out to be a leader, but becomes

one by the equality of his

actions and the integrity of his intent.

General Douglas MacArthur

Page 8: 6 myths of Software Testing (As I have seen during my testing journey)

Myth One

The force is strong

Page 9: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Two: Being certified = skilled

Page 10: 6 myths of Software Testing (As I have seen during my testing journey)

Here is an example…

Page 11: 6 myths of Software Testing (As I have seen during my testing journey)

From one of the originators…“Foundation level is based more on

learning facts than on practicing the craft. Why is that? Because the current scheme was designed to meet a different need, a basic ignorance about testing in general; it was not designed to assess testing skill.”

Dorothy Graham – One of the original *creators* of the ISEB Software Testing certification 1997

Page 12: 6 myths of Software Testing (As I have seen during my testing journey)

Compared to…Barclays GTC

Attract They raised the hiring (and existing employee) bar and transferred

quality ownership to the team. They made sure that GTC was viewed as a “Top Project”, very hard to get in (in analogy with Google).

Develop Keith invited James Bach to come and teach his Rapid Software

Testing course and regularly provide consulting as well. On top of that, they improved business and testing skills. After a while, people started developing their own training courses, around ten in total. These were staff-led without any steering from management. They also started a new test management mentoring programme.

Retain They flattened out the career framework, until it contained only four

levels. They developed Induction Programmes, in which they told people what was expected from them. In addition, Keith told them what was to be expected from him.

Page 13: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Two

It is your skill that determines your worth

Page 14: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Three: Testing approaches are mutually

exclusive

Page 15: 6 myths of Software Testing (As I have seen during my testing journey)

Reply from an agent…

"I know that you prefer exploratory testing but we do risk based testing and exploratory won't work here“

What is wrong with this statement?

Page 16: 6 myths of Software Testing (As I have seen during my testing journey)

Reply from an expert

“That sentence about risk-based testing doesn't even make sense.

Brian, you need to raise your profile. If they don't see you as an expert, they yatter idiotic things at you.”

James Bach – May 2012

Page 17: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Three

Recognising that different approaches can work well together

Page 18: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Four: Testing is…

Page 19: 6 myths of Software Testing (As I have seen during my testing journey)

Experience Report…

PM to Me (TM): “We need to get more resources or we may struggle.”

Me(TM) to PM: “Bringing more testers on at this late stage may not help make the project finish on time. For a start…”

PM to Me (TM): “That’s all right, I’ll get some students from Student Job Search for $10 an hour.”

Page 20: 6 myths of Software Testing (As I have seen during my testing journey)

TEST this…

Page 21: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Four

Good testing is a sapient, technical, empirical set of skills

Page 22: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Five: No Spec means No test

Page 23: 6 myths of Software Testing (As I have seen during my testing journey)

Testers have told me…

“No spec means no testing!”

What is WRONG with this?

Page 24: 6 myths of Software Testing (As I have seen during my testing journey)

If you have no spec how do you test?

Heuristics e.g. SFDPOT

Page 25: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Five

Good testing can be done even without a spec

Page 26: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Six: Test cases should be written before testing

begins

Page 27: 6 myths of Software Testing (As I have seen during my testing journey)

Why?

Page 28: 6 myths of Software Testing (As I have seen during my testing journey)

7 Propositions

1) At the beginning of a project we know least about the project2) Good testing requires sapience3) Skilled exploratory testers perform hundreds of what could be considered discrete tests in a session. Few are worth repeating.4) Most tests performed are informed by the results of the previous test.5) The usefulness of a test is often not known until it has been performed. You don’t know if a rock is worth lifting until you’ve lifted it to see what’s underneath.6) Testers, when following a script, will deviate from the script.7) Different testers interpret scripted instructions differently resulting in differences between testers even when following the same script.

Aaron Hodder – www.helloTestworld.com

Page 29: 6 myths of Software Testing (As I have seen during my testing journey)

Quote…

“Good auditors don’t need to see documented test cases. They need to see evidence of testing that was appropriate in the circumstances.”

James Christie – Software Test Consultant and Auditor

http://clarotesting.wordpress.com/2011/04/12/when-documentation-is-a-waste-of-time/

Page 30: 6 myths of Software Testing (As I have seen during my testing journey)

Myth Six

Test Cases do not always need to be written in advance

Page 31: 6 myths of Software Testing (As I have seen during my testing journey)

Summary

Myth One: Test leadership is dead Myth Two: Being certified = skilled! Myth Three: Testing approaches are

mutually exclusive Myth Four: Testing is easy Myth Five: No spec means no testing Myth Six: Test cases should be written in

advance