View
1
Download
0
Category
Preview:
Citation preview
Australia New Zealand Testing Board www.anztb.org
ANZTB SIGIST
1
ANZTB SIGIST
Facilitator: Steve Toms
Date: 31st May 2011
Australia New Zealand Testing Board www.anztb.org
Programme
• Steve Toms – Welcome
• Steve Toms – ANZTB
• Adam Hughes – Experiences of Off Shoring
• Networking• Networking
• Elliot Ashton - The Performance Assurance Paradigm
Copyright © ANZTB2
Australia New Zealand Testing Board www.anztb.org
ANZTB Mission Statement
• The Australia and New Zealand Testing Board offers sought after certification, dependable training accreditation and career-enhancing support for software testing professionals throughout Australia and New Zealand.New Zealand.
• The ANZTB will exclusively adopt the qualifications devised by the ISTQB as its national qualifications.
• The ANZTB was admitted into ISTQB in September 2005.
Copyright © ANZTB3
Australia New Zealand Testing Board www.anztb.org
Our Team
1. David Hayman, Chairman – Auckland
2. Steve Toms, Vice Chair – Sydney
3. Chris Carter, Board Member - Sydney
4. David Fuller, Treasurer - Sydney
5. Josephine Crawford, Accreditation Chair – Sydney
6. Graeme Mackenzie, Examination Chair - Wellington
7. Ian Ross, Governance Officer – Christchurch
Board Members
Copyright © ANZTB4
7. Ian Ross, Governance Officer – Christchurch
8. Carol Cornelius, Exam Panel – Wellington
9. Thomas McCoy, Marketing Chair – Canberra
1. Aaron Smith – Sydney
2. Brett Rodgers – Hong Kong
3. Farid Vaswani – Auckland
4. Jules Robinson - Perth
5. Matt Mansell – Wellington
6. Nigel Saunders, Accreditation Panel – Auckland
7. Rob O’Connell, Exam Panel – Wellington
Associate Members
Australia New Zealand Testing Board www.anztb.org
ANZTB Responsibilities
ISTQBWorking Parties
Syllabi
Examination Questions
Copyright © ANZTB5
ANZTB
Accreditation
Panel
Examination
Panel
National
Boards
Australia New Zealand Testing Board www.anztb.org
Certified Testers in Australia & NZ
1000
1200
1400
1600
1800
Copyright © ANZTB6
n.b. ANZTB formed in 2006
0
200
400
600
800
1000
2004 2005 2006 2007 2008 2009 2010 2011
Advanced
Foundation
ISEB
Australia New Zealand Testing Board www.anztb.org
ANZTB Conference
Copyright © ANZTB7
Australia New Zealand Testing Board www.anztb.org
ANZTB Conference
• Whole Day Tutorials
• Lee Copeland
• Part 1: Pair-Wise Testing Explained
• Part 2: Pragmatic Testing: What to Do When Your World Is Messy
• Isabel Evans
Copyright © ANZTB8
• Going Green to Make it Better: A Tool Kit for Defining and Delivering Quality
• Leanne Howard
• Agile Methods Workshop
• International Key-note speakers
• Isabel Evans (UK)
• Lee Copeland (USA)
• Julie Gardiner (UK)
• Shane Parkinson (AUS)
Australia New Zealand Testing Board www.anztb.org
ANZTB Conference
• Variety of other speakers and topics included:
• Automated Web Service
• Becoming a Great Tester
• Top Challenges in Testing
• Testing Trends & Innovations
• Psychology of Testing
• Testing as a Service
Copyright © ANZTB9
• Bridging the Gap & Security Testing
• http://anztb.org/downloads.php
• Something new this year was the Geeks Corner and the Lightening Key Note session.
• Next Year
• Wellington hosts the ISTQB General Meeting in March 2012
Australia New Zealand Testing Board www.anztb.org
Guest Presentation
10
Guest PresentationExperiences in Test Offshoring
By: Adam Hughes
Australia New Zealand Testing Board www.anztb.org
Introduction
Get your own House in order first 60 mins
The Wonderful World of Offshoring 20 mins
Offshoring starts at Home 30 mins• Go to Tender
• Conduct a Testability Review
• You are Testers....Test
Copyright © ANZTB11
• You are Testers....Test
• Moving towards Offshore
Don’t make a decision based on Cost 45 mins• But, you still need Funding
• Set Up Costs
• Ongoing Costs
We’re Offshoring....now what? 20 mins
Summary 10 mins
Questions 20 mins
Australia New Zealand Testing Board www.anztb.org
Get your own House in order first
Have a bedded in...
Copyright © ANZTB12
Australia New Zealand Testing Board www.anztb.org
The Wonderful World of Offshoring
China
- Emerging
Copyright © ANZTB13
Vietnam
- EmergingPhilippines
- Established
India
- Market
Leader
Australia New Zealand Testing Board www.anztb.org
Offshoring starts at Home
• Have a plan, with models for now, short-term, and long-term
• Are you looking at engaging an Offshore Partner, or do you
Copyright © ANZTB14
Offshore Partner, or do you have an Offshore Office?
• What is the right mix of permanents -v- Onsite Contractors -v- Offshore for your Organisation?
Australia New Zealand Testing Board www.anztb.org
Go to Tender
• What are your
Requirements?
• Get a BA to write your
Requirements down for you
Copyright © ANZTB15
• Do you have a Vendor
Management Team to
review your Requirements?
• Get Legal to review your
Requirements / Tender
document
Australia New Zealand Testing Board www.anztb.org
Conduct a Testability Review
• Did the Response meet Requirements?
• Can you compare apples with apples?
• Is everything in the Response clear?
• Do you need to go back for clarifications?
Copyright © ANZTB16
• Do you need to go back for clarifications?
• Do any of the responses change your
Requirements?
• Most Offshore labs were set up to comply with
S-Ox, but consider IT security.
• Read the RFT responses very carefully.
Australia New Zealand Testing Board www.anztb.org
You are Testers.....Test
Compare the Tender Responses:
• against the criteria
• against each other
Get Vendor Management and Legal to review the
Copyright © ANZTB17
Get Vendor Management and Legal to review the
Tender Responses
Undertake risk-based analysis against the
Responses:
• Use a Decision Tool such as a Kepnor Tregoe
Matrix
Australia New Zealand Testing Board www.anztb.org
Kepnor Tregoe-style sample
Copyright © ANZTB18
Australia New Zealand Testing Board www.anztb.org
Moving towards Offshore
• Get objective evidence
• Take into account the “A Team” factor
• Measure Performance
• Take care with your Contracts
Copyright © ANZTB19
• Take care with your Contracts
• Consider the additional costs associated with
setting up a Nearshore site
• How long do you need
Nearshore?
Australia New Zealand Testing Board www.anztb.org
Don’t make a decision based on cost
• Make a decision based primarily on:
• Quality of work
• Quality of communication
• Timeliness of delivery
• Reflect on which defects you have the most success getting
Copyright © ANZTB20
• Reflect on which defects you have the most success getting fixed? The ones where you have the best relationships.
• In Offshoring, the relationship is everything
• If your screw your Partner down on cost they are going to give you their cheapest personnel
• Hire using the same principles as you do for onsite permanents
Australia New Zealand Testing Board www.anztb.org
But, you still need Funding
• Cost / Benefit analysis
• Being aware of the tangible Benefits is a pretty straight-forward calculation
• ...but you must also be aware of all of the sometimes hidden Costs
Copyright © ANZTB21
hidden Costs
You will be required to
demonstrate Breakeven to
your Senior Management.
Australia New Zealand Testing Board www.anztb.org
Set Up Costs
Copyright © ANZTB22
The trademarked tools in the Table are
examples only. There are competitors for all of them. The costs in this Table are
illustrative only, rates will vary based on
where your Offshore facilities are established, and may vary for your
Organisation.
Australia New Zealand Testing Board www.anztb.org
Ongoing Annual Costs
Copyright © ANZTB23
The costs are again illustrative only, and
may vary based on your specific
circumstances.
Australia New Zealand Testing Board www.anztb.org
We’re Offshoring...now what?
Copyright © ANZTB24
Australia New Zealand Testing Board www.anztb.org
Summary
• Every problem is magnified by every kilometre you
are separated by. Get your house in order first.
• If you do it right, you are going to save a lot of
money, so don’t make a decision based on cost.
Copyright © ANZTB25
• Do the due diligence, or in Tester-speak:
• Get “Specifications”
• Conduct a Testability Review
• Carry out the Risk-based analysis
• Get objective evidence
• Slow and steady wins the Offshore race
Australia New Zealand Testing Board www.anztb.org
Questions
Copyright © ANZTB26
Australia New Zealand Testing Board www.anztb.org
Copyright © ANZTB27
Australia New Zealand Testing Board www.anztb.org
Networking & Refreshments
28
Networking & Refreshments
Australia New Zealand Testing Board www.anztb.org
Guest PresentationThe Performance
Assurance Paradigm
29
Assurance Paradigm
Clouding the Issue
By: Elliot Ashton
Australia New Zealand Testing Board www.anztb.org
What is “The Cloud”?
Gartner said this was the most strategic
technology of 2010.
Comes in 3 flavours:Comes in 3 flavours:
� on-demand applications (software-as-a-service);
� clouds as a platform (platform as a service); and
� clouds as a source of computing infrastructure
(Infrastructure-as-a-service).
Australia New Zealand Testing Board www.anztb.org
Cloud complexity
Public Cloud
Application
Application
Application
Private Cloud
Database
Application
ApplicationApplication
Australia New Zealand Testing Board www.anztb.org
Performance Assurance
Performance Testing
Infrastructure Monitoring
Capacity Planning
Real User Monitoring
Capacity Planning
Active Monitoring
Business Process Monitoring
Australia New Zealand Testing Board www.anztb.org
Putting it together
It's no longer a case of performance testing
We need to really understand the services
that the Business is providing and build that the Business is providing and build
processes that provide visibility into these
services.
We need to provide a single view
Australia New Zealand Testing Board www.anztb.org
Q + AQ + A
Australia New Zealand Testing Board www.anztb.org
ANZTB SIGIST
The ANZTB are committed to investing in the Australian and New Zealand Testing Community and developing a professional networking forum to represent the interest of software testers throughout our region.
Copyright © ANZTB35
Our first SIGIST started in Melbourne in February 2008, followed shortly by Sydney. SIGISTs are now being run in most major cities in Australia and New Zealand.
SIGISTs are sponsored by us and are in no way linked to any particular training provider or third party.
Australia New Zealand Testing Board www.anztb.org
Specialist Interest Groups
• Contractor / Recruiter / Client relationship
• Requirements engineering – improving quality
• Offshore management - incl. different time zones
• Defect management process
• Cloud Computing - testers role
Copyright © ANZTB36
• Cloud Computing - testers role
• Multi-vendor Management
• Tools advantages and disadvantages
• Risk based testing
• Environments
• How does the Tester fit within Agile
• Test Estimation
Australia New Zealand Testing Board www.anztb.org
Future SIGISTs
• Volunteers for facilitation of the next SIGIST?
• Volunteers to submit white papers for presentation and discussion?
Copyright © ANZTB37
The SIGIST cannot succeed without your input.
Next Meeting: Last Tuesday in the month, every 3rd
month – 30th August
Australia New Zealand Testing Board www.anztb.org
Enhancing Career Opportunities for Testing Professionals
Thank you for being involved.
www.anztb.org
Copyright © ANZTB38
www.anztb.org
Recommended