34
Presenters: Gan Boon Leong • Larica Bawar • Miki Soo • Rizwanur Rashid Testing Recipe The iconnect360 Way

#speakgeek - Testing Recipe: The iconnect360 Way

Embed Size (px)

Citation preview

Page 1: #speakgeek - Testing Recipe: The iconnect360 Way

Presenters: Gan Boon Leong • Larica Bawar • Miki Soo • Rizwanur Rashid

Testing RecipeThe iconnect360 Way

Page 2: #speakgeek - Testing Recipe: The iconnect360 Way

SETs Team

Wan Yee LaricaRizwan

Chitrini

Daniel

Linda

Jin Rou

MikiGAN

Page 3: #speakgeek - Testing Recipe: The iconnect360 Way

AgendaSETs - EvolutionTest Process – The Ingredients!

Test PlanningTest DesignTest ExecutionTest Closure

Automation FrameworkQ & A

Page 4: #speakgeek - Testing Recipe: The iconnect360 Way

SETs Evolution2015

2014Defined processFormed test automation team

2013

2012No ProcessSharepoint for defects.

Page 5: #speakgeek - Testing Recipe: The iconnect360 Way

Test Process

Planning

Design

Execution

Closure

Page 6: #speakgeek - Testing Recipe: The iconnect360 Way

Planning

Page 7: #speakgeek - Testing Recipe: The iconnect360 Way

Planning

Identify Activities

Plan Resources & Scheduling

Identify Exit Criteria

Page 8: #speakgeek - Testing Recipe: The iconnect360 Way

Risk Analysis

Failure Probability Business Impact

$$$

Failure Probability

Usage Frequency

Page 9: #speakgeek - Testing Recipe: The iconnect360 Way

Taiga

Taiga

Monitor Issues

Monitor Daily Tasks Track User Stories

PrototypesConvert Tasks to Cards

Page 10: #speakgeek - Testing Recipe: The iconnect360 Way

Design

Page 11: #speakgeek - Testing Recipe: The iconnect360 Way

Design Activities

Requirements Analysis

Knowledge Sharing

Prepare Test Cases

Review/Revise Test Cases

Prepare Regression Test Plan

Prepare Test Data & Environment

Page 12: #speakgeek - Testing Recipe: The iconnect360 Way

Regression Test PlanMust Test

Could be tested

Test if time permits

Not possible to test everything!

Page 13: #speakgeek - Testing Recipe: The iconnect360 Way

Plan for Test Resource

Manage Test Build Manage Test Case

Manage Test Plan

TestLink

Page 14: #speakgeek - Testing Recipe: The iconnect360 Way

Test Data Preparation

Manual Approach Generatedata.com Migration Tool SETs Developed Tools

Page 15: #speakgeek - Testing Recipe: The iconnect360 Way

Test Execution

Page 16: #speakgeek - Testing Recipe: The iconnect360 Way
Page 17: #speakgeek - Testing Recipe: The iconnect360 Way

Test Execution FlowTest Case Execution

Report & Re-test Defects

Regression Testing(Manual &

Automated)

Smoke Testing

Page 18: #speakgeek - Testing Recipe: The iconnect360 Way

Test Types

Unit Testing

Who: Developers

Where:Local PC, QAAlpha

Why: To make sure individual components

are working

Feature Testing

Who: Testers

Where: QABeta

Why: To make sure new features are working as

intended

Regression Testing

Who:Testers

Where:QABeta,

Pre-production

Why: To make sure existing features are still

working

Smoke Testing

Who: Testers

Where: Cold Server, Production

Why: To make sure core functionalities are

working

Page 19: #speakgeek - Testing Recipe: The iconnect360 Way

Monitor Test Progress

Execute Test Cases

TestLink - Execution

Page 20: #speakgeek - Testing Recipe: The iconnect360 Way

Defect Life Cycle

NewIn

Progress Dev

In Progress SETs

ResolvedKIV

Page 21: #speakgeek - Testing Recipe: The iconnect360 Way

Test Closure

Page 22: #speakgeek - Testing Recipe: The iconnect360 Way

Test Closure Activities

Release Readiness

Prepare Release Readiness DocumentHold Release Readiness Meeting

Release Day

Smoke Testing (Production, Sales, Demo)Release (Go Live)

Post Release

Release RetrospectiveBugzilla Defect Metrics

Page 23: #speakgeek - Testing Recipe: The iconnect360 Way

Bugzilla Defect Metrics

Page 24: #speakgeek - Testing Recipe: The iconnect360 Way

Automation

Page 25: #speakgeek - Testing Recipe: The iconnect360 Way

Test Automation Process

Page 26: #speakgeek - Testing Recipe: The iconnect360 Way

Test Automation - FrameworkCustom Build Framework

Telerik Testing

FrameworkC#.NET Silverlight

Automation

Selenium Java HTML Automation

Page 27: #speakgeek - Testing Recipe: The iconnect360 Way

Custom Automation Framework - Reasons

More controlFreedom for end to end

process

Custom Logger

Less Maintenance

Effort

Less learning curve

Page 28: #speakgeek - Testing Recipe: The iconnect360 Way

Thinking About LayersTests

Custom Framework

Automation Framework (Selenium/Telerik Testing Framework)

Browser (Web App)

Each layer only interacts with the layer immediately

below it

Page 29: #speakgeek - Testing Recipe: The iconnect360 Way

Thinking About Layers (Cont.)Tests

Framework

Selenium

Browser (Web App)

Page Tests

Data Layer

Logger

Page Repositories

Entities

UI Object Repositories

Testlink Updater

Helper Factory

The framework itself is divided into layers of functionality

Page 30: #speakgeek - Testing Recipe: The iconnect360 Way

The Page Objects Model

Test

LoginPage::Code- login()- ResetPassword()ToggleRememberMe()

LoginPage::Browser

Selenium org.openqa.selenium.support.PageFactory

.NET – Custom design

Pages are good way to model the functionality of an application

Page 31: #speakgeek - Testing Recipe: The iconnect360 Way

Execution Flow

Loop for configured countries

Begin test

CSV data

IsRun =

true?

Test initialization

Test execution (Page > UI repo)

HTML logger::Write detail log with screenshot

Update Testlink (pass/fail result)

HTML logger::Write summary

log

End execution

Is last row?

Yes

Yes

No

No, proceed to next row

Page 32: #speakgeek - Testing Recipe: The iconnect360 Way

End to End Demo of

Silverlight Automation

Page 33: #speakgeek - Testing Recipe: The iconnect360 Way

Question & Answer

Page 34: #speakgeek - Testing Recipe: The iconnect360 Way

THANK YOU!