22
Test Automation Approach

Test Automation - Keytorc Approach

Embed Size (px)

DESCRIPTION

Test Automation Test automation is the use of test automation software like Selenium or self-developed testware to execute test cases. Test automation is mostly used to automate repetitive testing tasks in a formalized way. It is also used to execute tests that would be difficult to perform manually like performance testing. There are many advantages of test automation that are mostly related to the repeatability of the tests and the speed of test execution. There are a lot of commercial and open source tools available which can be grouped into two main categories; Code-Driven and Graphical User Interface Testing. Thus the key success factor in test automation is selecting the right tool and have a specialized test automation team. It is to use test automation tools by considering ROI (return on investment). Otherwise it is quite easy to waste big amount of energy, commitment and definitely money. With more than 500 clients, Keytorc is the leading software testing company in EMEA region that have competencies of automating any kind of software in diverse industries. For more information about test automation tools and Keytorc’s test automation service you can contact with our performance test engineers: www.keytorc.com or blogs.keytorc.com Test Otomasyonu: Test otomasyonu özellikle tekrarlayan ve manuel olarak yapılması zor olan testlerin Selenium gibi test otomasyon araçları kullanılarak ya da özel olarak geliştirilen test otomasyon scriptleri ile yapılmasıdır. Bu bakımdan: - Regresyon testleri - Performans testleri - Yük ve Stres testleri - Test yönetimi test otomasyonuna en uygun test tipleri ve aktiviteleridir. Test otomasyonunun en büyük faydaları: - testlerin hıznının artırılması - testlerin kapsamının artırılması - testlerin doğruluğunun artırılması - testlerin raporlama kalitesinin artırılmasıdır. Test otomasyonu doğru araç seçimi yapılmaması, ya da test otomasyonunu bilen uzman bir ekip tarafından yapılmaması durumunda faydadan çok zarar getirmektedir. EMEA bölgesindeki lider yazılım test firması olan Keytorc’un test otomasyon ekibiyle iletişime geçmek için: www.keytorc.com ya da blogs.keytorc.com

Citation preview

Page 1: Test Automation - Keytorc Approach

Test Automation Approach

Page 2: Test Automation - Keytorc Approach

Definitions for Test Automation

In software testing, test automation is the use ofspecial software (separate from the software beingtested) to control the execution of tests and thecomparison of actual outcomes to predictedoutcomes. Test automation can automate somerepetitive but necessary tasks in a formalized testingprocess already in place, or add additional testingthat would be difficult to perform manually.

Test automation is; the use of software to perform orsupport test activities, e.g. Test management, testdesign, test execution and results checking.

Page 3: Test Automation - Keytorc Approach

Best Practices World Wide

Page 4: Test Automation - Keytorc Approach

Test Automation in Software Delevopment Lifecycle

Test design

tools:

Logical design tools

Physical design tools

Static

analysis

tools:

Coverage

tools

Debugging

tools

Dynamic

analysis

tools

Test execution

& comparison

tools

Performance,

simulator

tools

Management

tools

Requirement

specification

Architectural

design

Detailed

design

Code Unit test

Integration

test

System test

Acceptance

test

Page 5: Test Automation - Keytorc Approach

Key to Success

The major key to the success of Test Automation:

“To reduce manual testing activities and redundant test operations using a systematic solution to achieve a better testing coverage.”

Page 6: Test Automation - Keytorc Approach

Test Automation Decision

Test Execution Period ? (Frequency)

Maturity & Maintenance Effort ? (Cost)

Required Technology ? (Cost, Technology)

Cross-platform Support and Reusability ? (Cost, Modularity)

Mismatch between Automated and Manual Application Behavior ? (User Experience)

Are the Scenarios Automatable?

Test

Exe

cuti

on

Pe

rio

d

Not Possible Costs Much Costs Little

Whenever Possible

Regularly

Once in a While

Page 7: Test Automation - Keytorc Approach

Test Automation Lifecycle

Maintenance

Test Planning

• Aut. Decision

• Tool Selection

• Test Coverage

• Schedule & Frequency

• Effort Est.

Test Design

• Test Design

• Test Script Generation

• Test Data Preparation

Test Execution

• Test Execution

• Defect Detection

• Defect Reporting

Test Closure

• Test Reporting

• Quality Ratio Announcement

Maintenance

• Test Script Update

• Test Data Update

• Test Tool Maintenance

Regression Test Development Test Execution

Only Once As Much As Needed / Periodic

Page 8: Test Automation - Keytorc Approach

Test Automation vs. Test Types

Functional testingRegression testingCompatibility testingEndurance testingLoad testingLocalization testingPerformance testing

Recovery testingSecurity testingScalability testingStress testingUsability testingVolume testingInstallability testing

Page 9: Test Automation - Keytorc Approach

Manual vs. Automated Testing

Page 10: Test Automation - Keytorc Approach

Test Automation Technology

Page 11: Test Automation - Keytorc Approach

Test Automation Architecture

SystemUnder

Test

Pre-Condition System State Post-Condition System State

Page 12: Test Automation - Keytorc Approach

Object-Based Recognition

Advantages

Very flexible controlsDeep-dive automation chanceNot sensitive for mature applications

Disadvantages

Platform dependentUnified control handicapHave maintenance issues for low qualitycode

Page 13: Test Automation - Keytorc Approach

Image-Based Recognition

Advantages

Automates everything appears on screenPlatform independentValid for web, desktop and mobileEasy-to-use

Disadvantages

Cannot automate non-GUI softwareExtremely-sensitive to screen propertiesLess flexible than object-basedrecognition

Page 14: Test Automation - Keytorc Approach

Test Automation – Case Study

500 manual test cases/platform

200 automated test scripts/platform

Regular Regression Tests - Weekly

40% Automation Ratio

52 Distinctive Runs/Year

Source: Based on 200 automated regression test scripts

Page 15: Test Automation - Keytorc Approach

Test Automation – Case Study

Source: Based on 200 automated regression test scripts

Page 16: Test Automation - Keytorc Approach

Test Automation – Case Study

Source: Based on 200 automated regression test scripts

Page 17: Test Automation - Keytorc Approach

Test Automation – Case Study

Source: Based on 200 automated regression test scripts

56% total test effort reduction

66% head-count reduction

20% decline on UAT defects

10% decline on Live defects

Prevention of operational blindness

Reusability & Frequency

Less dependency on domain knowledge

Ease of rotation

Flexibility for weekly deployments

Page 18: Test Automation - Keytorc Approach

Keytorc Test Framework

Page 19: Test Automation - Keytorc Approach

ISTQB Foundation LevelISTQB Advanced Level

Test AnalystTechnical Test AnalystTest Manager

Test Automation CoursePerformance Testing CourseMobile Testing CourseUsability Testing Course

Value-added OutsourcingService Level AgreementsISTQB Certified Test Engineers

Testing Center of ExcellenceTest Automation Services Performance Testing ServicesTest Maturity Assessments

(TMMi, TPI, customized)

More than 350 corporate clients…+

Page 20: Test Automation - Keytorc Approach

+Turkey Software Quality Report+

http://turkishtestingboard.org/turkish/tsqr.htm

Page 21: Test Automation - Keytorc Approach

TestIstanbul Conferences+

http://www.testistanbul.org/

Page 22: Test Automation - Keytorc Approach

Bize Ulaşın

www.twitter.com/Keytorc

blogs.keytorc.com

tr.linkedin.com/in/keytorc

Contact

[email protected]

Keytorc Software Testing Services