Test Automation Approach
Definitions for Test Automation
In software testing, test automation is the use ofspecial software (separate from the software beingtested) to control the execution of tests and thecomparison of actual outcomes to predictedoutcomes. Test automation can automate somerepetitive but necessary tasks in a formalized testingprocess already in place, or add additional testingthat would be difficult to perform manually.
Test automation is; the use of software to perform orsupport test activities, e.g. Test management, testdesign, test execution and results checking.
Best Practices World Wide
Test Automation in Software Delevopment Lifecycle
Test design
tools:
Logical design tools
Physical design tools
Static
analysis
tools:
Coverage
tools
Debugging
tools
Dynamic
analysis
tools
Test execution
& comparison
tools
Performance,
simulator
tools
Management
tools
Requirement
specification
Architectural
design
Detailed
design
Code Unit test
Integration
test
System test
Acceptance
test
Key to Success
The major key to the success of Test Automation:
“To reduce manual testing activities and redundant test operations using a systematic solution to achieve a better testing coverage.”
Test Automation Decision
Test Execution Period ? (Frequency)
Maturity & Maintenance Effort ? (Cost)
Required Technology ? (Cost, Technology)
Cross-platform Support and Reusability ? (Cost, Modularity)
Mismatch between Automated and Manual Application Behavior ? (User Experience)
Are the Scenarios Automatable?
Test
Exe
cuti
on
Pe
rio
d
Not Possible Costs Much Costs Little
Whenever Possible
Regularly
Once in a While
Test Automation Lifecycle
Maintenance
Test Planning
• Aut. Decision
• Tool Selection
• Test Coverage
• Schedule & Frequency
• Effort Est.
Test Design
• Test Design
• Test Script Generation
• Test Data Preparation
Test Execution
• Test Execution
• Defect Detection
• Defect Reporting
Test Closure
• Test Reporting
• Quality Ratio Announcement
Maintenance
• Test Script Update
• Test Data Update
• Test Tool Maintenance
Regression Test Development Test Execution
Only Once As Much As Needed / Periodic
Test Automation vs. Test Types
Functional testingRegression testingCompatibility testingEndurance testingLoad testingLocalization testingPerformance testing
Recovery testingSecurity testingScalability testingStress testingUsability testingVolume testingInstallability testing
Manual vs. Automated Testing
Test Automation Technology
Test Automation Architecture
SystemUnder
Test
Pre-Condition System State Post-Condition System State
Object-Based Recognition
Advantages
Very flexible controlsDeep-dive automation chanceNot sensitive for mature applications
Disadvantages
Platform dependentUnified control handicapHave maintenance issues for low qualitycode
Image-Based Recognition
Advantages
Automates everything appears on screenPlatform independentValid for web, desktop and mobileEasy-to-use
Disadvantages
Cannot automate non-GUI softwareExtremely-sensitive to screen propertiesLess flexible than object-basedrecognition
Test Automation – Case Study
500 manual test cases/platform
200 automated test scripts/platform
Regular Regression Tests - Weekly
40% Automation Ratio
52 Distinctive Runs/Year
Source: Based on 200 automated regression test scripts
Test Automation – Case Study
Source: Based on 200 automated regression test scripts
Test Automation – Case Study
Source: Based on 200 automated regression test scripts
Test Automation – Case Study
Source: Based on 200 automated regression test scripts
56% total test effort reduction
66% head-count reduction
20% decline on UAT defects
10% decline on Live defects
Prevention of operational blindness
Reusability & Frequency
Less dependency on domain knowledge
Ease of rotation
Flexibility for weekly deployments
Keytorc Test Framework
ISTQB Foundation LevelISTQB Advanced Level
Test AnalystTechnical Test AnalystTest Manager
Test Automation CoursePerformance Testing CourseMobile Testing CourseUsability Testing Course
Value-added OutsourcingService Level AgreementsISTQB Certified Test Engineers
Testing Center of ExcellenceTest Automation Services Performance Testing ServicesTest Maturity Assessments
(TMMi, TPI, customized)
More than 350 corporate clients…+
+Turkey Software Quality Report+
http://turkishtestingboard.org/turkish/tsqr.htm
TestIstanbul Conferences+
http://www.testistanbul.org/
Bize Ulaşın
www.twitter.com/Keytorc
blogs.keytorc.com
tr.linkedin.com/in/keytorc
Contact
Keytorc Software Testing Services
Recommended
