Upload
felicia-anthony
View
216
Download
2
Tags:
Embed Size (px)
Citation preview
Jade Global, Inc.QA and Testing Services
Jade Global © 2013
►
Testing & QA Market TrendsThe average spending on
QA as a percentage of
the total IT budget has grown from
18% in 2012 to 23% in
2013. Testing is forecast to
reach 28% of IT budgets in
2015.
The total global
Software Testing market is estimated to reach USD 50
billion by 2020.Now more
than 55% organizations test mobile
applications compared to an industry average of 31% in last
year.
Significant opportunity
exists in Test Automation
as market penetration is still relatively
low with 49.8%.
►
Key Competitors in Testing & QA
• Tata Consultancy Services
• Wipro Technologies
• Infosys Technologies
• Cognizant Technology Solutions Corporation
Tier/Level 1
• MindTree Limited
• AppLabs Technologies
• Mahindra Satyam
Tier/Level 2
• Maverick Systems
• Thinksoft Global
• Cybage Software
• ITC Infotech
Tier/Level 3
►
Key QA Audience
QA Audience
CIO
IT Director
VP – Software Testing
QA Director
Head of Testing
Manager - QA
►
Key Sales Talking Points
Jade DiffrentiatorsTest Center of Excellence
Centralized Testing with Standardized Processes
Reusable Test Artifacts (Frameworks, Templates etc.)
Transparency Through Metrics
Flexible Resourcing & Costing Models
Knowledge Repositories & Talent Management
Key Focus on Test Automation and driving Business Value
QA Trends - Shifting from Functional to Business Assurance
• Functional and Regression Testing• Data Migration and BI Testing• Integration and Agile Testing• Globalization/ Localization Testing
“To be a trusted QA partner of choice” Enhanced business value aligned to your goals.
Define
Analyze
MeasureInnovate/ Automate
Over 200,000 man hours of experience
with highly trained and certified Test Engineers, Test Analysts and Test
Managers.Vast Tools expertise – Experienced
professionals trained in automation tools,
performance test tools, test data management
tools and defect tracking tools.
Jade Global QA and Testing – An Overview
Skills & CompetenciesExperienced testing professionals
with Multiple testing specializations
Processes & MethodologyOngoing Optimization strategyAutomation driven approachStrong Knowledge Management
Capabilities & ExperienceStrategic Consulting and Test CoE setup Innovative Solutions and Frameworks Deep Technology Alliances Industry Vertical UnitsPerformance, Load, Stress, Volume and
Endurance Testing
• Strategic Test Management & Process Consulting
• Testing CoE• End to End Test Management
• Performance Validation• Product and Online Businesses
Testing• Mobility based Test labs• Compliance/Certification Testing
Range of Services
Validation experts and business domain specialists
Jade Global Differentiators
•99% defect-free software delivered•30% Cost savings track record•80% reduction in production defects•Productivity improvement by over 50%
Superior Quality
•Quick ramp-up and effective knowledge management via reusable artifacts/ proven frameworks•Effective GDM model•Improved efficiency and productivity via automation
Faster Cycle Time
•Cost saving through early engagement (not just defect detection but defect prevention)•Operational and infrastructure cost savings•Cost saving through automation
Cost Optimization
Costs
Issues
Complexity
• Testing costs and regression expenses are becoming an overhead – a Spend Headache
• High cost of licensing and infrastructure set up
• Production issues and fallouts leading out from poor QA – revenue leakage
• High Test Cycle times leading to slower time to market
• Emerging Technologies of Cloud, Handheld devices leading to an ever changing complex QA paradigm
• Changing regulatory norms and compliance adding to the cost overheads
Key Challenges Faced by The Industry
20% Budget overhead from testing related spend and fallouts
►
Jade Global QA Services
Eclipse, Maven, Apache Ant, Unix/Linux, Jira, Junit, NUnit, QTP, QC, Selenium, Qualitia, LoadRunner, TestNG
►
Jade Global QA Methodology
►
QA Engagement Model• A trusted partner.• Jade Global manages
end to end needs for the customer.
• Dedicated testing team.
• Continuous asset building.
• Set –term outsourcing.• Project based
agreement.• Jade Global ensures
resources availabilty at key milestones.
• On-going professional support.
• Access to talent pool.• Improve your QA
efficiency & effectiveness.
• Dynamic & flexible staffing.
• Add field experts to your QA team.
• Quick ramp up & ramp down of resources.
• Quick access to missing skills.
Managed Testing Services (MTS)
Fixed Term Services(FT
S)
Consultancy Services
(CS)
Dynamic & Flexible Staffing (DFS)
►
QA Process @ Jade Global
Requirement Analysis
Test Case/Automation
design & scriptTest Planning QA Metrics
Test Execution / Defect Tracking
Knowledge Management
Productivity Improvement
Best Practices
Test CoE
RTMTest Plan/
Test StrategyTest Case/ Test Scripts
Defect Summary Reports
Status Reports
Project & Test Management
Test Governance
Test
ing
Life
Cyc
leCo
nti
nu
ous
Imp
rove
men
t
►
Jade Global – QA Matrices
Quality Metrics Productivity Metrics
a. Schedule deviationb. Efforts deviationc. Knowledge
Management related Metrics
d. Training related metrics.
a. Number of Test Cases executed by per person per day.
b. Number of Test Cases Created by per person per day.
c. Number of defects identified per day by per person.
d. Number of Defects verified per day by per person
a. Defects Identified across phases
b. Defect across severityc. Valid Vs. Invalid
Defectsd. Defect statuse. Defect average
turnaround time.f. Build qualityg. Defects identified
during test case review
h. Test case pass ratioi. Test case failed ratio
a. Number of Manual test case converted
b. Number of test methods written
c. Time saved (ROI)d. Code coverage
analysise. Business case value
realization
►
Jade Global – QA Matrices (Samples)
6%18%
15%62%
Defects Across Severity
Show Stopper BlockerCritical Medium
02468
1012141618
7
17
10
45
23
6
3
Find Vs. Fixed Defects
Find Fix Outstanding
►
Jade Test Center of Excellence – Components Overview
JADE TEST CENTER OF EXCELLENCE
• Project Management
• Best Practices
• Generic Framework
• Training Center
• Standard Test Deliverable Templates (Test Cases, Execution , Defects Reports etc.) .
• Generic Data Models.
• KPI Library
• Reusable Components
• Performance Measurement & Benchmarking
KEY BENEFIT
Organizations can typically save in excess of 30% of testing costs by using Jade’s Test COE while at the same time reducing risk and time to market.
• Intellectual Property
• Productivity Improvement
Solution Group LabsKnowledge
ManagementTraining BD/Presales
►
Core Testing
Jade Core Testing Competency
Best Practices
Requirements Review & Gap
Analysis
Standard Test Checklists
Standard Test Deliverable Templates
QA Matrices
Test Life Cycle
Requirements Analysis
Testing ToolsTest Management Defects/Bugs Management
Functional
Integration
Regression System
Test Management Consulting
Test Planning, Strategy &
Design
Test Planning
Test Designing
Environment Setup
Test Execution
Reporting & Closure
*All logos and trademarks belong to respective owners
►
Automation Testing
Jade Automation Testing Competency
Proprietary Frameworks
Web based Frameworks
Windows based Frameworks
Tool based Frameworks
Industry based Frameworks
Execution Flow
Scripts Execution
Log Review
Easy Bug Filing
Report and Analysis
Test Automation Methodology
Automation Tools
Commercial Tools Open Source Tools
Automation Plan
Execution
Framework Design Development
Acceptance Maintenance
Automation Feasibility Strategy ROI Assessment Tool Evaluation POC
Consulting & Strategy
►
Jade Global – QTP Automation Framework
Application User
Automation Scripts
QTP (Build In) Library
Custom Function Library
Object Repository
Recovery Scenarios
Test Data & Configuration Data
Test Reports (Logs)
►
Methodology – Tool Migration, QTP to Selenium
Planning Migration
Design Solution
Pre-Implementation
Implementation
- QTP scripts and execution flow- Input data source- Current implementation- Other requirements / limitations- Manual test cases
- Decide programming language- Decide Test Env- Prepare framework design /
architecture doc- Address limitations exits in QTP
system
- Setup coding standards- Setup selenium supporting tools- First sets of QTP script migration- Additional manual test cases
- Develop framework- Code QTP test cases- Make both system run- Compare the results- Fill-up the gap items- Repeat the process for next set of QTP scripts
- Test reports- Unattended
Execution- Application
performance reports- Email notification- ROI
Skilled and certified resources
►
Jade Global – Selenium Automation Framework
Libs BrowserDrivers
Test Script
Framework Layer
Excel files
DataBase
Framework Config files
Test Case XML files
Input Data
Selenium Webdriver
Framework Layer
Fram
ewor
k La
yer
Application
Logs Reports Mail
Feature List
•Framework consists of libs, browser drivers (IE, Firefox, Chrome) and selenium jars.
•Framework responsible for reading the input data and providing to the application at runtime.
•Input data can be excel file for data driven approach or normal text file.
•Test cases is in form of XML files (can be included or excluded) for the execution.
•Framework with the help of selenium web driver will be executing the test cases on the application
Fram
ewor
k La
yer
Object Repository
►
Performance Testing
Jade Performance Testing Competency
Core Activities
Identify Acceptance Criteria
Plan and Design Tests
Configure Test Environment
Implement Test Design
Performance Test Types
Performance Test ToolsCommercial Tools Open Source Tools
Load Testing Stress Testing Soak Testing
Execute Tests
Analyze, Report , and Retest
Spike Testing Configuration Testing
Isolation Testing
Process Flow
Record User Scenarios
Parameterize Test Scripts
Group User Scenarios
Create Load Scenarios
Simulate and Execute Load
Analyze Test Results & Report
►
Security Testing
Jade Security Testing Competency
Methodologies
Risk-based Application
Testing
Security Test Types & Techniques
Security Test ToolsCommercial Tools Open Source Tools
Penetration Testing
Password Cracking
URL Manipulation
SQL InjectionCross Site Scripting
Brute-Force Attack
Approach
Analysis
Application Penetration
Testing
Compliance Testing
Analysis & Certification
Design
Development
Assessment & Testing
Maintenance
►
Mobile Applications Testing
QA Challenges
Device Variation
Mobile Testing Types
Mobile Testing Tools
UI & Functional Testing
Usability Testing Performance Testing
Security Testing Compatibility Testing
Interruption Testing
Test Approach & Flow
Mobile Platforms
Tools Availability
Industry Standards
Skilled QA Specialists
Cloud Computing
Testing Needs Identification
Test Assets Building
Test Execution
Results Analysis & Reporting
Automation Implementation
Jade Mobile Applications Testing Competency
►
Cloud Applications Testing
Jade Cloud Applications Testing Competency
Challenges Testing Types & Techniques
Tests Tools
Performance Monitoring
Functional TestingCompatibility
Testing
Cross Browser Testing
Load & Stress Testing
Latency Testing
Test Process & Flow
Test Planning & Design
Cloud Setup
Test Execution
Remediation
Closure
Service Challenge
Security Challenge
Layered Testing Challenge
Lack of Standards
Utilization of Cloud Services
►
Oracle Applications Testing
Jade Oracle Applications Testing Competency
Oracle Applications Test Practice
Collaboration with Oracle
Competency Building
Technology Expertise
Oracle Test Process
Planning
Test Environment Setup
Requirements Gathering
Requirements Analysis
Testing Types & Activities
Tool - Oracle Application Testing Suite (OATS)
Manual Testing
Test Process Management
Automated Functional &
Regression Testing
Scalability, Performance & Load
Testing
Requirements & Test Management
Test Execution & Defects Tracking
Jade Global is an ORACLE Platinum Partner
Oracle Functional Testing Suite for Oracle Applications
Oracle Functional Testing Suite for Web Applications
Oracle Load Testing Suite for Oracle Applications
Oracle Test Manager
Solutions & Thought
Leadership
Methodology, Accelerators &
Tools
Test Development
Test Execution
Results Analysis & ReportingJade Global Key Differentiators Efficiency Visibility Agility
Business Requirements The Challenges
The Benefits
The SolutionAbout the Company
IT Landscape• Creation of Standardized Test Processes, Metrics & Framework• Immediate cost reduction, enhanced testing flexibility and reduced time-to-market • Support to Multiple Technologies & Architectures• Increased application scope with lesser number of resources• Knowledge retention of applications through Cross trainings at offshore• Availability of an offshore team to handle multiple application releases quickly with quick ramp up and ramp downs
• Lowering overall cost by maximizing testing resources
• Creation of Standardized Test Processes & Automation Framework
• Providing a core team of testers that are available for immediate testing
• Managing the testing effort and providing reports to management
• Business understanding within short time span.
• On demand test requests from production.
• Reducing the test automation costs.
• Need of testing web services.
• Discussions, walk-throughs with business people to gain business understanding quickly.
• Setting up Functional, Regression and Integration Testing.
• Production tickets support provided for handling on demand test requests from production.
• Migration from a high cost licensed tool (HP-QTP) to an open source tool (Selenium).
• Web services testing using Parasoft SOA Test.
Onsite/Offshore Testing Services
Client is a global leading billing service provider in the energies and utilities space
• Onsite-Offshore• Team Size- 20• Selenium / Java• SVN• TestLink, Jira• Parasoft SOA Test
Business Requirements The Challenges
The Benefits
The SolutionAbout the Company
IT Landscape• This led to savings of over US$ 1.5 million purely from licensing angle + further productivity benefits coming out time saved in
automation which were over 80% in most cases• Automation suite is highly scalable, easy to maintain and considerably reduces execution time & cost• Reduced production time and better time to market• Prioritized test coverage• Easy identification of new functional test scenarios for regression
• Lowering testing cost by Automating Regression Testing Suite
• Migrating existing scripts from QTP to Selenium (an open source tool)
• Creation of reusable Automation Framework & Automate Regression Suite
• Providing Automation Experts that are available for immediate implementation of automation solution
• Reducing test automation costs.• Increasing test reusability.• Test automation coverage with a
low cost or free tool.
• Creating reusable and easily maintainable automation framework with Selenium Webdriver.
• Automation of functional regression testing suite.
• Migration entire testing suite from a high cost licensed tool (HP-QTP) to an open source tool (Selenium).
Automation Testing Services
Client is a global leading energy service provider for the consumption-dependent billing of Electricity, Gas and water. They offer solutions for an individual and efficient energy cost and energy data management
• Onsite-Offshore• Team Size- 04• Selenium WebDriver
(Java)• QTP (VB Scripting)• Parasoft SOA Test• TestNG, ANT• SVN
www.jadeglobal.com http://www.facebook.com/jadeglobal
www.twitter.com/jadeglobal
www.linkedin.com/company/jade-global
Jade Global US Locations
Jade Global India Locations
Contact us on the Web
• Corporate Headquarters Jade Global, Inc.1731 Technology Drive Suite 350San Jose, CA 95110 Phone: +1 408-899-7200
• East Coast Jade Global, Inc.33 Wood Ave SouthSuite 600, Iselin NJ 08817Phone: +1 646-334-7165
• Central United StatesDallas, TexasPhone: +1 (940) 594-2752
• Jade Global Software Pvt. Ltd.Pinnacle Towers, Unit No 101, 1st Floor,A-42/6, Sector 62, Noida – 201301 Phone: +91-12-06408884
• Jade Global Software Pvt. Ltd. E-space IT Park A-3, 4th Floor, 104 A to E,Wadgaon Sheri Pune-Nagar Road, Pune, 411-014Phone: +91-20-66081500VOIP: +1-408-907-2730, +1-408-834-8606Fax: +91-20-66081595
Appendix
►
Jade Global – Automation Methodology
Test program review
and assessm
ent
Execution and management of
test
Test planning design
& develop
ment
Automated
testing introdu
ctionProcess
Test tool
acquisition
Decision to
automate test
Automated Testing Life Cycle Methodology
Value Definition
Value Realization
From Value Definition to Value Realization !
►
Jade Global – Automation Approach
Execute Automation
Scripts
Design Automation Architecture
Gather Requirements
& Test Planning
Automation Lifecycle Activities
Inception Phase
• Scenario Analysis• Automation
Feasibility Analysis• Effort Estimation
Design & Construction Phase
• Reusability• Robustness• Exception Handling• Scalability• Maintainability
Test Execution & Analysis Phase
• Exhaustive Test Data• Logging & Testing Results• Reporting Capabilities
►
Jade Global – Automation Approach ..cont.
- Design and develop the automation framework- Develop automated script based on the framework- Test data conditioning- Test the automated script- Prepare user manual guide- Package the automated scripts for release
- Identify test cases for automation- Identify reusable components- Prepare coding convention document
- Walkthrough of test cases- Walkthrough of test environment- Analyze test cases from automation perspective- Analyze variation in UI for future releases- Calculate ROI- Identify relevant tool for automation based on requirement
►
Selenium Introduction
Selenium - first developed in 2004
Jason Huggins building the Core mode as
"JavaScriptTestRunner"Selenium was developed by team of programmers
and testers at ThoughtWorks.
Google Too! Jason Huggins left
Thoughtworks in 2007 and joined the (then secret) Selenium support team
inside Google.
Trivia: Selenium is used to treat Mercury Poisoning
►
Selenium vs QTP
Selenium QTP
Open Source – So straight savings Paid and Licensed
Selenium supports almost all OOPs and scripting languages, hence more developer friendly
QTP only supports VB script as a test automation language
No Third party test automation frameworks available Many free Agile automation frameworks available
Test Scripts are IDE independent and hence easily deployable across multiple platforms
Test scripts are IDE(QTP) dependent in most cases
Jade Global is pioneering Selenium migration and helping clients globally save $$$
Thank You