Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Dec 2015
Syntel & Experitest Co-webinar:
Best Practices for Mobile Application QA in an Agile Environment
Speakers
Tom Ben SimhonHead of Sales
Experitest
Ashok
BalasubramanianHead of Services
Transformation Group
Syntel
Agenda1 The Digital Transformation - mobility industry overview
How mobile QA adapt to the digital transformation
How Agility effects mobile DevOps ?
Demo- How SeeTest Suite enables agile methodology?
Case Study
Q & A
5 Min
5 Min
1 Min
30 Min
10 Min
10 Min
2
3
4
5
6
Symbian
2015: A prominent year
for Mobility
Mobile adoption on Rise
One view – Any platform
Device Proliferation
Industry wide adoption of Mobility
18%
of IT spending on
mobility by 2017
($600 Bn Approx.)
By 2017, Global
EMM market to
reach
$3.1
Billion
workforce to
depend on Mobile
solutions for work
by 2015
480
Million
2006 2012 2017
Millions
~60
~600
~1500
2.4% Entertainment information & Media
9.4% Manufacturing
9.0% Government & public
3.8% Healthcare
2.8% Communications
2.4% Legal
2.0% Retail
7.6% Other
46.8% Financial Services
13.8% Business & Professional Services
0%
10%
20%
30%
40%
50%
60%
Google\ Android Apple\iOS Microsoft BlackBerry
2013 Feb 2014 Feb 2015 Feb
Digital - Mobility Industry Overview
What is changing
5
Businesses are struggling with speed of technological change(World Quality Report )
Budget spent on the new
transformational work has decreased
by 1 percent and more spending is on
the continuous transformation.
Modernize the testing practices
and procedures. This demands
higher proportion of that budget
is now dedicated to DevOps and
Agile principles.
Digital transformation and
security testing has become
critical to business assurance
for many organizations.
Customer experience is now
a key consideration for their
digital quality assurance
testing.
Digital Quality Engineering View
Performed Manuallyfor DevOps
6
Environment
Provisioning
Build Unit Testing Code Review Deployment Regression
Testing
Environment
Availability
Requirements
Unit Test Scripts Code Quality Rules Regression Scripts
Integrated QA
Automated Testing (MTAF)
Administration, Governance and Reporting
How is Mobile DevOps adapting to the Digital Transformation
7
3.
Customer experience
driven quality
2.
Multiple
technologies and
platforms
1.
More Agility
Business organization - Digital Transformation is rebranding or
integrating digital characteristics?
Core aspects of the Digital Transformation for building digital QA test
strategy:
Simple and robust automation for complete application development
lifecycle – From design phase to post production1.
More Agility
How Agility effects Mobile DevOps?
SeeTest Suite allows agile process for
Mobile application testing
Shorter release cycle
Manual regression shortened
QA automation process is more relevant
Automation ROI increased
A M
C N
AGILE
DEVELOPMENT
• Device Lab located onsite (in the customer VPN)
• Devices can be reserved and accessed by any remote user
• Used in conjunction with SeeTestAutomation/Manual/Mobile Add on for UFT for testing of remote devices
SeeTestCloud
End-to-End Product Suite –Manual, Automation, Monitoring, Load, Network Virtualization, Manager
SeeTestCloud- Centralize your Device Hub
Allow remote access
Allow working on devices 24/7 with different teams
Allow scalability – Support all operating systems- IOS, Android, Blackberry, and WindowsPhone
Increased device governance leading to better test operation management
SeeTestCloud
U.K
U.S.A
India
End-to-End Product Suite –Manual, Automation, Monitoring, Load, Network Virtualization, Manager
• Productivity tool for manual users
• Report with screenshots of each
step
• Used in conjunction with
SeeTestCloud
• Allow remote debugging
SeeTestManual Free
Tool!
M
• Device Lab located onsite (in the customer VPN)
• Devices can be reserved and accessed by any remote user
• Used in conjunction with SeeTestAutomation/Manual/Mobile Add on for UFT for testing of remote devices
SeeTestCloud
SeeTestManual integrates to ALM assets
Works in conjunction with SeeTestCloud
Integrates to HP ALM and JIRA - defect management tool.
Manual Testing M
Manual Tester
Develop / Debug M
Mobile Developer
SeeTestCloud
M
SeeTestManual allows remote debugging
19
Both QA and development teams can work on the same devices
M
Manual Testing
M
Manual Tester
Develop / Debug M
iOS DeveloperDevelop / Debug
Android Developer
M
SeeTestCloud
End-to-End Product Suite –Manual, Automation, Monitoring, Load, Network Virtualization, Manager
• Automation tool
• Same test runs on different devices
• Plugs into all testing & CI environments
SeeTestAutomation
Mobile Add-On for UFT
• Full & complete integration into HP UFT:
• Record a test, edit it, run it, and view results
• Integration of object repository and more…
U
• Device Lab located onsite (in the customer VPN)
• Devices can be reserved and accessed by any remote user
• Used in conjunction with SeeTestAutomation/Manual/Mobile Add on for UFT for testing of remote devices
SeeTestCloud
• Productivity tool for manual users
• Report with screenshots of each step
• Used in conjunction with SeeTestCloud
• Allow remote debugging
SeeTestManual Free
Tool!
M
SeeTestAutomation works in conjunction with SeeTestCloud
25
Same test runs on all platforms:
• All device types
• All operating systems: iOS, Android, Blackberry, and WindowsPhone
Automation
engineer
India
SeeTestCloud
SeeTestAutomation has advanced Continuous Integration capabilities
26
On-the-Fly instrumentation
Dynamic allocation of devices for execution
Parallel Execution environment
Developers
Source Code
Repository
CI Server
YOUR
APPExecuter
Agent
Execute Test On Devices
xTest Results
End-to-End Product Suite –Manual, Automation, Monitoring, Load, Network Virtualization, Manager
Network Virtualization• Device performance under varying network conditions
• Simulating mobile network bandwidth latency and reception while on the move N
• Full integration to LoadRunner through
SeeTestAutomation
Mobile Add-On for LoadRunnerSeeTestLoad
• Real device generated mobile load
• Full integration to LoadRunner, Jmeter, etc.L
SeeTestLoad
• Automation tool
• Same test runs on different devices
• Plugs into all testing & CI environments :
SeeTestAutomation
Mobile Add-On for UFT
• Full & complete integration into HP UFT:
• Record a test, edit it, run it, and view results
• Integration of object repository and more…
U
• Device Lab located onsite (in the customer VPN)
• Devices can be reserved and accessed by any remote user
• Used in conjunction with SeeTestAutomation/Manual/Mobile Add on for UFT for testing of remote devices
SeeTestCloud
• Productivity tool for manual users
• Report with screenshots of each step
• Used in conjunction with SeeTestCloud
• Allow remote debugging
SeeTestManual Free
Tool!
M
Network Virtualization• Device performance under varying network conditions
• Simulating mobile network bandwidth latency and reception while on the move N
30
Works in conjunction with SeeTestManual and SeeTestAutomation
SeeTest NetworkVirtualization simulates different network conditions N
Manual Testing M
Manual Tester
Develop / Debug A
Automation Engineer
NN SeeTestCloud
33
Case Study: mobile application non-functional QA
• Increased NFR coverage by 40%, resulting in 70% overall NFR coverage
• 30% Reduced cycle time
• 40% overall reduction in NFR testing Costs
Business
Benefits
About the Client Challenges Syntel Solution
• UK based Leading investment
firm
• Non-functional testing of Mobile apps -
Hybrid
• Interruption testing
• Connectivity testing
• Session Management
• Caching
• Accessibility testing
• Network Simulation
• App profiling
• Leveraged SeeTest’s Network
virtualization feature for simulation
of networks & service providers
• Centralized managed lab for entire
portfolio
• UI driven Framework for early
automation
34
Case Study: mobile application functional QA
• Achieved 80% overall Functional coverage
• 40% effort saving in the test design phase
• Structural savings of 25% and overall reduction in IT Costs
Business
Benefits
About the Client Challenges Syntel Solution
• US based Leading Insurance firm • Real Device Testing for E2E functional
Testing
• Mobile Lab to be accessible all across the
globe
• Non-functional testing of Mobile apps -
Hybrid
• Interruption testing
• Connectivity testing
• Session Management & Caching
• Application Management - Project
Management as a part of a solution
• Centralized managed lab for entire
portfolio
• UI driven Framework for early
automation
• More secured private device hub
with seamless device sharing
• Leveraged SeeTestCloud for real
device sharing, remote access,
application management and
project management