Upload
phungcong
View
216
Download
2
Embed Size (px)
Citation preview
1 © 2013 SAP AG or an SAP affiliate company. All rights reserved.
MOBILE app testing
– tools & experience
Sandip Ghosh, Practice Lead, Global Testing Solutions, SAP
Paul Jackson, Principal Consultant, SAP UK
2 © 2013 SAP AG or an SAP affiliate company. All rights reserved.
A discussion on challenges in application testing different
types of mobile applications we lead on to looking at
different options for mobile application testing.
The options will include using SAP Solution Manager, SAP
Quality Center and other tools.
This will then be followed by a Mobile Apps Test Automation
Demo and opportunity to ask questions that will lead to
‘app’y MOBILE testing.
‘app’y MOBILE testing
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 3 Public
Agenda
Challenges in mobile application testing
Types of mobile applications
Test management overview
Mobile application testing
Introducing SeeTest by experitest
Mobile Apps Test Demo
Questions & Summary
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 5 Public
Key challenges in testing of mobile applications
Functional testing Variety of mobile devices with different operating systems
High number of combination (e.g. business process variants,
devices, network) in case of changed business processes
Test for user interactions
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 6 Public
Mobile application testing Challenges
Different screen sizes, processing power,etc
Different input types: Normal, Touch, Qwerty keyboards
Different battery strength, etc
Variety of mobile devices
Mobile OS is divided under the category of “Smartphones” and normal OS
There are many vendors in Smartphone mobile OS space (fragmented market share)
Each OS has many releases, and there are devices running on different version of the same
Many operating systems
400 + mobile operators in the world with different communication technology like GSM, CDMA, LTE, etc.
Each operator has his own unique combination of infrastructure based protocol
The devices performance depends on the signal strength, location, time of day, etc
Numerous mobile operators
Mobile devices are evolving very quickly
Mobile OS versions and variety is increasing at rapid pace
Fast changing market share for mobile devices, Operating Systems, etc.
Extremely dynamic space
SAP, partner and customer applications
Applications of kind: Web, Hybrid & native Variety of applications
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 8 Public
Types of mobile applications
Browser-based Hybrid Native
Accessed via internet on mobile
browsers e.g. m.facebook.com
User interface is native but
content is loaded from web e.g.
facebook app
Standalone & server based
applications
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 9 Public
SAP Business Suite
Architecture
SAP Mobile Platform
SAP, Partner, and Custom Apps
Native Apps Hybrid Browser based
Internet
SAP NetWeaver Gateway
1. Variety of mobile apps
2. Connectivity
3. Backend
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 11 Public
Test Option 1
Test Option 3
SAP Connector, Quality Manager, Requirements Composer, Team Concert, ...
Business Blueprint
BPCA
Business Blueprint
Test Planning/Management
Test System Setup Test Execution
Change
Deployment Change Impact Analysis
SAP Solution
Update
New SAP
Solution
SAP Test Management Products and capabilities integrated with SAP Solution Manager 7.1 SP07+
Test Workbench Test Automation Framework HP QTP CBTA 3rd Party
Quality Center Business Process Testing HP QTP SAP TAO
Test Automation Test Management
Test Automation Test Management
Test Option 2
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 13 Public
Test Management Products and capabilities of Test Option with SAP Solution Manager 7.1
Quality Center by HP
• Requirement
• Test Plan
• Business Process Tests
SAP TDMS
Test Option 2
Business Blueprint
Test Planning/Management
Test System Setup
Test Execution
Reporting
Change
Deployment Change Impact Analysis
Solution Manager
Business Blueprint
• Process documentation
• Business requirements
Solution Manager
BPCA
• Change Impact Analysis
• Test Scope Optimization
Adapter Quality Center by HP
• Test Lab
• Sprinter
• QTP
• Defect
• Test Requirement
• Defects / test results
SAP TAO
• Optimized SAP test scripts
• Accelerated maintenance
• Load and performance
testing
LoadRunner
• Setup of lean test systems
3rd party mobile
automation tools
e.g. SeeTest
DEMO
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 14 Public
Flow to create automated test for mobile applications
Business Process SAP Quality Center
Create Test Requirements
Assign tests to
requirements
SAP Quality Center by HP
1. Sign On to SeeTest
2. Access devices
hosted on cloud or
via USB connection
3. Convert the script in
QTP format
On cloud devices
On premise devices
Create Automated Test Script
Store QTP
Script DEMO
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 16 Public
experitest- Overview
- Market leader in Mobile testing & Monitoring - 7 of 10 largest banks in the world base their
mobile testing on experitest - HP Gold partner and HP Certified Application - Microsoft VSIP Premier partner
Company overview
Software only, simple and quick deployment
Device connectivity: Local or Cloud (remote)
Mobile OS: iOS, Android, Blackberry and WindowsPhone
Identification by Native/Web properties, inc Xpath
Integrative to all test, monitoring & CI environments
Key functionalities
Mobile Test Products
HP UFT/QTP as add-in – which integrates with HP ALM and
SAP Solution Manager
HP Quality Center,Performance Center &LoadRunner
Microsoft Visual Studio and TFS
IBM Rational
Junit, Perl and Python
Jenkins, Team City
Integration options
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 17 Public
Worldwide customer base of Fortune 500 companies
Hundreds of users, thousands of 24/7 test users
Example Customers
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 18 Public
7 out of the top 10 banks base their mobile testing on SeeTest
Top 10 banks worldwide*:
Barclays
HSBC
American Express
Bank of America
Bank of China
Wells Fargo
JPMorgan
Westpac
Citigroup
TD Bank.
Out of these, 7 (!) have large scale deployments of SeeTestAutomation for mobile testing.
SeeTest from experitest is the tool of choice for the banking industry worldwide.
*based on Wikipedia
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 19 Public
SeeTestAutomation • Automation tool • Records & Play on real devices and on emulators • Plugs into UFT/QTP, Visual Studio, RFT, Junit, Python, Perl
SeeTestManual • Manual testing tool •Test on one device manually, get results on 8 devices •Integrated to QC
SeeTestCloud • Device hub located onsite (in the customer VPN) that can be remotely accessed
Product Portfolio
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 20 Public
SeeTestCloud Approach for remote testing of mobile devices
1.Access SeeTestCloud via SeeTest tool and
select an appropriate device
2.Device Visualization appears on the User machine
Mobile devices hub
Onsite Mobile cloud
User
HP ALM
3. Over the air/remote installation of the mobile app
4. Record, Execute and View repots on the User
machine as though the device was locally connected
© 2013 SAP AG or an SAP affiliate company. All rights reserved. 22 Public
Questions
Thank You For Your Time
23 © 2013 SAP AG or an SAP affiliate company. All rights reserved.
A discussion on challenges in application testing different
types of mobile applications we lead on to looking at
different options for mobile application testing.
The options will include using SAP Solution Manager, SAP
Quality Center and other tools.
This will then be followed by a Mobile Apps Test Automation
Demo and opportunity to ask questions that will lead to
‘app’y MOBILE testing.
‘app’y MOBILE testing