E2E Integration Testing
October 2008
Product Management E2E Solution OperationsActive Global Support (AGS)SAP AG
© SAP 2008 / Page 2
Disclaimer
This presentation outlines our general product direction and should not berelied on in making a purchase decision. This presentation is not subject toyour license agreement or any other agreement with SAP. SAP has noobligation to pursue any course of business outlined in this presentation or todevelop or release any functionality mentioned in this presentation. Thispresentation and SAP's strategy and possible future developments aresubject to change and may be changed by SAP at any time for any reasonwithout notice. This document is provided without a warranty of any kind,either express or implied, including but not limited to, the implied warrantiesof merchantability, fitness for a particular purpose, or non-infringement. SAPassumes no responsibility for errors or omissions in this document, except ifsuch damages were caused by SAP intentionally or grossly negligent.
© SAP 2008 / Page 3
1. SAP’s approach to End-to-End Integration Testing
2. Test Capabilities Option 1
3. Test Capabilities Option 2
4. SAP Testing Services
Agenda
© SAP 2008 / Page 4
SAP Solution Manager Enterprise EditionFrom Awareness to Action
SAP is aware of customer pain points. Pain points are addressed by best practices:SAP Standards for E2E Solution Operations.
SAP has compiled best practices for E2E Solution Operations basedon the experience from customer engagements over three decades.
Implementation methodology forE2E Solution Operations: Run SAP.
Require-ments
Design
Deploy
Build &Test
Optimize
Operate
ApplicationManagement
Require-ments
Design
Deploy
Build &Test
Optimize
Operate
ApplicationManagement
SAP Solution Manager provides allcapabilities for E2E Solution Operations.
ChangeManagement
SolutionUpdates
Problemanalysis
Monitoring Softwarelogistics
IntegrationValidation
IntegrationTesting
InnovationManagement
Transparency onProcesses & Apps
IncidentManagement
Improvements of processes,components and solutionsMaintenance of
SAP Solutions
Root CauseAnalysis
Monitoring of mission-critical processes
Deployment ofsolution updates
IntegrationValidation
IntegrationTesting
InnovationManagement
Identification of criticalbusiness processes
IncidentManagement
© SAP 2008 / Page 5
Changing SAP Solutions
Customer pain points
2
3
1 Tests in heterogeneoussystem landscapes
Change Impact Analysis
Test Data Management
E2E Integration Tests of business processes in systemenvironments interfacing SAP with non-SAP solutions
Indentification of critical business processes affected bychange events such as SAP Support Packages
No test recommendations for SAP Enhancement Packages
Test Systems with outdated test data
Productive System copy is too expensive and rework intensive
Creation of appropriate test data for automated test cases
4 Test AutomationCreation of automated test cases is time consuming andexpensive to maintain via skilled QA specialists
Automated test cases get damaged by change events andneed time consuming repair by QA Specialist
© SAP 2008 / Page 6More information about the Run SAP Methodology for E2E Solution Operations at: http://service.sap.com/runsap
Methodology
E2E Solution Operations methodology for theongoing management of end-to-end solutions
Run SAP methodology to implement end-to-endsolution operations including SAP standards,best practices, roadmap, training, certification,services and tools for E2E solution operations
Test ProcessFrom change events and change impact analysis
via test planning and test execution
to deployment of changes in production system
Test Capabilities
SAP Solution Manager acts as central point ofaccess to SAP and 3rd Party test capabilities
… as well as additional capabilities like E2EIntegration Validation and defect management
Business Blueprint
Test Planning Test Execution Apply Changesto ProductionChange Impact
AnalysisSAP Solution
Update
New SAPSolution
SAP Solution Manager
Managing Changes is Critical for Business AgilityMethodology, Test Process and Test Capabilities
© SAP 2008 / Page 7
Q Gate
Designto
Build
Q Gate
Buildto
Test
Q Gate
Testto
DeployRequirements
from businessDepartments
OptimizeBuild Test Deploy
Extend SolutionSAP UpdatesCustom Dev.Partner solutions
Unit Tests
Prepare SolutionOperations
Solution DocuEnablement ofStandards forSolution Operations
Transports in Cycles Final Transport
Execution ofFunctional andUser AcceptanceTests
Incident& Problem
Mgm
t. and RootC
ause Analysis
Data ConsistencyChecks
Performance TestsFunctional andtechnicalblueprint
Functional andtechnicalfeasibility
Handover to Production
Prepare TestsTest ScopeIdentificationTest RequirementsTest System SetupTest Planning
Incident& Problem
Mgm
t. and RootC
ause Analysis
Requirements
Design
Collaboration and Project Controlling
Quality ManagementThe Quality Management process for SAP centric Solutions
© SAP 2008 / Page 8
E2E Integration Testing of SAP SolutionsTest Process embedded in the SAP Application Lifecycle
Business Blueprint
Test PlanningSystem Setup Test Execution Deploy Changes
to Production
Change ImpactAnalysis
Business BlueprintUpdate
Identification ofBusinessProcesses affectedby SAP SolutionUpdates
Recommendationof businessprocesses forregression tests
SAP SupportPackages
SAP EnhancementPackages
Custom Code
Customizingchanges
Planning of TestCases
Test Catalogssetup
Compilation ofTest Packagesand assigment toTesters
Setup of TestSystem
Creation of TestData
Test Scope Identification
Manual tests
Automated tests
IntegrationValidation
IncidentManagement
Apply changesthroughtransports fromTest toProductionsystem
Apply SP‘s orEhP‘s
Type of Change
SAP SolutionUpdate
New SAPSolution
Implementation ofnew SAP Solution
Business BlueprintDesignSolutionConfiguration
© SAP 2008 / Page 9
E2E Integration Testing of SAP Solutions
SAP Solution Manager
All SAP test capabilities are provided andtightly integrated with SAP Solution Manager
Risk-based Test Planning
Identification of business processes affectedby SAP Solution changes
Provide choices to SAP customers
Customers can use SAP capabilities and 3rdParty Test Suites in combination
All required Interfaces will be provided overtime
Guiding Principles
© SAP 2008 / Page 10
E2E Integration Testing of SAP SolutionsTest Capabilities
Customers have various options
Test Option 1Test capabilities provided by SAP SolutionManager with integration of testautomation tools from partners
Recommended for SAP-centric customers
Test Option 2Test capabilities provided by SAPSolution Manager, SAP QualityCenter by HP and SAP TAO
Recommended for customers withheterogeneous system landscape
© SAP 2008 / Page 11
1. SAP’s approach to End-to-End Integration Testing
2. Test Capabilities Option 1
3. Test Capabilities Option 2
4. SAP Testing Services
Agenda
© SAP 2008 / Page 12
Option 1
E2E Integration Testing of SAP SolutionsOptions for SAP Customers
Business Blueprint
Test PlanningTest System Setup
Test Execution Apply Changesto Production
Change ImpactAnalysis
SAP SolutionUpdate
New SAPSolution
Solution ManagerTest Workbench
Test planning
Solution ManagerBusiness Blueprint
Solution ManagerTest Workbench
Manual testing
Solution ManagereCATT
Solution ManagerBusiness ProcessChange Analyzer *
Application-logic Tests
TestPartner
QTP
eCATT
UI based Tests
* planned for Q4 2008
Setup of businessprocess catalog
Businessrequirements
Identification ofprocesses affectedby code / customizingchanges
Admin ofautomated tests
SAP TDMS
Setup of leantest systems
QTP
Test Scope IdentificationType of Change
Automated Tests
© SAP 2008 / Page 13
E2E Integration Testing of SAP SolutionsSAP Solution Manager: Business Blueprint
Documentation of Business Processes
Bus.Process Hierarchy
Process HierarchyScenarioBusiness ProcessBus. Process Step
Graphical and textualdescription of businessprocessBusiness requirementsprovided by businessusers as input for testrequirementsAssignment of SAPTransaction / ReportAssignment of testsTraining MaterialLink to configuration
© SAP 2008 / Page 14
E2E Integration Testing of SAP SolutionsSAP Solution Manager: Business Process Change Analyzer
Change Impact Analysis Test Planning Test ExecutionSAP
SolutionUpdate
Identification ofbusiness processesaffected by change
Risk-based TestRecommendation
Check / creation ofTest Cases
Test Plan updateand Test Packagecreation
Manual Tests
Automated Tests via3rd Party Test Suitesor SAP eCATT
Customer Pain PointSAP Solution updates occur frequently
SAP triggered: Support Packs, Enhancement PacksCustomer triggered: Custom code, Customizing
Which business processes are affected by planned change?
Approach
© SAP 2008 / Page 15
E2E Integration Testing of SAP SolutionsSAP Solution Manager: Business Process Change Analyzer
Scenario: Order to CashSales OrderDeliveryGoods IssueBilling
Scenario: Procure to Pay…
Customer executes Business Process
Preparation
Business Blueprint
Identificationof criticalBusiness
Processes
Background trace records all used SAP objectsCode: Function Modules, Module Pools, …
Tables: Configuration, Master Data, …
Technical Bill of Material (T-BOM) assignment toBusiness Process of Business Blueprint
AnalysisCustomer plans SAP Solution Update including:
SAP Support Packs
SAP EnhancementPackageCustom CodeExtentionsModifications
Customizing changes
Business Process Change Analyzer (BPCA)
“Which criticalBusiness Processes
will be affected?”
Scenario: Order to CashSales Order code changeDeliveryGoods Issue UI changeBilling
Scenario: Procure to PayCreate PO customizing change
BenefitsIdentification of affected Business ProcessesRisk-based test scope recommendationAutomatic test plan generation
© SAP 2008 / Page 16
SAP Test Data Migration Server (SAP TDMS)
MotivationPain point: test system setup via copy of entire SAP production system not suitableGoal 1: fast creation of lean test system with production like environment, but reduced volumeGoal 2: transfer of specific test data such as posted documents and master data
SAP TDMS
Typical SAP TDMS Use CasesCreate separate TDMS client in development environment
Create a slim test system with a reduced set of data for upgrade testing purposes
Business Process Library: quickly populate maintenance systems with small data sets based onbusiness objects
Create multiple TDMS clients with differing data volumes in DEV as master clients to supply test ortraining systems recurringly, e.g. for resetting purposes
Create initial master shell and place in transport path to be used as starting point for target system build
© SAP 2008 / Page 17
Business Process Library – Approach
Predefined business object and process data selection scenariosMaster data onlySelective transactional data with dependent master dataComplete business processes / test cases
Covers key areas in ERP and industry solutionsData extraction based on built-in relationship knowledgeSimple integration of customer data und customer developmentOptional scrambling of sensitive data during extraction (customizable)
© SAP 2008 / Page 18
SAP TDMS – BPL: ExampleSales Order
Main Business Objects:
Sales Order
Sales Document
Customer
Materials
Conditions
Provides selective Sales Order data withdepending objects (including masterdata)
© SAP 2008 / Page 19
Excerpt of Existing SAP TDMS Customers
Horiba, Ltd.
Zentraldienst der Polizei
Weyerhaeuser
Effem ServicesIncorporated
Yell Ltd.
Cemex Central, S.A. deC.V.
Autodesk, Inc.
Wincor NixdorfInternational GmbH
AstraZeneca
Ulta Salon, Cosmetics &Fragrance
Johnson & Johnson
EADS DeutschlandGmbH
J. Crew Group Inc.
AllgemeinesKrankenhaus Wien
REWE
Pacific Coast BuildingProducts
nordIT GmbH
Linde AGGenentech, Inc.Co-Operative BulkHandling Ltd.
Kyocera MitaCorporation
Otafuku Sauce Co.,Ltd.
Nortel Networks LimitedHoneywell International,Inc.
Eastman ChemicalCompany
Saskatchewan PowerCorporation
Leopold Kostal GmbH& Co. KG
Respironics, Inc.Forest Laboratories, Inc.Husky Energy Inc.ColesWeidmüller
Pratt & Whitney CanadaInc.Mahindra Mahindra
ADCTelecommunications,
Inc.Electricity Supply BoardVNG Verbundnetz Gas
AG
BOC Group Plc.Diageo Plc.First EnergyPirelli & C. S.p.A.Kimberly Clark
Agilent Technologies,Inc.CenterPoint Energy, Inc.City Power
Johannesburg (Pty) Ltd.Migros-
Genossenschafts-BundISE Innomotive
Systems Europe GmbH
UPM-Kymmene OyjGoodrich CorporationAir LiquideJumbo Markt AGW.W. Grainger, Inc.
Puget Sound Energy,Inc.Baldor Electric CompanyPick 'n Pay Retailers
(Pty) Ltd.Bundesamt für Bauten
und LogistikE.I. DuPont de
Nemours & Co., Inc.
T-Mobile USA, Inc.MarsWalMartKnorr-BremseEon AG
School Board of PolkCounty
Stadtwerke DüsseldorfAG
Holcim Group SupportLtd.
OesterreichischeKontrollbank
KLA-TencorCorporation
PetrobrasGie CegetelKao CorporationSmithfield FoodsDegussa AG
Federal Prison IndustriesDisney WorldwideServices, Inc.Service Birmingham Ltd.The Coca-Cola
CompanyKommunalkredit Austria
AG
IGTSolectron CorporationAstellasTelekom Austria AGBurberry Limited
Nordson CorporationNippon Paper IndustriesCo., Ltd.
British Nuclear FuelsPlc.
SPAR Österr.Warenhandels AG
HeidelbergerDruckmaschinen
Homebase LimitedMicrosoft CorporationVodafone Group Plc.Solvay SAEndress & Hauser
R.J. Reynolds TobaccoCompany
Anheuser-BuschCompanies, Inc.
GB Gas HoldingsLimited
Provinzial NordWestHoldingBehr GmbH & Co. KG
WorldbankEMI Group Plc.Bekaert N.V.Edeka AGSchaeffler KG
Bold = SAP Reference Program
© SAP 2008 / Page 20
Option 1
E2E Integration Testing of SAP SolutionsOptions for SAP Customers
Business Blueprint
Test PlanningTest System Setup
Test Execution Apply Changesto Production
Change ImpactAnalysis
SAP SolutionUpdate
New SAPSolution
Solution ManagerTest Workbench
Test planning
Solution ManagerBusiness Blueprint
Solution ManagerTest Workbench
Manual testing
Solution ManagereCATT
Solution ManagerBusiness ProcessChange Analyzer *
Application-logic Tests
TestPartner
QTP
eCATT
UI based Tests
* planned for Q4 2008
Setup of businessprocess catalog
Businessrequirements
Identification ofprocesses affectedby code / customizingchanges
Admin ofautomated tests
SAP TDMS
Setup of leantest systems
QTP
Test Scope IdentificationType of Change
Automated Tests
© SAP 2008 / Page 21
SAP Solution ManagerNew Workcenter for E2E Integration Testing
Status Reporting
Workcenter: Role-specific entry point for all test related activities
Test Coordinator
Quality Expert
Tester
VP of Q&A
© SAP 2008 / Page 22
SAP Solution ManagerTest Management via SAP Test Workbench
SAP Test Workbench
Test Plan: Generation from BusinessProcess Hierarchy (Blueprint)Test Cases: Definition of manual andautomated Test CasesTest Packages: automatic generation oftest packages and distribution to testersExecution of manual and automatedtestsIncident Management: Service DeskintegrationReporting: Comprehensive test statusreporting including SAP BI
© SAP 2008 / Page 23
SAP Solution ManagerSAP Test Workbench: Test Sequences
Test Plan
Test Package Tester 1
Tester 2Test Case 1
Test Case 2Test Case 3 Tester 3
Classic approach:
Several Testers (Tester Pool)are assigned to severalTest Cases (Test Package)
New approach:
In addition to classic approachyou can assign directly a TestCase to a Tester and thesequence of test cases canbe process as workflow
Test Plan
Test Package Tester 1
Tester 2Create Sales Order
Create Outb. Del.
Create Billing Doc. Tester 3
1.2.
3.
Example: As soon Test Case 1 successfully tested by Tester 1, Tester 2 will be notified that Test Case 2 is ready to be tested
Benefit: Allows to define cross area end-to-end integration test scenarios where testerswith different skills need to test in the right sequence.
© SAP 2008 / Page 24
SAP Solution ManagerSAP Test Workbench: Test Sequences - Execution
Worklist of tester 1 - 1st test case of each test sequence is ready to test1 Processing of first test case andsetting status to ‘OK’
2
2nd test case of sequence #1 is ready to test3
Tester assigned to 2nd test of sequence #1 gets an E-Mail notification4
© SAP 2008 / Page 25
Workflow Based on Test Plan Status
Tester‘s worklist before release of test plan1
Testers receives E-Mail notification3
Test Coordinator sets test plan status to released2
Tester‘s worklist after release of test plan – ready for test4
© SAP 2008 / Page 26
SAP Solution ManagerSAP Test Workbench: Test Plan - Release Status Schema
Test plan is closed forchangesTest plan is closed forexecution
Test plan is open forchangesTest plan is closed forexecution
Test plan is closed forchangesTest plan is open forexecution
ProtectedNew Released
Example to highlight the benefit for test plans
After TestBefore Test During TestPhase
Status
Impact
Automated E-Mail notificationto all Tester
that test execution phaseis started
Automated E-Mail notificationto all Tester
that Test execution phase has ended
This can be combined with a Digital Signature strategy for compliance reason, wherethe Test Coordinator need to sign relevant status changes
© SAP 2008 / Page 27
Option 1
E2E Integration Testing of SAP SolutionsOptions for SAP Customers
Business Blueprint
Test PlanningTest System Setup
Test Execution Apply Changesto Production
Change ImpactAnalysis
SAP SolutionUpdate
New SAPSolution
Solution ManagerTest Workbench
Test planning
Solution ManagerBusiness Blueprint
Solution ManagerTest Workbench
Manual testing
Solution ManagereCATT
Solution ManagerBusiness ProcessChange Analyzer *
Application-logic Tests
TestPartner
QTP
eCATT
UI based Tests
* planned for Q4 2008
Setup of businessprocess catalog
Businessrequirements
Identification ofprocesses affectedby code / customizingchanges
Admin ofautomated tests
SAP TDMS
Setup of leantest systems
QTP
Test Scope IdentificationType of Change
Automated Tests
© SAP 2008 / Page 28
E2E Integration Testing of SAP SolutionsTest Automation via SAP eCATT
Testing of complex business process scenarios like Order-to-Cash and Procure-to-PayAdvanced functionality to test backend business logic(function modules, eSOA services, test result verification at SAP table / database level, result comparison with previous runs, …)
Central definition via SAP Test Workbench combined with execution in distributed systemsCentral repository for test dataIntegration of 3rd party test automation tools for UI-based tests, e.g. CRM, Enterprise Portal
Strengths
Sales Order Billing &Payment Receipts
Return &Complaint Handling
Delivery &ShipmentBusiness Processes
eCATT Test Automation eCATTScript 1
eCATTScript 2
eCATTScript 3
eCATTScript 4
Test Data Container
SAP System Landscape
Landscape 1 (Dev)
Landscape 2 (Test)
…
ParameterParameter Parameter
CRM Test 2CRM Test 2 R/3 Test 2R/3 Test 2 ERP Test 2ERP Test 2
CRM Dev 1CRM Dev 1 R/3 Dev 1R/3 Dev 1 ERP Dev 1ERP Dev 1
Import
included in1 eCATTMaster Script
© SAP 2008 / Page 29
eCATT Test ConfigurationComposite Processes and Applications
SAP HCM
Packaged Solutions andDeployment View
Functional andProcess Component View
Product DataManagement
LeadProcessing
Sales OrderProcessing
OpportunityProcessing
PersonelAdministration
PayrollProcessing
DemandPlanning
Service PartsPlanning
SAP ERP
SAP CRM
SAP SCM
CompositesHigher flexibility and fasterapplication lifecycle lowers potentialfor automated testing (Effort BenefitRatio)Different UI technologies(Web Dynpro, Adobe Forms, …) tobe supported by test tools
Application LandscapeDecoupled UI from back-end allowsdecoupling of test activitiesHigh potential for automatedregression testing of Web-Serviceswithout UI
Web-Services
Calls
E2E Integration Testing of SAP SolutionsTest aspects of eSOA based Composite Applications
© SAP 2008 / Page 30
E2E Integration Testing of SAP SolutionsTest aspects of eSOA based Composite Applications
Decoupled UI from back-end allows decoupling of test activities in same test frameworkTesting the Web Service in parallel of implementing / changin the CompositesSeveral variants of test data for both steps
Testing of Backend WebServices via eCATT
Implement/Change of Backend
Web Services
Implement/ChangeComposite
Application
Testing of CompositeApplication
SAP Solution Manager
Business Blueprint
SAP Solution ManagerBusiness Process Change
Analyzer*
SAP Solution Manager
Test WorkbenchSAP Solution Manager
Test Workbench
HP: QTPCPWR:TestPartner
SAP Solution ManagereCATT
UI based Tests
eCATT:ApplicationLogic Tests
Backend Tests
SAP TDMS
Automated TestsManual TestsTest PlanningTest Scope Identification
Test Prep. and Planning
© SAP 2008 / Page 31
E2E Integration Testing of SAP SolutionsTest aspects of eSOA based Composite Applications
Intregrated E2E Regression TestingReusage of test dataSeveral variants of test data for all phases
Testing of Backend WebServices via eCATT
Implement/Change of Backend
Web Services
Implement/ChangeComposite
ApplicationTesting of Composite
Application
Repeat test with several variantsincl. negative tests
FurtherChecks
Test Prep. and Planning
SAP Solution Manager
Business Blueprint
SAP Solution ManagerBusiness Process Change
Analyzer*
SAP Solution Manager
Test WorkbenchSAP Solution Manager
Test Workbench
HP: QTPCPWR:TestPartner
SAP Solution ManagereCATT
UI based Tests
eCATT:ApplicationLogic Tests
Backend Tests
SAP TDMS
Automated TestsManual TestsTest PlanningTest Scope Identification
© SAP 2008 / Page 32
BackendSystem Web
Services
E2E Integration Testing of SAP SolutionsComposite Applications Example for Order to Cash
Sales OrderProcessing
OutboundDelivery
Customer Service Rep
Billing
Customer Service RepWarehouse Clerk
Customer built composites:based on SAP Composite: e.g. Inventory Level Replenishment (xILR) * - Simplified View
FindCustomer
ViewCustomer
Details
FindCustomer
spec. Products
Read/UpdateCustomer
spec. Products
CreateSales Order
*Details on: https://wiki.sdn.sap.com/wiki/display/ESpackages/Order+to+Cash
Step 1 Step 2 Step 3 Step 4 Step 5 Step 6 Step 7 Step 8 Step 9
Webservice Calls
Customer ID Customer ID Product ID
Customer ID
Product ID
Customer ID
Product ID
Customer ID
Product ID
Customer ID
Product ID
Customer ID
Data Flow
© SAP 2008 / Page 33
eCATT Test configuration
BackendSystem
*Details on: https://wiki.sdn.sap.com/wiki/display/ESpackages/Order+to+Cash
Step 2 Step 3 Step 4 Step 5 Step 9
Webservice Calls
Test Scripts
Test Data Containers
Test ParameterImport Export Import Export Import Export Import Export Import Export
Check
Import Export
Test Variants
Customer Product
WebServices Find
Customer
ViewCustomer
Details
FindCustomer
spec. Products
Read/UpdateCustomer
spec. Products
CreateSales Order
Customer NameCustomer Name Product NameProduct Name QuantityQuantity Expected priceExpected price
E2E Integration Testing of SAP SolutionsTesting a Service enabled Business Process using SAP eCATT
© SAP 2008 / Page 34
1. SAP’s approach to End-to-End Integration Testing
2. Test Capabilities Option 1
3. Test Capabilities Option 2
4. SAP Testing Services
Agenda
© SAP 2008 / Page 35
E2E Integration Testing of SAP SolutionsTest capabilities for functional testing
Business Blueprint
Test RequirementsTest Planning
Test Execution Deploy Changesto Production
Change ImpactAnalysis
SAP SolutionUpdate
New SAPSolution
Functional test capabilities for SAP customer with heterogeneous solution landscape
Quality CenterTest requirementsTest planning
Solution ManagerBusiness Blueprint
Solution ManagerBusiness ProcessChange Analyzer *
Quality Center
Quality Center
SAP TAOAccelerated testcomponent generation
SAP TDMS
Setup of leantest systems
Test Scope IdentificationType of Change
Identification ofbusiness processesaffected by code /customizing changes
Setup of businessprocess hierarchy
Business requirements
Test LabDefect management
Business Process TestsQuick Test Pro
LoadRunnerPerformance Tests
* planned for Q4 2008
© SAP 2008 / Page 36
SAP Solution ManagerSAP Solution Manager Adapter for SAP Quality Center by HP
SAP Solution ManagerAdapter
SAP Quality Center by HP
SAP Solution Manager Adapter for SAP Quality Center by HPintegrates application lifecycle management capabilities of SAP
Solution Manager with test planning and test execution capabilities ofSAP Quality Center by HP
OutboundBusiness BlueprintBus.Requirements
InboundTest ResultsDefects
© SAP 2008 / Page 37
SAP Quality Center by HPRequirements Management
Key benefitsAllow business analysts,testers and developers tocollaborate on applicationrequirementsAssess overall risk to thebusiness through real-timevisibility of test coverageand associated defects
Key capabilitiesTrack multiple requirementstypes and analyzerequirements changeimpactFull traceability fromrequirements to tests anddefectsLeverage existing assets inMS Word
Define multiple requirements types and interdependencies
© SAP 2008 / Page 38
SAP Quality Center by HPRequirements Management – Test Planning
Automatically generate Test Cases from SAP Business Blueprint
3
21 Select business process structure Wizard to create test plan structure and test cases
Test Plan with (empty) test cases linked totest requirements.
© SAP 2008 / Page 39
SAP Quality Center by HPRequirements Management
Key benefitsAllow business analysts,testers and developers tocollaborate on applicationrequirementsAssess overall risk to thebusiness through real-timevisibility of test coverageand associated defects
Key capabilitiesTrack multiple requirementstypes and analyzerequirements change impactFull traceability fromrequirements to tests anddefectsLeverage existing assets inMS Word
Define multiple requirements types and interdependencies
© SAP 2008 / Page 40
SAP Quality Center by HPTest Planning
Key benefitsManage test strategiesand processes based onbusiness riskEnable centralizedmanagement of manualand automated test assetsEnsure all business criticalrequirements are plannedfor testing
Key capabilitiesDevelop, manage and planmanual and automatedtests including custom testtypesOut –of-the-box integrationwith QuickTest Pro,LoadRunner, …Real-time test status andprogress reportingBidirectional traceabilityallows trackingrequirement and defectcoverage
Manage test cases based on business and test requirements
© SAP 2008 / Page 41
SAP Quality Center by HPTest Lab
Definition of Execution Flow (test case sequence)
© SAP 2008 / Page 42
SAP Quality Center by HPTest Lab and Defects
Test Case execution
Defect creation
© SAP 2008 / Page 43
SAP Quality Center by HPDefects
Defect reporting
Defect reporting
© SAP 2008 / Page 44
SAP Quality Center by HPReport, Graphs and Dashboards
Key benefitsMake business decisionsbased upon holistic viewacross allquality initiativesAllocate resources based uponcurrent progress and status ofapplication releasesReport progress on test cycles
Key capabilitiesCustom, role-based, shareablereportsCoverage graphs with drilldown capabilityMS Word and Excel formats toshare data with non-QC users
Real time progress, status and release views
© SAP 2008 / Page 45
SAP Loadrunner by HPPerformance Testing
Key benefitsEasy-to-use solutionMost comprehensive environmentsupportIntegrated analysis with transactionbreakdown analysis under loadRich analysis engine, includingautomatic correlation
Key capabilitiesReplaces real users with thousands of“virtual” usersGenerates accurate, measurable andrepeatable load on the system from asingle point of controlPinpoints bottlenecks in the system
Emulates production workloads on an IT system
© SAP 2008 / Page 46
E2E Integration Testing of SAP SolutionsTest capabilities for functional testing
Business Blueprint
Test RequirementsTest Planning
Test Execution Deploy Changesto Production
Change ImpactAnalysis
SAP SolutionUpdate
New SAPSolution
Functional test capabilities for SAP customer with heterogeneous solution landscape
Quality CenterTest requirementsTest planning
Solution ManagerBusiness Blueprint
Solution ManagerBusiness ProcessChange Analyzer *
Quality Center
Quality Center
SAP TAOAccelerated testcomponent generation
SAP TDMS
Setup of leantest systems
Test Scope IdentificationType of Change
Identification ofbusiness processesaffected by code /customizing changes
Setup of businessprocess hierarchy
Business requirements
Test LabDefect management
Business Process TestsQuick Test Pro
LoadRunnerPerformance Tests
* planned for Q4 2008
© SAP 2008 / Page 47
SAP TAOMission, Approach, Integration and Customer Benefits
Customer SAP LandscapeCustomer SAP Landscape
Integration
Changing the testing paradigm from manualtesting to „Testing by Composition“
Reducing costs and risks for testing after SAPsolution updates
Automatic generation of test components forSAP business processes via SAP TAO
Composition of automated test cases viastandard functionality of SAP Quality Center byHP
Approach
Mission
HP Quality Suite (QC, BPT, QTP)
SAP Solution Manager
SAP TAO
Application lifecycle management
Test component generation
Test planning, test case composition and testexecution
Customer Benefits1. Reduced effort for
maintaining automatedbusiness process tests
2. Reduced risk due tobetter testing coverage
3. Increased capacity toabsorb /manage change
4. Tight integration withSAP Solution Manager
Customer Benefits1. Reduced effort for
maintaining automatedbusiness process tests
2. Reduced risk due tobetter testing coverage
3. Increased capacity toabsorb /manage change
4. Tight integration withSAP Solution Manager
© SAP 2008 / Page 48
SAP TAO Frontend
SAP TAO Agent
Customer SAP Test Systems
User selects Business Processes
Automatic inspection of SAP Transactions
Automatic generation of Test Components
CRMCRMR/3R/3ERPERP SAP Business Process
SAP Quality Center by HP
4
1
2
3
Inspect
Upload to Quality Center
5 User composes Test Case
Test Case execution6
SAP TAOApproach for accelerated Test Case Composition
© SAP 2008 / Page 49
drag & drop
Composition ofautomated test cases
Based on SAP TAOtest components
SAP TAO and Quality Center (BPT)Composition of automated test cases
© SAP 2008 / Page 50
Execution ofautomated test cases
QTP simulates thebevaviour of anenduser
SAP TAO and Quality Center (QTP)Execution of automated test cases
© SAP 2008 / Page 51
SAP TAOApproach for Test Case update after SAP Solution change
Quality Center TestComponent Library TEST
CASE
TESTCAS
E
TESTCAS
E
TESTCAS
E TESTCAS
E
CHANGED
CHANGED
CHANGEDX XX
© SAP 2008 / Page 52
SAP TAOApproach for Test Case update after SAP Solution change
Quality Center TestComponent Library TEST
CASE
TESTCAS
E
TESTCAS
E
TESTCAS
E TESTCAS
E
CHANGED
CHANGED
CHANGEDX XX
Re-Inspection of impacted SAP Transactions
Update ofTesting Components
Test Cases are Up to Date !Test can be executed successfully
POTENTIALLY :Maintain Process Flow / Test Data
2
Identify impactedSAP Transactions *
13
4
* Planned for SAP Solution Manager 7.0 SP18
© SAP 2008 / Page 53
1. Customer changes SAP Solution
2. SAP Business Process Change Analyzer identifies affected Business Processes
3. Re-inspection of damaged Test Components with SAP TAO
4. Upload to Quality Center and semi-automatic update of Test Case
5. Add test data – if required
6. Test cases ready for execution
Accelerated Update of damaged Test Cases
SAP TAO helps customers to lower maintenance costs ofautomated business process tests
SAP TAOApproach for Test Case update after SAP Solution change
© SAP 2008 / Page 54
SAP TAOCapabilities SAP TAO Release 1.0
ScopeAssignment of Business Processes via list of SAP Transactions
Test Component generationSAP TAO Inspection: Automatic background inspection of SAPGUI basedTransactions and generation of Test ComponentsSAP TAO UI Scanner: Frontend scanning of user selected SAPGUIuser-interfaces
Integration with SAP Quality Center by HPAutomatic Upload of Test Components to Quality Center
OtherPre-build generic test components available in Quality CenterLanguages: English
© SAP 2008 / Page 55
SAP TAO Roadmap
SAP TAO 1.0June 2007
SAP TAO 2.0planned for Q3 2009 (1)
SAP TAO Patch 1.0.10Aug 2008
Functionality: Generation oftest components for SAPGUIbased transactions via SAPTAO Inspector and UIscanner. Consolidation of testcomponents. Upload to SAPQuality Center by HP.
Regional availability: NorthAmerica - extended to allregions in March 2008.
Improvements
Software correction andimproved user handling
New user guide
Extendeddocumentation fordelivered SAP TAO testcomponents
Streamlined SAP TAOuser-interface: UIScanner integrated inSAP TAO Frontend
This document contains intended strategies, developments and/or functionality and is not intended to bebinding upon SAP to any particular course of business, product strategy and/or development. Please notethat this document is subject to change and may be changed by SAP at any time without notice.
Status: planned
Planned functionality
Process Flow Analyzer forstreamlined identification andgeneration of test components
Change Analysis for automatedtest cases based on SAP TAOvia Business Process ChangeAnalyzer
Improved handling of SAP TAOconsolidation
1) SAP TAO delivery dates are subject to change and will becoupled with SAP Solution Manager 7.0 SPs or EhPs
2) An additional Function Pack might be shipped before SAPTAO Release 2.0
Notes:
© SAP 2008 / Page 56
SAP TAO
Customer Benefits
Automated Business Process TestingAccelerated way to automate business process testing
Lower RiskLower risk after SAP Solution updates due to better testing coverageIncreased capacity to manage change
Lower Maintenance CostsComponent-based Test Cases allows accelerated update of damaged test cases
IntegrationTight integration between SAP Solution Manager, SAP TAO and SAP QualityCenter by HP
© SAP 2008 / Page 57
E2E Integration Testing of SAP SolutionsTest Capabilities
Customers have various options
Test Option 1Test capabilities provided by SAP SolutionManager with integration of testautomation tools from partners
Recommended for SAP-centric customers
Test Option 2Test capabilities provided by SAPSolution Manager, SAP QualityCenter by HP and SAP TAO
Recommended for customers withheterogeneous system landscape
© SAP 2008 / Page 58
1. SAP’s approach to End-to-End Integration Testing
2. Test Capabilities Option 1
3. Test Capabilities Option 2
4. SAP Testing Services
Agenda
© SAP 2008 / Page 59
Global Testing Solutions
Our mission is to...
…provide Testing Services/Solutions
…deliver Functional & Performance Testing
…support and maintain customer testingenvironments
© SAP 2008 / Page 60
Global Testing Solutions
Target Testing Services Portfolio
2
1
3
4
5
6
7
Advisory & StrategyQA & Test Advisory, Audit, Methodology, Approach &Strategy Services
Test Project ManagementDay-to-day Delivery Management
Test Analysis & POCTest Analysis & Execution
Performance TestingDelivery Frameworks, Script Analysis, Build Out &Execution
Functional AutomationAutomation Frameworks, Script Analysis, Build Out &Execution
Environment ManagementChange Configuration & Release Management, Data& Environment Solutions, Visualization etc.
Training & EnablementSAP Test Solution Training & Partner Enablement
Contact: Martin KanissGlobal Testing Portfolio Lead, [email protected]
© SAP 2008 / Page 61
InformationE2E Integration Testing: http://service.sap.com/testingSAP TAO: http://service.sap.com/saptaoSAP Solution Manager: http://service.sap.com/solutionmanager
SAP Solution Manager e-learning material: http://service.sap.com/rkt-solman
E2E Integration Testing of SAP SolutionsInformation and SAP Contacts
Regional SAP ContactsAmericas
[email protected] Product Information and Solution [email protected] Professional Services
[email protected] Product Information and Solution [email protected] Professional [email protected] Professional Services
[email protected] Product Information and Solution Sales
© SAP 2008 / Page 62
Copyright 2008 SAP AGAll Rights Reserved
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changedwithout prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.
SAP, R/3, xApps, xApp, SAP NetWeaver, Duet, SAP Business ByDesign, ByDesign, PartnerEdge and other SAP products and services mentioned herein as well as their respective logos aretrademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned and associated logos displayed arethe trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.
The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior writtenpermission of SAP AG. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies,developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note thatthis document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant theaccuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express orimplied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.
SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitationshall not apply in cases of intent or gross negligence.
The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in thesematerials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.
Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die ausdrückliche schriftliche Genehmigung durchSAP AG nicht gestattet. In dieser Publikation enthaltene Informationen können ohne vorherige Ankündigung geändert werden.
Einige von der SAP AG und deren Vertriebspartnern vertriebene Softwareprodukte können Softwarekomponenten umfassen, die Eigentum anderer Softwarehersteller sind.
SAP, R/3, xApps, xApp, SAP NetWeaver, Duet, SAP Business ByDesign, ByDesign, PartnerEdge und andere in diesem Dokument erwähnte SAP-Produkte und Services sowie diedazugehörigen Logos sind Marken oder eingetragene Marken der SAP AG in Deutschland und in mehreren anderen Ländern weltweit. Alle anderen in diesem Dokument erwähnten Namen vonProdukten und Services sowie die damit verbundenen Firmenlogos sind Marken der jeweiligen Unternehmen. Die Angaben im Text sind unverbindlich und dienen lediglich zuInformationszwecken. Produkte können länderspezifische Unterschiede aufweisen.
Die in dieser Publikation enthaltene Information ist Eigentum der SAP. Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Formauch immer, nur mit ausdrücklicher schriftlicher Genehmigung durch SAP AG gestattet. Bei dieser Publikation handelt es sich um eine vorläufige Version, die nicht Ihrem gültigen Lizenzvertragoder anderen Vereinbarungen mit SAP unterliegt. Diese Publikation enthält nur vorgesehene Strategien, Entwicklungen und Funktionen des SAP®-Produkts. SAP entsteht aus dieserPublikation keine Verpflichtung zu einer bestimmten Geschäfts- oder Produktstrategie und/oder bestimmten Entwicklungen. Diese Publikation kann von SAP jederzeit ohne vorherigeAnkündigung geändert werden.
SAP übernimmt keine Haftung für Fehler oder Auslassungen in dieser Publikation. Des Weiteren übernimmt SAP keine Garantie für die Exaktheit oder Vollständigkeit der Informationen, Texte,Grafiken, Links und sonstigen in dieser Publikation enthaltenen Elementen. Diese Publikation wird ohne jegliche Gewähr, weder ausdrücklich noch stillschweigend, bereitgestellt. Dies gilt u. a.,aber nicht ausschließlich, hinsichtlich der Gewährleistung der Marktgängigkeit und der Eignung für einen bestimmten Zweck sowie für die Gewährleistung der Nichtverletzung geltenden Rechts.SAP haftet nicht für entstandene Schäden. Dies gilt u. a. und uneingeschränkt für konkrete, besondere und mittelbare Schäden oder Folgeschäden, die aus der Nutzung dieser Materialienentstehen können. Diese Einschränkung gilt nicht bei Vorsatz oder grober Fahrlässigkeit.
Die gesetzliche Haftung bei Personenschäden oder Produkthaftung bleibt unberührt. Die Informationen, auf die Sie möglicherweise über die in diesem Material enthaltenen Hotlinks zugreifen,unterliegen nicht dem Einfluss von SAP, und SAP unterstützt nicht die Nutzung von Internetseiten Dritter durch Sie und gibt keinerlei Gewährleistungen oder Zusagen über InternetseitenDritter ab.
Alle Rechte vorbehalten.