BPT & QTP

MercuryBusiness Process Testing

Faster, Easier and Smarter Quality Assurance

SPAN Technologieswww.spantechnologies.com

Copyright: SPAN Technologies and Mercury 2006.2

Agenda

Objective

BPT: Other Benefits

Challenges with Traditional Automation

BPT: the Big Picture

BPT Addresses Traditional Automation Challenges

Need for Automation

Case Studies

Q & A


Objective

To promote an understanding of business process Testing and its benefits for:

– Users considering Mercury tools for automation– Existing users of QTP and Quality Center – Users who recently acquired BPT

Demographics

Automation Experts

SystemArchitects

LOBOwners

Managers

Directors

Testers


Need for AutomationRapid execution of test scriptsRepeatable, reliable, unattended testingExtensive enterprise environment and test plan coverageAccurate defect replication

5

4

6

1

Data Sets

Business Processes

Front End Clients

Operating Systems

Combinations of various usernames, passwords, search strings, order numbers, ship dates

Login, Search, Order Entry, Order Confirmation, Order Fulfillment

Internet Explorer 6, Netscape 6, Java, Visual C++

Windows XP, Windows ME, Win 2000, Win NT 4, Win 2003

Platforms Intel

15

Total Tests to Run 1 X 6 X 4 X 5 X 15 = 1,440



Subject Matter Experts design requirements and test cases very early in the life cycle. Test Automation requires a fairly stable application, which is not available till much later in the life cycle.

– Duplication of effort in documentation and application expertise– Lack of collaboration between SMEs and Automation Experts– Planning for automation does not start till stable application is available

Test AutomationSubject Matter Experts

Business Requirements

SMEs and Automation Experts Are Disjointed



SME

Tester

Automation Expert

Not role-based—too many overlaps in duties

Lack of standards in automation

Decentralized—inefficient use of resources

Project 1QTP Experts

Project 2QTP Experts

High maintenance without intelligent framework


SummaryLack of collaboration between SMEs and automation experts




High maintenance without an intelligent framework


How does BPT address these challenges?


BPT: the Big PictureMercury Quality Center™

Dashboard

TestDirector

RequirementsManagement Test Plan Test Lab Defect

Management

Functional Testing

QuickTest Professional WinRunner

Business Process Testing

Accelerators for SAP, Oracle, Security

Delivery Options

Mercury Managed Services In-house Deployment Combination

Shared Data Repository Central Administration Workflows Open APIs

Foundation



Traditional Automation


Planning, automation framework

Requirements and design

and test documentation

Development and initial

build

Automation Framework

Map objects Run tests

Modifytests

Automation

DevelopersSMEs QTP Experts QTP Experts QTP Experts

Run tests

SMEs,Testers

Planning, build components, flows

SMEs

Automation

QTP Experts

SMEs,Testers

Testers, QTP

Experts

Modify tests

QTPExperts


BPT: the Big PictureAdditional Quality Center moduleA layer of abstraction between Requirements and Test PlansStructurally, Business Components are similar to reusable functions and actions in QTP


BPT: the Big PictureSME Creates and Defines Business Components


SME Creates and Defines Business ComponentsSME Creates and Defines Business ComponentsBPT: the Big PictureSME Assembles Business Components into Tests


BPT: the Big PictureSME Can Reuse Business Components in Multiple Tests

Login Component

Test Four

Test ThreeTest Two

Test One



QTP experts work behind the scenes creating the automation assets for the business components created by SMEs

– Implement function libraries– Create object repositories– Define application areas– Define recovery scenarios– Manage all resources in Quality Center

In this model, QTP experts focus purely on automation, with minimal knowledge of the application. SMEs/Testers then assemble and execute the tests and analyze the results.

QTP Experts Build the Automation Assets



Once the automation assets have been developed by the QTP expert, automation is just a matter of using the keyword-driven approach to create test scripts

Easy Keyword-driven Approach for Automation


Summary RevisitedLack of collaboration between SMEs and automation experts




High maintenance without an intelligent framework


How does BPT address these challenges?


BPT Addresses Traditional Automation ChallengesEnables Collaboration of Business Users, Technical Automation Engineers

Automation Experts

Centralized QA automation experts enable business

experts via Mercury Business Process Testing

Subject Matter Experts

Subject-matter experts build, data-drive, and

execute automated tests via web

Mercury Business Process Testing

Business Requirements Data Application

Keywords

Login Component

Invoice Component

PO Component

Early automation Collaboration Reuse of documentation


BPT Addresses Traditional Automation ChallengesRole-based Testing—Optimal Use of Resource Time

Optimal use of expertise Clear definition of roles

Defines business processesDefines and implements the componentsCombines the ready components into complete processes

SME

Builds the object repositoryBuilds user-defined functionsBuilds application areasBuilds recovery scenarios

QTP Expert

Runs and analyzes test results

Tester


Centralized and Standardized


Each project has its own SMEs and testers, but shares centralized automation experts with other projects in the organization

– Need for fewer specialized automation experts, efficient use ofresources

– Facilitates efficient use of third-party vendors for automation– Sharing of knowledge and best practices between projects– Easier to implement automation standards given a central team

Standardized automation Efficient use of resources



BPT entails the use of business components as building blocks for more complex business scenarios. This built-in framework enforces modularization.

– When the application changes, all test scripts do not need to change.

– Typically, business components do not change in a logical sense,only the underlying application and objects

– Maintenance is quick and behind-the-scenes

Built-in Framework Reduces Maintenance

Reduces maintenance Enforces modularization


BPT: Other Benefits

Traditional Automation


Planning, automation framework

Requirements and design

and test documentation

Development and initial

build

Automation Framework

Map objects Run tests

Modifytests

Automation

DevelopersSMEs QTP Experts QTP Experts QTP Experts

Run tests

SMEs,Testers

Planning, build components, flows

SMEs

Automation

QTP Experts

SMEs,Testers

Testers, QTP

Experts

Modify tests

QTPExperts


BPT: Other BenefitsBusiness Sign-offSince the SMEs are involved in the creation of test scenarios, automation will make intuitive sense to them. This facilitates easier business sign-offs

Auto-DocumentationSingle point of entry for documentation combined with the auto-documenting features of BPT will dramatically reduce the documentation effort.

ScalabilitySince this model is not build around individual contributors, it is highly scalable. Efficient use of resources and a centralized model contributes to the scalability as well.

Faster, easier and smarter quality assurance


Mercury Business Process TestingThe Business-centric Quality Automation Solution

Provides entire QA team with collaborative solution

Provides entire QA team with collaborative solution

Starts quality automation process sooner

Starts quality automation process sooner

Automates maintenance and reduces costs

Automates maintenance and reduces costs

Ensures visibility and verification with auto-documentation

Ensures visibility and verification with auto-documentation


Raymond James

Business Teams unable to use traditional test automation tools QA team unable to handle volume of application changesBuy vs. build test automation framework

Challenge

Mercury Quality CenterMercury Business Process Testing

Solution

Mercury Business Process Testing chosen as a result of buy vs. build feasibility studyTeam of 14 QA engineers and Business Analysts support 200+ Developers50% reduction in compatibility testing time Existing test automation assets leveraged with Mercury

Result

“Mercury Business Process Testing is our standard for functional testing. It enables our QA and Business Teams to operate as one, allowing the testing process to be more efficient and effective. ”

Leanne Stumph, QA Management

Leading US Financial Services Provider


Global Leader in Communications SystemsAvaya

Testing activity for billing app manual and documented in spreadsheetsText execution manual for string/functional and integration testingDefects, daily completion, and pass/fail stats tracked manually

Challenge

Mercury Quality CenterMercury Business Process Testing

Solution

Testing activities more aligned with needs of the businessTesting cycles shortenedTesting and resulting stats more accurate

Result

“Mercury Business Process Testing helps us align our project and testing teams so that line of business owners can set up the right business scenarios and tests for our applications. Instead of a long manual testing process, we now have an agile testing platform that keeps our applications finely tuned to support our business objectives and provide better service to our customers.”

Dave Bishop, Sr. Manager, IT Applications

Documents

BPT & QTP