What’s new hp automation tools

©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice

1

Heather Taylor – Sr Product Marketing Managerheather.taylor@hp.com

HP Software Test Automation Tools

What’s New

HP Unified Functional TestingHP Functional Testing (QuickTest Pro)HP Service Test

22

Modern Applications bring new Testing Challenges

3

What does the business want?

Base: 206 IT decision makers with insight into budgeted modernization activities. Source: Clearing Your Path to Modern Applications and Business Agility, Forrester Research, April 6, 2010. A Forrester Consulting thought leadership paper commissioned by Hewlett Packard.

Agility…

Innovation…

Lower cost…and a better application

experience

4

What does application modernization mean to QA?

Technology• Complex integrated

systems• Distributed components• Test GUIs, APIs, web

services and vertical integration

• RIA, Web 2.0

Process• Agile, iterative hybrids• Automate early without

GUI• Accommodate fast-paced

changes

People• Global, distributed teams• Pressure to expand skill

set or risk being outsourced

• More BA participation• Increase collaboration with

development

Asks• Shorten test cycles• Improve planning

estimates• Test more with less• Take on more technical

tasks• Improve collaboration• Align testing objectives

with overall business objectives

5

Test and Automate early for best outcome

C1 C1

C2

C1

C2

C3

G2

C1

C2

G1 G1

C3

C1

C2

G1

G3

G2

C3

C1

C2

G1

… …BP1

BP2

G3

G2

C3

C1

C2

G1

Regression test at the end of each iteration or as part of continuous build

Automate tests when available

components become stable

C GUI-less component

G GUI element

BP business process

stable component

6

Modern Applications have many layers

Exchange

Screen 5 (Java)

Screen 6 (.NET)

SAP

Screen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 Billing

Screen 1(Ajax)

Screen 2 (Java)

Graphical user

interface layer

Interact with modern GUI interfaces, Web 2.0

7

Modern Applications have many layers

Exchange

Screen 5 (Java)

Screen 6 (.NET)

SAP

Screen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 Billing

Screen 1(Ajax)

Screen 2 (Java)

Graphical user

interface layer

Headless Layer

Interact with modern GUI interfaces, Web 2.0

Continue the scenario to the headless layer; test the integration between the layers

Component 1(.Net API)

Component 2(Java API)

Component 3(web service)

Component 4(JMS service)

Component 5(web service)

Component 6(REST service)

8

Modern Applications have many layers

Exchange

Screen 5 (Java)

Screen 6 (.NET)

SAP

Screen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 Billing

Screen 1(Ajax)

Screen 2 (Java)

Graphical user

interface layer

Headless Layer

Interact with modern GUI interfaces, Web 2.0

Continue the scenario to the headless layer; test the integration between the layers

Component 1(.Net API)

Component 2(Java API)

Component 3(web service)

Component 4(JMS service)

Component 5(web service)

Component 6(REST service)

9

Modern Applications have many layers

Process Layer

A new transaction

Exchange

Screen 5 (Java)

Screen 6 (.NET)

SAP

Screen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 Billing

Screen 1(Ajax)

Screen 2 (Java)

End to end business process

Graphical user

interface layer

Headless Layer

Interact with modern GUI interfaces, Web 2.0

Continue the scenario to the headless layer; test the integration between the layers

Report on the quality of the entire end to end process

Component 1(.Net API)

Component 2(Java API)

Component 3(web service)

Component 4(JMS service)

Component 5(web service)

Component 6(REST service)

10

Modern Applications have many layers

Process Layer

A new transaction

Exchange

Screen 5 (Java)

Screen 6 (.NET)

SAP

Screen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 Billing

Screen 1(Ajax)

Screen 2 (Java)

End to end business process

Graphical user

interface layer

Headless Layer

Interact with modern GUI interfaces, Web 2.0

Continue the scenario to the headless layer; test the integration between the layers

Report on the quality of the entire end to end process

Component 1(.Net API)

Component 2(Java API)

Component 3(web service)

Component 4(JMS service)

Component 5(web service)

Component 6(REST service)

11

HP Software solutions multi-layer testing

Process Layer

A new transaction

Exchange

Screen 5 (Java)

Screen 6 (.NET)

SAP

Screen 3 (.NET)

Screen 4 (Ajax)

Web 2.0 Billing

Screen 1(Ajax)

Screen 2 (Java)

End to end business process

Graphical user

interface layer

Headless Layer

Component 1(.Net API)

Component 2(Java API)

Component 3(web service)

Component 4(JMS service)

Component 5(web service)

Component 6(REST service)

HP Unified Functional Testing

HP Unified Functional Testing includes the ability to test the GUI layer + the Headless layer + the end to

end process.

12

Unified Functional Testing

HP Service Test

HP Functional Testing

(QuickTest Professional& all the add-ins)

Call activities from the other

productTransfer data Unified report

HP Unified Functional Testing 11.00

13

HP QuickTest Pro script to call HP Service Test HP Unified Functional Testing integration

HP Service Test call in QTP

14

Unified report showing HP Service Test step

Shows activities from bothHP Functional Testing & HP Service Test

Multiple views of the flow

Full traceability for easier debugging

1515

HP Functional Testing (QTP)

16

What’s new with HP Functional Testing 11.00? (QuickTest Pro)

GUI and headless testing with Unified Functional Testing

Visual Object Identification

Web 2.0 and RIA support

Dev-QA collaboration with application log verification

Enhanced Reporting

Data Awareness to help Prepare and Manage Test Data

And More….

HP Restricted | Date or Rev. #17

Visual Identification of Objects

HP Functional Testing 11.00

18

Harden test scripts against changes in the application GUI

Visual Identification of Objects

– Record a test script to buy a Ferrari – yeah!

BUY

BUY

BUY

BUY

Ford

Honda

Fiat

Ferrari

// index = 0

// index = 1

// index = 2

// index = 3BUY

BUY

BUY

BUY

Ford

Honda

Fiat

Ferrari

// index = 0

// index = 1

// index = 2

// index = 3

MondayTuesday

TopGearCars.com

19

Harden test scripts against changes in the application GUI

Visual Identification of Objects

– Record a test script to buy a Ferrari – yeah!

– But! The object is in different position the nextday… you’re about to buy a Fiat – boo!

BUY

BUY

BUY

BUY

Ford

Honda

Fiat

Ferrari

// index = 0

// index = 1

// index = 2

// index = 3BUY

BUY

BUY

BUY

Ford

Honda

Ferrari

Fiat

// index = 0

// index = 1

// index = 2

// index = 3

MondayTuesday

TopGearCars.com

20

Harden test scripts against changes in the application GUI

Visual Identification of Objects

– Record a test script to buy a Ferrari – yeah!

– But! The object is in different position the nextday… you’re about to buy a Fiat – boo!

– QTP allows you to identify “key” and “fragile” objects and express a geometric relationship between them

BUY

BUY

BUY

BUY

Ford

Honda

Fiat

Ferrari

// index = 0

// index = 1

// index = 2

// index = 3BUY

BUY

BUY

BUY

Ford

Honda

Ferrari

Fiat

// index = 0

// index = 1

// index = 2

// index = 3

MondayTuesday

TopGearCars.com

21

Schematic Representation

Visual Identification of Objects

22

New Complex Visual Relationship IdentifierVisual Relation Identifier – object details

New VRI Object

Property

Clickto Add

23

Configure Relation

Visual Identification of Objects

Object Relation Preview on AUT

‘Static’ object

HP Restricted | Date or Rev. #24

Collaboration between Dev and QA using AUT Log Verification

HP Functional Testing 11.00

25

Leverage application log into the Functional Testing effort

Application Under Test (AUT) Log Verification

Detects issues of the AUT internal state

Supports Log4Net and Log4J

Enhances the test reports

Pass/fail a test according to log errors

Detailed defect description

26

Log Tracking Pane

Log tracking Report in the Run Results Viewer

HP Restricted | Date or Rev. #27

HP Functional Testing & HP Quality Center Integration

Data Awareness Capability

HP Functional Testing 11.00

28

Improved data management capabilities with HP Quality Center + HP Functional Testing

Share test data across tests and test scenarios

Run tests on a subset of the data; reporting is granular to the data row level

Requirements coverage can be granular to the test data level

Data source

Req 1

Req 2

Req 3 Test 3

Test 2

Test 1 Data set 1

Data set 2

Data Set 3

HP Restricted | Date or Rev. #29

Testing Web 2.0 and RIA

HP Functional Testing 11.00

30

Out of the box support

Community

Testing Web 2.0 and RIA

• Simpler & faster• Harness the power of

community• Aimed for Web 2.0 controls

Extensibility Accelerator

RIA

Ajax Toolkitsand more…

Extensibility

31

Out of the box support

Community

Testing Web 2.0 and RIA

• Simpler & faster• Harness the power of

community• Aimed for Web 2.0 controls

Extensibility Accelerator

RIA

Ajax Toolkitsand more…

Extensibility

32

Opening web extensibility to the online community: Extensibility Accelerator

33

Easy, wizard-like interface

Extends HP Functional Testing fast; uses Intellisense

Automated deployment

Free download from www.hp.com

Opening web extensibility to the online community: Extensibility Accelerator

34

Improved debugging capabilities

35

Additional Web support

– Support for Firefox on web extensibility objects−Run, Record, Learn, Spy

– Identify object according to the XPath and CSS– Automatically identify control using Xpath

HP Restricted | Date or Rev. #36

Enhanced Reporting

HP Functional Testing 11.00

37

Enhanced reporting and Run Results Viewer

Executive Summary

38

Enhanced reporting and Run Results Viewer

Executive Summary

Data

39

Enhanced reporting and Run Results Viewer

Executive Summary

DataPrevious

Run

40

Enhanced reporting and Run Results Viewer

Customizable panes

Quick high level overview

Collaborative report viewer – No need for a FT license

Recovery for corrupted reports

Executive Summary

DataPrevious

Run

HP Restricted | Date or Rev. #41

And more…

HP Functional Testing 11.00

42

New Menu and EvaluatorImproved regular expressions

New Regular Expression Evaluator

aids in writing and validating regular

expressions.

Works with the Object Repository,

Checkpoints and Recovery Scenarios

43

Object Spy Enhancements

Highlight the selected object

in the application

Copy object description

Add test object to current

repository

4444

HP Service Test

45

GUI

Why focus on testing the headless layer?

46

GUI

AquaLogic

BPMS

Tibco

TradingLogistics

Rules Engines

Reservations

JMS

Java.Net

WCF

XML JSON

Fix / Swift

Web servicesSOAP

Why focus on testing the headless layer?

47

• Bugs discovered earlier are cheaper and easier to fix

• Shorten late-stage testing cycles

Test earlier in the lifecycle

• Reduce test cycle time for services and consuming applications

Another opportunity for

automation

• Harden the building blocks of your applications

• Reduce risk in all layers of the application

Independent validation of services &

components

• …like performance, security, integrations, standards compliance and more

Can’t test all aspects through

the GUI…

Why focus on testing the headless layer?

48

HP Service Test 11.0

Services testing made easy

• Visual, intuitive test design

• Ready-to-use test activities

• Features for both technical and non-technical users

• Test headless layer without programming

• Powerful data driving• Simple security config.

Integrations with HP Software

• Multi-layer testing with HP QuickTest Professional

• Integration with HP Loadrunner

• Industry-leading test management with HP Quality Center

• Enhanced component test management using HP Service Test Management

Technology support

• Activities for HTML, WSDL, REST, JMS, Java, WS-Security, and more OOBox

• Add custom event handlers with .NET, C# and auto-completion

• Based on standard .NET framework

• Add support for additional technologies not supported out of the box

49

HP Service Test visual test designer

50

Visual Test Flow Designer

drag & drop canvas

51

Extensive Toolbox(Almost) codeless

testing

52

Activity Properties

53

Powerful Data Handling!

Supports text-based data tables, Excel,

XML

54

Configuring security

Straightforward security config for most common standards including WS-Security and WCF scenarios

55

Data driving Map fields in the property sheet to columns in the data table

Auto generate from the structure of the activity, or drive manually with existing file

56

Creating custom events

Choose from a list of events, or create custom event handlers

57

Custom event handlers

Auto-complete makes it easier to create custom event handlers

58

Custom event handlers

Auto-complete makes it easier to create custom event handlers

59

Custom event handlers

Auto-complete makes it easier to create custom event handlers

60

Custom event handlers

Auto-complete makes it easier to create custom event handlers

61

Custom event handlers

Auto-complete makes it easier to create custom event handlers

62

Custom event handlers

Auto-complete makes it easier to create custom event handlers

63

Custom event handlers

Auto-complete makes it easier to create custom event handlers

64

Join the community!

– www.hp.com/go/swcommunity

– The Future of Testing blog (swcommunity)

– www.hp.com/go/functionaltesting for more product information and product availability matrix

– LinkedIn groups for QC, BPT, QTP and Service Test (new!)

65

Thank you!