Productivity Acceleration Tools for SOA Testers

Evanthika Amarasiri : Technical Lead - QANirodha Gallage : Senior Software Engineer - QA

April 2013

About WSO2● Providing the only complete open source componentized

cloud platform- Dedicated to removing all the stumbling blocks to enterprise agility- Enabling you to focus on business logic and business value

● Recognized by leading analyst firms as visionaries and leaders- Gartner cites WSO2 as visionaries in all 3 categories of application infrastructure- Forrester places WSO2 in top 2 for API Management

● Global corporation with offices in USA, UK & Sri Lanka- 200+ employees and growing

● Business model of selling comprehensive support & maintenance for our products

150+ globally positioned support customers

Agenda

● Advantages of using tools for SOA testing

● Choosing the right tool that matches your requirement

● Test Scenarios

- soapUI

- Apache JMeter

● Tips on tools

Advantages of using tools & automation for testing

● No need to re-invent the wheel : Reduce time of writing

client programs from scratch

● Reduces time on frequent recursive testing

● Saves time to utilize the specialized knowledge effectively;

i.e. to do exploratory testing

● Reduces test execution time : Takes more time if done

manually

● Helps to release early & release often

● Reduces the possibility of missing test scenarios

● Ability to do dynamic data driven testing

Advantages of using tools & automation for testing

Contd...● Ability to do load/performance testing

● Can generate result summaries and reports easily

● Ability to integrate test suites in build systems and trigger

automatically

Choosing the right tool...

soapUI - What does it support?

● Automated request generation : i.e. Generate SOAP

request messages when WSDL is provided

● Ability to validate responses : i.e. assertions

● Support for QoS : i.e. Security, MTOM

● Ability to simulate service providers; i.e. mock services

● Ability to do performance testing

● Supports multiple protocols & message types : i.e. HTTP,

HTTPS, REST, JMS, JSON

Examples with soapUI

● Web Testcase support

● Invoking secured web services with HTTP basic authentication

● Invoking a web services secured with asymmetric binding policy

● Assertions for responses

● Sending HTTP chunk encoded messages

● Executing soapUI test suites/test cases in headless mode

● Testing RESTful APIs

Web Testcase support

● Allows to test solutions without ?wsdl

● Invoke simple HTTP methods; i.e. GET, POST, etc on

different services within the same project.

<GET https://192.168.217.1:9443/services/HelloService/greet?name=SoapUI HTTP/1.1Accept-Encoding: gzip,deflateAuthorization: Basic ZXZhbjplZWVlZWU=Host: 192.168.217.1:9443Connection: Keep-AliveUser-Agent: Apache-HttpClient/4.1.1 (java 1.5)

Basic Authentication

An example

Service Consumer

Service A

Service B

Service C

Service Provider

<GET https://192.168.217.1:9443/services/HelloService/greet?name=SoapUI HTTP/1.1Accept-Encoding: gzip,deflate

Host: 192.168.217.1:9443Connection: Keep-AliveUser-Agent: Apache-HttpClient/4.1.1 (java 1.5)

Signing SOAP messages● Asymmetric binding

- message security is provided using asymmetric keys

E.g.: public keys.

- assures confidentiality, integrity and the non-repudiation

Server's public key

Client's private key

Server's private key

Client's public key

Client signs the message from his private key and encrypts from server's public key

Server signs the message from his private key and encrypts from client's public key

Increase raw request/response size When raw view does not show large messages,

configure UI settings ...

... and it will increase

- size of raw request messages

- size of raw response messages

Assertions

● Validates responses

● Added to test steps

● Provides different types of assertions; assertions to be

done on response message, for HTTP status codes, SOAP

faults

Add Assertions

Sending chunked-encoded requests

● Content-Length

- The length of the request body in octetsPOST /services/Axis2Service HTTP/1.1Accept-Encoding: gzip,deflateContent-Type: text/xml;charset=UTF-8SOAPAction: "urn:echoInt"Content-Length: 3782Host: 127.0.0.1:9764Connection: Keep-AliveUser-Agent: Apache-HttpClient/4.1.1 (java 1.5)

POST /services/Axis2Service HTTP/1.1Accept-Encoding: gzip,deflateContent-Type: text/xml;charset=UTF-8SOAPAction: "urn:echoInt"Transfer-Encoding: chunkedHost: 127.0.0.1:9764Connection: Keep-AliveUser-Agent: Apache-HttpClient/4.1.1 (java 1.5)

● Chunked

- Messages are sent in chunks

Headless mode compatibility of soapUI

● Windows○ testrunner.bat -s Axis2Service_TestSuite -r -f C:\soapUI\logs\response -I

C:\soapUI\projects\my_soapui-project.xml

● Linux○ testrunner.sh -s Axis2Service_TestSuite -r -f /opt/soapUI/logs/response -I

/opt/soapUI/projects/my_soapui-project.xml

● Parameter lists the test suite to run

c the test case to run

r prints summary report

l ignore errors and continue

f folder to which test results should be saved

Testing RESTful APIs

● Scenario 1 - Invoke Login API of WSO2 API Manager

In which situations we can use JMeter?

● To simulate multiple user access/ load tests

● For data driven testing

● To analyze & measure performance of services

● To validate responses; i.e. assertions

● To create test suites with real world scenarios which involves

executing multiple services sequentially or in parallel

● Support for different transport protocols; i.e. HTTP, HTTPS,

JMS, MAIL, FTP, JDBC, LDAP etc

Testing examples with JMeter

(Currency conversion rate)

1. Send SOAP requests to a Stock Quote web serviceScenario 1 : Testing a web service with dynamic data

2. Need to send dynamic data inputs in the SOAP request3. Read the response and verify the response is valid

1. Send request to the Web Service

2. Send requests with dynamic inputs

Stock Quote service

Testing examples with JMeter

● Thread Group● Sampler > SOAP/XML-RPC Request● Config Element > CSV Data Set Config● Assertions > Response Assertion● Listener > View Results Tree● Listener > Aggregate Report

Scenario 1 : What JMeter components you will need?

Demo

Testing examples with JMeter

1. Invoke Login API

(Access Token)

2. Invoke Stock Quote API with the Access Token

(Response)

Login API

Stock Quote API

1. Call the login API [REST] and acquire an access tokenScenario 2 : Testing API's with WSO2 API Manager

2. Use that access token to invoke the API3. Read the response and verify the response is correct

Testing examples with JMeter

● Thread Group● Config Element > HTTP Cookie Manager● Config Element > User Defined Variables● Sampler > HTTP Request● Config Element > HTTP Header Manager● Post Processors > Regular Expression Extractor● Assertions > Response Assertion● Logic Controller > Loop Controller● Listner > View Results Tree● Listner > Aggregate Report

Scenario 2 : What JMeter components you will need?

Demo

Testing examples with JMeter

● Create it once.... Run it anywhere!!!

● All you need is a JMeter distribution a JRE installed and a

command shell

● Linux : ./jmeter.sh -n -t /path/to/JmeterTest.jmx -l /path/to/resultsFile.jtl

● Windows : jmeter.bat -n -t \path\to\JmeterTest.jmx -l \path\to\resultsFile.jtl

● Use Shell/ Batch scripts to change test parameters and execute

programmatically, for recursive test scenarios. Refer : http://nirodhawrites.blogspot.com/2012/06/how-to-run-jmeter-tests-in-non-gui-mode.html

Scenario 3 : Running JMeter scripts in 'Headless' mode

Tips...When sending http requests with Jmeter always select

'httpclient4' as the implementation for high load scenarios

When doing load tests disable "View Results Tree", as it

affects thread creation rate.

Always keep test parameters like endpoints, IPs, ports etc as

configurable variables

For high load tests run the Jmeter tests in headless mode, and

write the result to a .jtl file. You can open them later in JMeter

UI, to check results summary, and performance figures.

When measuring performance figures with load tests make sure

only the client and server are running in their respective

machines

Tips...

Other free external plugins are available for Jmeter

● Ant plugin http://www.programmerplanet.org/pages/projects/jmeter-ant-task.php

Allows you to run JMeter script as an ANT task

Creates reports

● Google plugin http://code.google.com/p/jmeter-plugins/

Generates new set of graphs for performance test

Have some new throughput controlling components

Q & A

Engage with WSO2

● Helping you get the most out of your deployments

● From project evaluation and inception to development

and going into production, WSO2 is your partner in

ensuring 100% project success

Engage with WSO2