OpenTAP Introduction to Test Composition and Automation

Lars Nielsen Keysight Technologies5G-VINNI WP4 030320

This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279

Agendabull OpenTAP overview

ndash Conceptndash Architecture

bull Main concepts for usendash UIsndash Workflow

bull Practical example from test composition to resultsndash Demo

03032020 OpenTAP Introduction to test composition and automation 2

OPENTAP OVERVIEWIntroduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 3

What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure

ndash Everything (including GUIs) is seen as a plugin

bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins

bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition

bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs

03032020 OpenTAP Introduction to test composition and automation 4

Why OpenTAP for Test Automationbull Simplicity

ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo

ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators

bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused

bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition

03032020 OpenTAP Introduction to test composition and automation 5

Result Listeners

User Interfaces

Instrument Plugins

DUT Plugins

Test Step Plugins

How does the architecture look likeDEPENDENCY

PathWave

Automation Engine

DB Storage

CLI

DesktopEditor

Text Log

RabbitMQ

VNF DUT

Custom DUT

Custom Step

ConfigureTool

Custom Inst Custom RL

Custom UI

TUIWeb

Editor

Hawkeye Yardstick

IxLoad

Traffic load step

REST API

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

Agendabull OpenTAP overview

ndash Conceptndash Architecture

bull Main concepts for usendash UIsndash Workflow

bull Practical example from test composition to resultsndash Demo

03032020 OpenTAP Introduction to test composition and automation 2

OPENTAP OVERVIEWIntroduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 3

What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure

ndash Everything (including GUIs) is seen as a plugin

bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins

bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition

bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs

03032020 OpenTAP Introduction to test composition and automation 4

Why OpenTAP for Test Automationbull Simplicity

ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo

ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators

bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused

bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition

03032020 OpenTAP Introduction to test composition and automation 5

Result Listeners

User Interfaces

Instrument Plugins

DUT Plugins

Test Step Plugins

How does the architecture look likeDEPENDENCY

PathWave

Automation Engine

DB Storage

CLI

DesktopEditor

Text Log

RabbitMQ

VNF DUT

Custom DUT

Custom Step

ConfigureTool

Custom Inst Custom RL

Custom UI

TUIWeb

Editor

Hawkeye Yardstick

IxLoad

Traffic load step

REST API

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

OPENTAP OVERVIEWIntroduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 3

What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure

ndash Everything (including GUIs) is seen as a plugin

bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins

bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition

bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs

03032020 OpenTAP Introduction to test composition and automation 4

Why OpenTAP for Test Automationbull Simplicity

ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo

ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators

bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused

bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition

03032020 OpenTAP Introduction to test composition and automation 5

Result Listeners

User Interfaces

Instrument Plugins

DUT Plugins

Test Step Plugins

How does the architecture look likeDEPENDENCY

PathWave

Automation Engine

DB Storage

CLI

DesktopEditor

Text Log

RabbitMQ

VNF DUT

Custom DUT

Custom Step

ConfigureTool

Custom Inst Custom RL

Custom UI

TUIWeb

Editor

Hawkeye Yardstick

IxLoad

Traffic load step

REST API

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

What is OpenTAPbull OpenTAP Open(source) Test Automation Platformbull OpenTAP is a light weight sequencing enginebull OpenTAP has a highly modular structure

ndash Everything (including GUIs) is seen as a plugin

bull Configure DUTsSUTs toolsndash via instruments and test steps contained in plugins

bull OpenTAP provides a low entry barrier for development and usagendash Quick development of plugins and test steps tailored to individual needsndash Simple dragrsquonrsquodrop of test steps in test plan composition

bull It is possible to ldquorulerdquo all the tools (not only Keysightrsquos) and DUTs

03032020 OpenTAP Introduction to test composition and automation 4

Why OpenTAP for Test Automationbull Simplicity

ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo

ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators

bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused

bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition

03032020 OpenTAP Introduction to test composition and automation 5

Result Listeners

User Interfaces

Instrument Plugins

DUT Plugins

Test Step Plugins

How does the architecture look likeDEPENDENCY

PathWave

Automation Engine

DB Storage

CLI

DesktopEditor

Text Log

RabbitMQ

VNF DUT

Custom DUT

Custom Step

ConfigureTool

Custom Inst Custom RL

Custom UI

TUIWeb

Editor

Hawkeye Yardstick

IxLoad

Traffic load step

REST API

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

Why OpenTAP for Test Automationbull Simplicity

ndash Low technical barrier of entry TAP is not ldquoyet another programming languagerdquo

ndash Does just what you need not trying to be ldquoeverything for everyonerdquondash Simple for everyone programmers non-programmers and operators

bull Scalabilityndash Modular software architecture centered around a core sequencing enginendash IP encapsulated as plugins Build solutions through re-use not re-inventionndash Plugins can be shared and reused

bull Speedndash Optimized for manufacturing (speed time = $) yet robust for RampD usagendash Powerful analytics such as Timing Analyzer continuously amp efficiently improvendash Get to market fasterhellipaccelerate your deployments outpace the competition

03032020 OpenTAP Introduction to test composition and automation 5

Result Listeners

User Interfaces

Instrument Plugins

DUT Plugins

Test Step Plugins

How does the architecture look likeDEPENDENCY

PathWave

Automation Engine

DB Storage

CLI

DesktopEditor

Text Log

RabbitMQ

VNF DUT

Custom DUT

Custom Step

ConfigureTool

Custom Inst Custom RL

Custom UI

TUIWeb

Editor

Hawkeye Yardstick

IxLoad

Traffic load step

REST API

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

Result Listeners

User Interfaces

Instrument Plugins

DUT Plugins

Test Step Plugins

How does the architecture look likeDEPENDENCY

PathWave

Automation Engine

DB Storage

CLI

DesktopEditor

Text Log

RabbitMQ

VNF DUT

Custom DUT

Custom Step

ConfigureTool

Custom Inst Custom RL

Custom UI

TUIWeb

Editor

Hawkeye Yardstick

IxLoad

Traffic load step

REST API

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

From a Userrsquos Perspective

03032020 OpenTAP Introduction to test composition and automation 7

Results Viewer

Run ExplorerTiming Analyzer

Editor

Package Manager

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

Community Edition Developer GUI

bull Free to use for non-commercial

organizations amp open source projects

bull Download via OpenTAPio or

Keysightcom

bull Ready to use in under 85 seconds

bull Quickly create amp edit test plans without any

programming experience

bull Experiment with demo plugins requiring no

hardware

httpsgitlabcomOpenTAP

Join ndash The Community

MAIN CONCEPTS FOR USE OF OPENTAP

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 10

OpenTAP GUI Components - Desktop

03032020 OpenTAP Introduction to test composition and automation 11

Test Step Panel

Log Panel

Settings PanelTest plan Panel

Resource BarInstruments DUTs result listeners

OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal

including Docker containers

03032020 OpenTAP Introduction to test composition and automation 12

Example of OpenTAP Workflowbull Prerequisites

ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB

bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana

03032020 OpenTAP Introduction to test composition and automation 13

Generic Example of Vertical Application

Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to

prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status

live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in

terms of functionality and performance

03032020 OpenTAP Introduction to test composition and automation 14

Network to test

Hospital

Ambulance

API API

5G

Test scripts

Generic Example of Vertical Application

Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag

and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests

03032020 OpenTAP Introduction to test composition and automation 15

Network to test

Hospital

Ambulance

API API

5G

AmbulancePlugin

HospitalPlugin

OpenTAPplan

OpenTAPEngine

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

OpenTAP GUI Components - Desktop

03032020 OpenTAP Introduction to test composition and automation 11

Test Step Panel

Log Panel

Settings PanelTest plan Panel

Resource BarInstruments DUTs result listeners

OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal

including Docker containers

03032020 OpenTAP Introduction to test composition and automation 12

Example of OpenTAP Workflowbull Prerequisites

ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB

bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana

03032020 OpenTAP Introduction to test composition and automation 13

Generic Example of Vertical Application

Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to

prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status

live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in

terms of functionality and performance

03032020 OpenTAP Introduction to test composition and automation 14

Network to test

Hospital

Ambulance

API API

5G

Test scripts

Generic Example of Vertical Application

Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag

and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests

03032020 OpenTAP Introduction to test composition and automation 15

Network to test

Hospital

Ambulance

API API

5G

AmbulancePlugin

HospitalPlugin

OpenTAPplan

OpenTAPEngine

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

OpenTAP GUI Components - TUIbull Textual based UIbull Create and edit OpenTAP plansbull Modify bench settingsbull Run in almost every terminal

including Docker containers

03032020 OpenTAP Introduction to test composition and automation 12

Example of OpenTAP Workflowbull Prerequisites

ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB

bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana

03032020 OpenTAP Introduction to test composition and automation 13

Generic Example of Vertical Application

Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to

prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status

live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in

terms of functionality and performance

03032020 OpenTAP Introduction to test composition and automation 14

Network to test

Hospital

Ambulance

API API

5G

Test scripts

Generic Example of Vertical Application

Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag

and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests

03032020 OpenTAP Introduction to test composition and automation 15

Network to test

Hospital

Ambulance

API API

5G

AmbulancePlugin

HospitalPlugin

OpenTAPplan

OpenTAPEngine

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

Example of OpenTAP Workflowbull Prerequisites

ndash Plan what to test and howndash OpenTAP plugins to control DUT and test toolsndash DB to store resultsndash Result listener to post results to DB

bull Flowndash Install needed plugins using OpenTAP package managerndash Configure instruments in OpenTAP editorndash Compose OpenTAP plan using editorndash Configure result listenerndash Run OpenTAP test planndash View results eg in Grafana

03032020 OpenTAP Introduction to test composition and automation 13

Generic Example of Vertical Application

Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to

prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status

live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in

terms of functionality and performance

03032020 OpenTAP Introduction to test composition and automation 14

Network to test

Hospital

Ambulance

API API

5G

Test scripts

Generic Example of Vertical Application

Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag

and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests

03032020 OpenTAP Introduction to test composition and automation 15

Network to test

Hospital

Ambulance

API API

5G

AmbulancePlugin

HospitalPlugin

OpenTAPplan

OpenTAPEngine

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

Generic Example of Vertical Application

Use casebull Emergency vehicle transporting patient to hospitalbull Communicate status to personal at hospital to

prepareinitiate treatmentbull Communication equipment in vehicle and hospitalbull Equipment support functions to connect and transmit status

live video vital signs etcbull Equipment can be controlled via offered APIsbull Test engineer to write scripts to test system capabilities in

terms of functionality and performance

03032020 OpenTAP Introduction to test composition and automation 14

Network to test

Hospital

Ambulance

API API

5G

Test scripts

Generic Example of Vertical Application

Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag

and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests

03032020 OpenTAP Introduction to test composition and automation 15

Network to test

Hospital

Ambulance

API API

5G

AmbulancePlugin

HospitalPlugin

OpenTAPplan

OpenTAPEngine

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

Generic Example of Vertical Application

Use case ndash OpenTAP approachbull Create plugin to control each entitybull Plugin offers steps to use when composing test plan (drag

and drop)bull OpenTAP engine executes test steps as sequencebull Expose external parameters of selected variablesbull Easy automation of tests

03032020 OpenTAP Introduction to test composition and automation 15

Network to test

Hospital

Ambulance

API API

5G

AmbulancePlugin

HospitalPlugin

OpenTAPplan

OpenTAPEngine

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

PRACTICAL OPENTAP USAGE EXAMPLE

Introduction to OpenTAP

03032020 OpenTAP Introduction to test composition and automation 16

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

Test Overview - Hawkeyebull Configure and run Hawkeye test between 2 endpoints

ndash httpswwwixiacomcomproductshawkeye-network-performance-monitoring

bull Endpoints acting as both client and serverbull Store results in DB of choicebull Create result visualizations

Hawkeye bull Application-layer end2end network performance test toolbull Central server and distributed endpointsbull Server acting as central registrationcommand and control serverbull Endpoints acting as worker nodes

ndash Register with serverndash Pull test specifications from serverndash Execute tests of network performance between endpointsndash Push results to server after tests

bull Supporting wide range of measurement types and application layer traffic emulation

03032020 OpenTAP Introduction to test composition and automation 17

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Configure test

Pushresults

TestTraffic

HawkeyeServer

Overview of Planned Test ndash OpenTAP Managed

bull Create OpenTAP plan using test steps from Hawkeye plugin

bull Configure tests and runbull Pull results from serverbull Post results in DB via Result

Listenerbull Visualize results in Grafana

dashboard

03032020 OpenTAP Introduction to test composition and automation 18

DB

HawkeyeEndpoint 1

HawkeyeEndpoint 2

Network to test

Postresults

Fetchresults

Run test

Pull results

Configure test

Pushresults

TestTraffic

OpenTAP Editor

Grafana

HawkeyeServer

DEMOUse OpenTAP to Run Hawkeye Tests

03032020 OpenTAP Introduction to test composition and automation 19

Thank you for your attention

QampA

This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279

ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu

DEMOUse OpenTAP to Run Hawkeye Tests

03032020 OpenTAP Introduction to test composition and automation 19

Thank you for your attention

QampA

This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279

ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu

Thank you for your attention

QampA

This project has received funding from the EUrsquos Horizon 2020 research and innovation programme under grant agreement No 815279

ResourcesOpenTAP httpswwwopentapioOpenTAP on Gitlab httpsgitlabcomOpenTAPopentapHawkeye httpswwwixiacomcomproductshawkeye-network-performance-monitoring5G-VINNI httpswww5g-vinnieu