Ranorex Research Projects - · PDF fileDocker –putting tests in a container What’s...

Ranorex Research Projects

28.09.2017

Agenda

Research @Ranorex

Docker – putting tests in a container

What’s the “smell” of my tests?

What about robustness?

Research @Ranorex

Research @Ranorex

• Small prototypes

• POCs

• Tool integrations

Always trying to think outside the box

DockerPutting tests in a container

Docker

Quick Intro

Anybody not familiar with docker/containers?

Two options

• Running Rx test in a container

• Mobile tests (POC with BitBar)

• Selenium tests

• Running SUT in container

• Web-apps

Limitations of Windows containers

• Native Windows apps supported by docker

Windows containers

• No GUI-apps supported yet

• No RDP (or similar) possible

It is on our radar

Quick Demo

• Run single web test locally

Automate Wordpress bootstrapping process

Can only be run once per WP instances

• Move to Containers

• Spawn Docker container with Ranorex

• Run test on Selenium Box

• Destroy Docker container

Multiple parallel executions possible

What’s the “smell” of my tests?

An add-on provided by Qualicen

Ranorex test meta analysis

• Based on an add-on provided by Qualicen

https://www.qualicen.de

• Analysis of

• Recording modules

• Test suite

… more to come

• Webinar planned

Demo

What about robustness?

How to achieve robustness?

Multiple selectors

• „Fuzzy“ selectors

• Structural / positional /

attribute based

• Attribute matching• String distances

• Position• In tree

• On screen

Element not found…

Really?

• “Element not found” errors

“Earlier” error

Screen did not change

Consider whole UI

Remember automation “path”

Element not found…

Dynamic ID/label?

• Feature calculation on ID

• Numbers

• String-Lengths

…

Classification with SVM/LDA/…

• ID matching regex “growing”

80-90% accuracy

@github

Things available @github

• Ranorex github repository

http://www.github.com/ranorex

• “Private” repo with Ranorex-projects

http://www.github.com/cbreit

… unofficial

A few more things

Other experiments

• Centralized reporting

• Elasticsearch connection

• Appium

• JMeter/Gatling integration

Thank you

for your attention!

Questions?

cbreitwieser@ranorex.com

Christian Breitwieser