Keyword Driven Testing

© 2015 Maveryx srl.

All rights reserved.

Keyword-Driven Testing

� What is Keyword-Driven Testing

� How to Create Keyword-Driven Tests

� Keyword-Driven Testing by examples

Overview

Definitions of Keyword-Driven Testing

Keyword-driven testing: A scripting technique that uses data files tocontain not only test data and expected results, but also keywordsrelated to the application being tested. The keywords areinterpreted by special supporting scripts that are called by thecontrol script for the test.

[ISTQB – Glossary Standard Glossary of Terms used in Software Testing Version 2.4]

Keyword-Driven Testing is a way of describing test cases by using apredefined set of Keywords. These Keywords are names which areassociated with a set of actions that are required to perform aspecific step in a test case. By using keywords to describe test stepsinstead of natural language, test cases can be easier to understand,to maintain and to automate.

[ISO/IEC/IEEE 29119-5: Keyword-Driven Testing]

What is Keyword-Driven Testing

� Keyword-driven testing, also known as table-driven testing or

action word based testing, is a software testing methodology

suitable for both manual and automated testing

� The basic idea in Keyword-Driven Testing is to provide a set of

reusable “building blocks”, referred to as Keywords, which can be

used to create manual or automated test cases without requiring

detailed knowledge of programming or test tool expertise

Goals of Keyword-Driven Testing

� The final goal of Keyword-Driven Testing is to provide a

comprehensive set of keywords so that all required test cases can

be entirely composed of these keywords

Keyword-Driven Testing

� In Keyword-driven testing every

(testing) action like a mouse

click, keystrokes, opening or

closing a browser or other

actions is described by a

“keyword” such as Click,

TypeText, Select, OpenBrowser,

Login, …

The actions include interactions with the User Interface,

verification, specific actions to set up a test scenario …

What are Keywords

� A keyword is a synonym of a “function” (in the context

of programming languages) doing “something”

� A keyword is a defined combination of one or more

actions on a test object

� Keywords define actions that drive or get information

“from – to” test objects

Keyword and Arguments

� Keywords may or may not take arguments and may or

may not return a value

� void TypeText <text> ⇒ e.g. TypeText “Hello World!”

� void StopApplication <>

� string GetText<>

� void Login<UserName , Password> ⇒ e.g. Login “Joe”,

“21Joe74.”

Keywords

� Keywords are usually characterized by:

� an action-descriptive keyword name (using at least one verb)

� none, one, or more arguments

� a return value

� at a lower level, each keyword is associated with a detailed set

of actions that describes the exact steps to be performed

� for GUI applications, each keyword is associated with one (or

more) GUI objects

Hierarchy of Keywords

� Keywords can refer to actions at different abstraction levels

� Low level keyword : a keyword responsible only for one

(or very few) atomic actions and is not composed from

other keywords ⇒ e.g. Click, TypeText, Select, …

� High level keyword : a keyword responsible for complex

activities, that may be composed from other keywords

⇒ e.g. OpenBrowser, Login, …

Keyword-Driven Test Cases

� A keyword-driven test is a sequence of high level and low

level keywords, including the keyword arguments, as

applicable, which are composed to describe the actions

of a test case

Roles in Keyword-Driven Testing

� Keyword-driven testing is a testing methodology that separates

the test creation process into design and implementation stages

� It allows the involvement of additional professionals, e.g.

business analysts, in the test (automation) process

� Business analysts / testers will only work with keywords and test data

� Specialized test automation programmers will implement each of the

keywords

Keyword-Driven Automation

� A test automation approach where test data and also keywords

instructing how to use the data are read from an external data

source

� Each keyword needs to be associated with at least one command,

test script or function, which implement the actions associated

with that keyword

� When test cases are executed keywords are interpreted by a test

library which is called by a test automation framework



� A Keyword-Driven Testing framework for automated test execution shall :

1. Parse the test case / file

2. Interpret the sequence of keywords. For each keyword :

Call the respective command / script / function, which execute the actions related with the keyword

3. Provide execution results at the keyword level

Pros & Cons

Advantages of Keyword-driven testing /1

� Test cases become clear and understandable

� Concise, readable, maintainable (easy to modify) …

� Tests can be developed without programming knowledge

� Not dependent on a specific tool or programming language

Pros & Cons

Advantages of Keyword-driven testing /2

� Tests can be developed earlier in the software development

life cycle even before the application is delivered for testing

� by using existing keyword libraries

� by defining new keywords

� High degree of reusability

� New test cases can reuse existing keywords

Pros & Cons

Disadvantages of Keyword-driven testing

� High initial investment : developing the keywords and its related

functionalities might take longer

� Personnel has to be trained to use keywords for test case

specification

� Moderately high learning curve initially

� Require knowledge of meta-languages

Pros & Cons

Disadvantages of Keyword-driven testing

� Difficult to implement the framework

� Significant upfront investment for the design and

implementation of the framework

� High automation expertise required

� Keyword limitations restrict the complexity of test cases

� …

How to Create Keyword-Driven Tests

Major activities involved in Keyword driven Testing:

1. Identifying keywords (low level ⇒ high level)

2. Implementing the keywords as executables

3. Composing test cases

4. Creating the driver scripts

5. Executing the automation test scripts

The example application

The Test Tool – Maveryx

Maveryx is a

professional, test

automation tool for

functional and

regression testing of

Java™ & Android™

applications.

The Test Case

Test Case

1. Enter username

2. Enter Password

3. Click "Login" button

4. Check the results

5. Click “OK" button

Keyword-Driven Testing Step #1

1. Identifying keywords

2. Implementing the

keywords


4. Creating the driver

scripts

5. Executing the

automation test scripts

Test Case

1. Enter username

2. Enter Password

3. Click "Login"

button



Keyword

1. Set_Text

2. Click

3. Has_Text



2. Implementing the

keywords



scripts

5. Executing the




2. Implementing the

keywords



scripts

5. Executing the


Test Case

1. Enter username

2. Enter Password

3. Click "Login" button



Anatomy of the test case



2. Implementing the

keywords



scripts

5. Executing the




2. Implementing the

keywords



scripts

5. Executing the


Keyword + Data Driven

${file path} {testdata name} {data id}

High Level Keywords

Keyword implementation

Lessons Learned

1. Keyword-Driven Testing is a software testing methodology

that uses keywords (or action words) to symbolize a

functionality to be tested

2. A keyword is defined as the set of actions that must be

performed during the execution of one or more test cases

Lessons Learned

3. Keywords can refer to actions at different abstraction levels

Low level keyword → High level keyword

4. With Maveryx you can separate much of the programming

work of test automation from the actual test design



About Maveryx…

Maveryx is a professional, award-winning test automation tool for

functional and regression testing of Java™ & Android™ applications.

Maveryx provides testers with automated testing capabilities for

functional, regression, GUI, Keyword-driven and keyword-driven

testing.

Maveryx

� No GUI Maps

� Intelligent Objects Recognition

� Keyword-driven testing

� Keyword-driven Testing

� Assertion-based CheckPoints

� Distributed testing

� Single tool for Java & Android

� Standard Test Logging

� Built on Java & JUnit

� Advanced Test API

� Test Data Generation Tool

� Extension plugins

� Eclipse plugin

� Android ADT plugin

� …

Key Features



No GUI Maps

No Recording. No Object Spy. No Object Maps. Nothing.

o No GUI MAP needed to create and run the test scripts

o No Object Repository to learn & maintain, maintain, maintain…

o No pre-recording or screen capture

o Independent of screen coordinates and resolutions

⇒ Test scripts immediately executable!

o A.I. Artificial Intelligence. Advanced Searching Algorithms to identify

UI objects directly at runtime during test execution, like humans do..

o Automatically accommodate UI changes without changing the scripts

o “Geolocation” of objects in the User Interface (TOP, BOTTOM, LEFT, RIGHT, UP,

DOWN, NEAR-TO …)

Intelligent Objects Recognition



TOP

BOTTOM

L

E

F

T

R

I

G

H

T

CENTER

o Code-free Keyword-driven Testing

o Keyword testing driven from Excel™ sheets and XML files

o No coding required ⇒ short time to implement test scripts

o Keyword-driven testing

o Dedicated scripting API for Keyword-driven testing

o Varying set of data sources : Excel™ sheets , CSV & XML files

Codeless Test Automation





“One Script” Technology

Write Once, Run Many. Maveryx allows

creating scripts that can be run without

modification against any Android apps,

as well as Java desktop applications on

all platforms.

o Tests can be executed on Android Virtual Devices (AVDs) or Real

Devices ⇒No Rooting!

o devices connected to the local PC [via USB cable or Wi-Fi]

o devices connected remotely to a mobile device lab

o Support for all versions of Android

o Support for almost all UI Elements

o …



Mobile Testing

The industry like us

Winner.



Useful Links

o Maveryx – http://www.maveryx.com

o User guide – http://www.maveryx.com/en/support/learn-

more/user-documentation.html

o Forum – http://www.maveryx.com/en/forum/index.html

o Training – http://www.maveryx.com/en/services/training.html

Thank You!

• www.maveryx.com

• [email protected]

• [email protected]