Acceptance & Integration Testing With Behat (PBC11)

Acceptance & Integration

Testing Using Behat

Ben WaineEmail: ben@ben-waine.co.uk

Twitter: @bwaine

Saturday, 29 October 11

Pair Programming

Say hello to the person next to you....

Set Up

USB Stick

Set Up

For instant set up:

1) Copy code into a new vhost with the web root pointing at the ‘public’ folder.

2) Uncomment line 13 in: tests/acceptance/features/bootstrap/UIContext.php

3) Install Sahi from the misc folder.

Set Up

If setting up today run the Behat command using behat.phar

eg: php behat.phar --tags demo1

If you have previously set up, run the behat command

eg: behat --tags demo1

Goto: tests/acceptance/

Sky BetPHP / MySQL Stack

PHPUnit / Selenium / Behat

Software EngineerPHP Developer

Roadmap

•Intro To Behaviour Driven Development

•Introducing Behat

•Gherkin & Steps

•API / Service Layer Testing

•UI Testing

•Phabric - Dynamic Fixture Creation

joind.in

http://joind.in/talk/view/4328

What Marco Said......

Stories

What is BDD?

Introducing Behat....

Resistance is futile.......Saturday, 29 October 11

Origins in Rubys cucumber

What Does It Test?

ScriptsAPI’s

Web PagesModels

Integration Testing !=

Unit Testing

Anatomy Of A Behat Test

Describes the behaviour in a storyHuman ReadableSamples Later

PHP that maps to lines of the gherkin.Behat parses gherkin and runs the associated steps.

Writing Behat Tests

$ben > cd /path/to/projects/tests$ben > behat --init

Bootstrap Behat. Provides you with a structure

Writing Behat Tests

Feature Files

Feature: Home Page When visiting the PHPCon site As a site visitor I need to be able to see what ` conferences are coming up

Name of testDescription of test

ScenariosScenario: Get all conferences Given there is conference data in the database When I go to the homepage Then I should see three conferences in a table

Scenario. Multiple scenarios in a single feature file

ScenariosGiven

(Some Context)

When (Some Event)

Then (The Outcome)

Keywords. Always follow the same formula

Given (Some Context)

Given there is conference data in the database

Sets up some state or context

When (Some Event)

When I go to the homepage

When I use the findConferences method

When I am on "/index.php"

When I fill in "search-text" with "PHP"

Executes whatever it is your testing. A http call, a method invocation, a page load

Then (The Outcome)

Then I should see three conferences in a table

Then I should get a array of three conferences

Then I should see "PHPNW"

An assertion.Has it worked? Are we seeing what we expect to see.

ConferenceService.feature

Feature: ConferenceService Class In order to display conferences on PHPCon site As a developer I need to be able to retrieve conferences

Scenario: Get all conferences Given there is conference data in the database When I use the findConferences method Then I should get a array of three conferences AND it should contain the conference “PHPNW”

Written By our TESTERS - Fed In From BAsHow is this feature executed?Each step is reusable! MENTION PHP METHODS + ANNOTATIONS!!!!

Class Methods & Annotations

Written By our TESTERS - Fed In From BAsHow is this feature executed?Each step is reusable! MENTION PHP METHODS + ANNOTATIONS!!!!

/ Everybody Stand Back /

Behat Knows Regular Expressions

PHP Annotations used to map steps to linesBehat supplies regex.

Demo One

Behat’s - Regex Fu

Introducing....... The Sample Domain

My Amazing PHP Conference Website

Service Layers

Demo One

Fill in the Feature Context File public function __construct(array $parameters) { $params = array( 'user' => $parameters['database']['username'], 'password' => $parameters['database']['password'], 'driver' => $parameters['database']['driver'], 'path' => $parameters['database']['dbPath'], );

$con = \Doctrine\DBAL\DriverManager::getConnection($params);

$confMapper = new \PHPCon\Conference\Mapper($con); $confService = new \PHPCon\Conference\Service($confMapper);

$this->service = $confService; }

The Feature context file- Ever feature gets a instance. Set up some resources. - Set up the object to test - similar to PHPUnit’s set up method.

Fill in the Feature Context File

/** * @Given /^there is conference data in the database$/ */ public function thereIsConferneceDataInTheDatabase() { $fileName = self::$dataDir .

'sample-conf-session-data.sql'; self::executeQueriesInFile($fileName); }

Remember - Given sets the state.Loads an sql fixture to the DB.

Fill in the Feature Context File

/** * @When /^I use the findConferences method$/ */ public function iUseTheFindConferencesMethod() { $this->result = $this->service->findConferences();

Remember - When executes the thing you want to test.

Fill in the Feature Context File /** *@Then /^I should get an array of (\d+) conferences$/ */ public function iShouldGetAnArrayOfConferences

($numberOfCons) { assertInternalType('array', $this->result); assertEquals($numberOfCons, count($this->result)); }

Remember - This verifies the output Also - identified a number. Passes the number into the method.

/** * @Then /^it should contain the * conference "([^"]*)"$/ */ public function itShouldContainTheConference

($confName) { $names = array();

foreach($this->result as $conf) { $names[$conf->getName()] = true; }

if(!array_key_exists($confName, $names)) { throw new \Exception("Conference "

. $confName . " not found"); } }

Exceptions == Test Failures

Passing Behat Test

Demo Two

Exercise One

Testing a service layer with Behat.

Exercise One

Open the PDF in the misc folder. Read through Section One.

Start Coding :)

Failing Test

If exceptions are encountered .....

Passing Test!

What about the UI?

We’ve covered testing a service class. But how do you test the UI?

Part of the Behat Project.A abstraction over a number of different browser testing tools.

Goutte Sahi

Zombie.js

Goutte - headless browserSahi - like seleniumZombie.js -

Extend Mink Context

Use Bundled steps to create higher level abstractions.

Includes predefined steps

Back To: My Amazing PHP Conference

Website!

We need a UI to testintroducing.....

Example

Scenario: View all conferences on the homepage Given there is conference data in the database When I am on "/index.php" Then I should see "PHPNW" in the ".conferences" element And I should see "PHPUK" in the ".conferences" element And I should see "PBC11" in the ".conferences" element

Using Minks Bundled Steps

This is ok - but ties the feature to your implementation.

Link FeatureContext.php

to UIContext.php

# features/bootstrap/UIContext.php

use Behat\Behat\Context\ClosuredContextInterface, Behat\Behat\Context\BehatContext, Behat\Behat\Exception\PendingException;

use Behat\Gherkin\Node\PyStringNode, Behat\Gherkin\Node\TableNode;

require_once 'mink/autoload.php';

class UIContext extends Behat\Mink\Behat\Context\MinkContext{

class FeatureContext

public function __construct(array $parameters) { $this->useContext('subcontext_alias', new UIContext($parameters));

! // REST OF FEATURE CONSTRUCTOR

1) Linking feature files2) All steps included ‘out the box’

Demo Three

A Behat UI Test (Using Mink + Goutte)

Exercise Two

Testing the UI with Mink and the headless browser Goutte.

Exercise Two

Open the PDF in the sources folder. Read through Section Two.

Start Coding :)

Scenario: View all conferences on the homepage Given there is conference data in the database When I am on the "home" page Then I should see "PHPNW" in the "conferences table” And I should see "PHPUK" in the "conferences table” And I should see "PBC11" in the "conferences table”

Abstracting your scenario

class UIContext extends Behat\Mink\Behat\Context\MinkContext{ protected $pageList = array( "home" => '/index.php'); protected $elementList = array( "conferences table" => '.conferences');

Mink Feature Context

A simple abstraction that makes a map of pages > urls and elements > css selectors. Example of step delegation. Now you never change the feature file. Just steps.

/** * @When /^I am on the "([^"]*)" page$/ */ public function iAmOnThePage($pageName) {

if(!isset($this->pageList[$pageName])) { throw new Exception( 'Page Name: not in page list'); } $page = $this->pageList[$pageName]; return new When("I am on \"$page\""); }

/** * @Then /^I should see "([^"]*)" in the "([^"]*)"$/ */ public function iShouldSeeInThe($text, $element) { if(!isset($this->elementList[$element])) { throw new Exception( 'Element: ' . $element . ‘not in element list'); } $element = $this->elementList[$element]; return new Then("I should see \"$text\" in the \"$element\" element"); }

Demo Four

A Behat UI Test (Using Mink + Goutte)UI implementation abstracted away from Gherkin.

Exercise Three

Abstracting the UI implementation away from the Gherkin.

Exercise Three

Open the PDF in the sources folder. Read through Section Three.

Start Coding :)

Javascript Testing withSahi

Back To: My Amazing PHP Conference

Website!

We need a UI to testintroducing.....

@javascriptScenario: Use autocomplete functionality to complete a input field Given there is conference data in the database When I am on the "home" page When I fill in "search-text" with "PHP" And I wait for the suggestion box to appear Then I should see "PHPNW"

Example

Mention @tagsSO you need to test java script. Headless browser isn’t suitable.

@javascriptScenario: Use autocomplete functionality to complete a input field Given there is conference data in the database When I am on the "home" page When I fill in "search-text" with "PHP" And I wait for the suggestion box to appear Then I should see "PHPNW"

Great Reuse

These are supplied by Mink. Woohoo!REUSE

// In the UIContext class /**

* @Given /^I wait for the suggestion box to appear$/ */ public function iWaitForTheSuggestionBoxToAppear() { $this->getSession()->wait(5000, "$('.suggestions-results').children().length > 0" ); }

Get session - gets you minkWait, Then execute jquery!

Demo Five

UI Testing With Sahi

Exercise Four

UI Testing With Sahi

Exercise Four

Open the PDF in the sources folder. Read through Section Four.

Start Coding :)

How do you supply your data?

SQL Fixture

Can be difficult to maintain.Hides Data in a fixture NOT in your scenarios.

Phabric

Gherkin Tables

Demo Five

Dynamic fixture creation with Phabric.

Case Study: Behat at Sky Bet

Whats the problem we are solving.Three elements of the team.Delivering the product first time. Correctly.

The Problem

The Business Analyst

BA / Product owner has all the knowledge Write stories

The Tester

Testers test implementation vs the story

The Developer

Dev - write the codeAutomate the process of testing if code meets the requirements of a story

The Problem

BA’s Write Stories

Testers Write Gherkin

Developers Write Steps + Code

BDD - Skybet Workflow

Less Defects

Fewer times through this cycle

The Place Of Acceptance & Integration Tests

Balance.

Jason HugginsThe place of acceptance and integration tests

A whole world of trouble.

Takes a long time to run, Harder to implement, when they break you have to do this again!not as reassuring!

joind.in

http://joind.in/talk/view/4328

Questions?

Behat Github Page: https://github.com/Behat/Behat

Mink On Github: https://github.com/Behat/Mink

Website: http://behat.org/

Phabric On Github: https://github.com/benwaine/Phabric

Acceptance & Integration Testing With Behat (PBC11)

Technology

Web Acceptance Testing with Behat

Behat - events.drupal.org · What is Behat? Behat does one simple thing: ** each line in a scenario is called a “step” Behat “executes” your scenarios, reading each step and

Integration kit for Acceptance ofstatic.ancv.com/.../integration_kit_cvco_API...2_5.pdf · Integration kit for Acceptance of “Chèque-Vacances Connect”, an Online Holiday Voucher

BDD in PHP - Behat

Behat - Read the DocsNote: Behat was heavily inspired by Ruby’sCucumberproject. Since v3.0, Behat is considered an ofﬁcial Cucumber implementation in PHP and is part of one big

Site Integration Acceptance Test Procedures - dpw

Integration kit for Acceptance of

Site Integration Acceptance Test Procedures

Behat sauce

Behat: Beyond the Basics

Engineer Peter Sawczynec 8 Behat... · Drupal PHP Gherkin Behat Feature files, the “Tests” Behat Context class files, the testing code /** * Step function to visit the last created

Full-Acceptance Detector Integration at MEIC

Behat - human-readable automated testing

BDD using behat

Behat в PHP с использованием Behat и Mink

BDD, Behat & Drupal

BDD With Behat and Mink

Bdd and Behat

BDD & Behat for PHPNE

Creating Behat extensions