Embed Size (px)
DESCRIPTION
What makes up an acceptance testing framework? Especially one that will help you use Selenium successfully? How about a list of what ones currently exist? We've got you covered. This talk was prepared for the DC Selenium Meetup in April 2013.
Citation preview
Frameworks^3by Dave Haeffner
ARRgyle.com
Frameworks Agenda
What it isWhy it's worth itWhat should go into oneWhat's available todayQ&A
What is...an acceptance testing framework?
Elizabeth Hendrickson says...
1. Defines the format in which to express expectations
2. Creates a mechanism to hook into, or drive, the application under test
3. Executes the tests4. Reports the results
[link]
Why is...an acceptance testing framework...worthwhile?
The Standard Evolution of Selenium automation at an organization
1 - Record tests with Selenium IDE2 - End up with a brittle suite of tests3 - Export to code, get them working4 - Rewrite them so they're DRY5 - Scale, hit performance issues6 - Monkey-patch as you go
A - Ignore it and go back to manual testingB - Throw it out and rewrite
Standard Selenium Evolution
Hmm...
What really makes up...an acceptance testing framework?(especially one that uses Selenium)
Framework anatomy
CurrentRunnerIntegrationConfigurableReportingLoggingPerformanceDSLTaggable
But the real value isn't realized...until you do something with it.
Why Feedback loop for the teamHow Integrate with CIWhat Timely, in-band notifications
Frameworks in the wild...
Open Source
Py.Saunter (Python)SaunterPHP (PHP)ChemistryKit (Ruby)Geb (Groovy)SST (Python)
ScalaTest (Scala & Java)Baby Framework (Java)
JDriver (Java)
Open Source cont'd
Robot Framework (Python & Java)Fitnesse (Java & .NET)Cucumber (Ruby)Cucumber-jvm (Java)Specflow (.NET)Turnip (Ruby)
ProofTitanium xAFT
Commercial Offerings
SauceLab PartnersQAOnDemandTFT ConsultingDynacron GroupSoftcrylicThinkSys IncHindsight SoftwareQASource
Recap● An 'acceptance testing framework' that is
built for successful Selenium has a lot of parts
● A framework will help you get started, grow, and avoid pitfalls
● There are many "frameworks" (both open source and commercial)
● But there are few that come with everything you need out of the box
● The real value comes from using it within your development workflows
Office Hours (30 min, FREE)sohelpful.me/tourdedave
Blog & Newsletter (FREE)arrgyle.com
[email protected]@TourDeDave
Additional Resources
Selenium HQ's outdated framework page
Agile Alliance Functional Testing Toolsspreadsheet (outdated-ish)wiki (should be the record of truth)
List of available Selenium Resourcesblog post on arrgyle.com
SF Selenium Meetup's Testing Tool Demo Night videos
![[320] Web 3: Selenium · for Selenium Java module for Selenium Ruby module for Selenium JavaScript mod for Selenium Chrome Driver Firefox Driver Edge Driver. Examples. Starter Code](https://img.pdfslide.us/doc/110x75/5eadce82cc4f0d7405687f01/320-web-3-selenium-for-selenium-java-module-for-selenium-ruby-module-for-selenium.jpg)
