Embed Size (px)
Citation preview
Modernize Your Test Automation For Modern Application Delivery PARASOFT webinar: Why Testers Can't Test: Solving the Test Environment Dilemma.
May 21, 2015 Diego Lo Giudice, Vice President, Principal Analyst @dlogiudice
For: PARASOFT
Businesses must continuously exploit digital technologies to both create new sources of value for customers and increase operational agility in service
of customers.
Rolls Royce and GE Aviation lease hours of propulsion.
“It’s Great So-ware Applica4ons That Drive Digital Businesses Success…. ….And Every Enterprise Needs To Excel At Delivering Them !”
Test Obsessed!
© 2015 Forrester Research, Inc. Reproduction Prohibited 5
Tes<ng has never been a good companion of Speed…
© 2015 Forrester Research, Inc. Reproduction Prohibited 6
Modern Applica;ons Are All About Delivery Speed, But At Different Levels…
Social media and search
Systems of engagement (SOE) Systems of record
(SOR)
Traditional
3rd party Cloud-based services
• Mobile, web, and smart devices • Frequent changes • Delight clients • Mobile and Web apps
• Stable requirements • Highly transac;onal • Less change • ERPs (SAP, ORACLE, JDEDWARS, etc)
Private Cloud
Months Weeks
Weeks, Days, Minutes, Seconds
Months, Weeks Days
© 2015 Forrester Research, Inc. Reproduction Prohibited 7
Tes4ng must improve Quality@speed
Old-School thinking compromises between speed and quality
Introducing quality@speed: fast frequent pit stops and con<nuous tes<ng…
© 2015 Forrester Research, Inc. Reproduction Prohibited 9
Modern Automa<on Is 2 of the 5 Must Do’s For tes<ng quality@speed !
From manual GUI testing
Automated Functional Testing (API/Non GUI Testing)
Target state
Automated GUI tests
Increase Test Automa<on and Focus it on API / Non GUI tes<ng automa<on
Manual testing
% Automation vs % Manual
Current state
10 – 20 %
60 – 80 %
Automated Testing
To manual exploratory testing 5 – 20 %
5 – 10 %
60 – 80 %
Automated API/ non GUI tests
% Automation vs % Manual
Source: Wolgang Platz – Tricen4s -‐ modified by Forrester
© 2015 Forrester Research, Inc. Reproduction Prohibited 11
Test beyond GUI to verify and validate business and technical services
API Layer UI Layer
Backend / resource Layer (Apps, services, etc)
© 2015 Forrester Research, Inc. Reproduction Prohibited 12
Continuous delivery Pipeline
Development Build Test environment Stage environment
Production environment
Integra<ng Tes<ng Tightly And Efficiently In Your Con<nuous SoTware Delivery Process
› Source: Forrester adapta4on of SVT for dummies
Deploy
Automated Gate checks
Automated Process Tes4ng
Automated Func4onal Tes4ng
Automated Unit Tes4ng
Release automa4on
Release candidates
Retro-‐vert
Continuous Integration / Continuous Delivery
Retro-‐vert
Automated Performance Tes4ng
© 2015 Forrester Research, Inc. Reproduction Prohibited 13
Use Service Virtualiza;on To Deal With Teams Different Speed Levels…
Social media and search Traditional Private Cloud
Months Weeks
Weeks, Days, Minutes, Seconds
Months, Weeks Days
Tes4ng Of Simulated and Virtualized Services (Func4onal, Performance Load, Integra4on, Data)
Design Assets (WSDL, XML, ….)
Custom Developed
(Java, JavaScript, C#, etc
Run;me Non Accessible Services
(Messaging, Swi-, Tibco, etc)
Paid Third Party Services (Cloud,
Mainframe, etc)
APIs ( Mainframe, Middleware, Applica4on Services)
© 2015 Forrester Research, Inc. Reproduction Prohibited 14
Conclusions
1. Digital is disrup4ng and transforming *ANY* business, and “so-ware tes4ng” with it !
2. To increase levels of automa4on you need to focus on beyond the GUI or do more API Tes4ng
3. Introduce Service Virtualiza4on to test your so-ware in a wind tunnel
Alaska Airlines Plug
Flight Operations Manager Challenges + Solutions Ryan Papineau – Automated Test Engineer 2015-‐05-‐21
Flight Opera4ons Manager
Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
System under test
Complex cross system dependencies make tes4ng very difficult
• Environment • Shared • Continual changes
• Data • Integrated, but not coordinated. • Does not exist • Inconsistent
• Services • Not available • Inconsistent
• Events • Do not exist • Lack of resources to make them happen
Challenges – “Why testers can’t test.”
Flight Opera4ons Manager
Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
Isolate System Under Test
Virtualize Data Feeds – stabilizing tes4ng
AirportWebService
CargoWebService
BaggageWebService
PassengerWebService
Planeside Device
Service Virtualization
Events - Message Exchange Patterns Synchronous (Request/Response) Asynchronous (Event Driven)
GetCargo
GetBaggage
GetPassenger
Depart
Take Off
Land
Arrive
Book Ticket
Check In
GetFuel
Board Flight
Final Solution Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
Cargo WebserviceBacked by Test Data Management (TDM)
Baggage WebserviceBacked by (TDM)
Passenger Webservice Virtualized
AircraftCommunication
Virtualized
Crew WebserviceBacked by (TDM)
Flight Movement Triggered byAutomatedTest Client
Aircraft Maintenance Webservice
Backed by (TDM)
Load PlanBacked by (TDM)
Event Modeling
X =
Data Modeling
Final Solution Cargo Load Plan Baggage
Passenger Aircra-
Fuel Flight Events Crew
Cargo WebserviceBacked by Test Data Management (TDM)
Baggage WebserviceBacked by (TDM)
AircraftCommunication
Virtualized
Crew WebserviceBacked by (TDM)
Aircraft Maintenance Webservice
Backed by (TDM)
Load PlanBacked by (TDM)
Challenges + Solutions
Problem Solution Tool Environmental Impacts Isolated Environment + System VMWare Data Alignment Test Data Management (TDM) Custom SQL Inconsistent Web Services Service Virtualization (SV) Parasoft Virtualize Lack of Events Automated Test Clients Parasoft SOAtest
Q + A
