STARWest - Think you can just ‘Test’ that API? Think again

Always In Title Case; 2 Lines Preferred

Think you can just Test that API? Think againThursday, October 6, 2016 - 11:15am to 12:00pm

2016 CA. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies. No unauthorized use, copying or distribution permitted. Please note that this presentation is for your informational purposes only does not serve as any technical user guides or documentation. There is no direct or indirect warranty provided pertaining the products and actual use may vary from the illustrations provided.

Jonathon WrightDirector of Digital Assurance

# 2016 CA. All rights reserved.

1

# 2016 CA. All rights reserved.AgendaINTROWHATWHYWHENWHICHDEMO123456

# 2016 CA. All rights reserved.Introduction

VALUE-DRIVENTIME

1960s1990sTODAYMAINFRAMEERP/CRM SYSTEMSAPPLICATION ECONOMY (API)

Digital Assurance Evolution, over Revolution1 The Battle for Competitive Advantage in the App Economy, Oxford Economics, 20152 Sony VR - Pre-orders in multi-millions (EST) 13/10/2016 - http://www.psu.com/review/31303/PlayStation-VR-Review-PS4s-virtual-reality-headset of enterprises believe that they need value-driven algorithmic business models to respond to disruption in the next 3 years.78%

Legacy is your Legacy (API)Digitalization of your Core (SOA)Digital Disruption (Micro)

# 2016 CA. All rights reserved.This is your slide to set up the application economy Dive into history of what has changed to drive companies to delivery software faster than theyve ever had to before.

End with discussion on this study from Oxford. Nearly 80% believe software-driven business models is the way to win. How much focus and effort will all your competitors, and even startups that you dont know about, will use to drive the development of software to win your customers. What are you doing about it? Whats your strategy? (this leads into next slide better deliver software like never before).5

Industry Research: Gartner Market Guide for API Testing and Service VirtualizationSource - Gartner Market Guide for API Testing and Virtualization http://bit.ly/Gartner_SV-Guide Key findings include:The need for API testing and service virtualization is becoming increasingly important as IT organizations develop multi-modal capability to support mobile, digital business transformation initiatives and the Internet of Things (IoT).Service virtualization enables earlier, continuous, complete and parallel development and testing of software in a highly complex, heterogeneous and distributed environment. It can also reduce overall test lab costs.


Alexa How on earth am I going to test your Artificial Intelligence API?

Alexa APIs - https://developer.amazon.com/public/solutions/alexa/alexa-skills-kit

# 2016 CA. All rights reserved.Demo Link - https://youtu.be/KJo2HMI7Et0 7


HIVE (IoT)EndpointSmart MeterAlexa(AI)WIFI DeviceEndpointiPhone 7 +iPhone 7Home Automationhttps://youtu.be/KJo2HMI7Et0

# 2016 CA. All rights reserved.What is an API?

API GatewayAPI can be considered a call to a protocol which could be messages based, JSON, MQ etc. or to a direct function such as PL/SQL with a set of inputs (parameters) that perform actions, that are logic based; against and with data stores; and using other APIs and returns a response to help identify whether the API worked.The API in an ideal world should be clearly documented with a clear purpose such that any causes (inputs) and results (effects) are easy to understand and can be easily incorporated into the process flows, such as a UI or App.DefinitionTakeawayRequestResponse


2016 Niantic, Inc. 2016 Pokmon. 19952016 Nintendo /Creatures Inc. / GAME FREAK Inc., API - https://pokeapi.co/

How canI test the Pokmon Go AR API?

# 2016 CA. All rights reserved.2016 Niantic, Inc. 2016 Pokmon. 19952016 Nintendo /Creatures Inc. / GAME FREAK inc.11

Example - Pokmon GoSource Take a Requirements-Driven Approach to Better Software, 20th September 2016, https://www.brighttalk.com/webcast/9305/225813


What is Service-oriented architecture?ESBService-oriented architecture (SOA) is an architectural pattern in computer software design in which application components provide services to other components via a communications protocol, typically over a network.1

DefinitionTakeaway1 - https://www.quora.com/What-is-the-difference-between-SOA-and-microservices ConsumerProvider

# 2016 CA. All rights reserved.What is Service-oriented architecture?Benefits of making sections of code accessible across applications and to other applications include:New customer channels and markets1Visibility across physical and virtual components1Componentization is a fundamental of good programming can ensure that applications are stable and flexibleDigital can be the driving force behind organisations shift to Algorithm based Business models1 API Architecture for the Modern Enterprise - http://www.slideshare.net/rnewton

# 2016 CA. All rights reserved.New customer channels and markets - http://www.slideshare.net/rnewton

Visibility across physical and virtual components - http://www.slideshare.net/rnewton14

Source - IEEE Transactions on Pattern Analysis and Machine Intelligence, 21st September 2016, http://arxiv.org/abs/1609.06647 Source - Google AI APIs - https://cloud.google.com/prediction/docs/apis

AI

Test Data SetTest Algorithms Set

Test Meta Data


Source - Beyond Siri: The World Premiere of Viv, Dag Kittlaus, 9th May 2016


What are Microservices?Micro-containerizationMicroservices is a software architecture style in which complex applications are composed of small, independent processes communicating with each other using language-agnostic APIs.1

DefinitionTakeaway1 - https://www.quora.com/What-is-the-difference-between-SOA-and-microservices EndpointIoT Mesh


Think you can just Test that Microservice? Think againSource - Forbes, Theo Priestly, 2016

# 2016 CA. All rights reserved.Source - http://www.forbes.com/sites/jacobmorgan/2014/09/04/cities-of-the-future-what-do-they-look-like-how-do-we-build-them-and-whats-their-impact/#5dd46f574e9b18

What about1 - The Advanced Research Projects Agency Network (ARPA) Network, 1969

Component Layer

MVC

2 Testing as a Service Models, BCS Keynote, 5th June 20153 'Test Automation as a Service, STARWest, 4th October 2012

Node.TestAPI Layer

automation engineering

UI Layer

# 2016 CA. All rights reserved.CONTINUOUS TESTING

RUNDEPLOYTESTBUILDPLAN

INTAKE RequirementsUser StoriesRelease PlanMODEL Import User Stories to Automatically Create, Visualize and Optimize Tests

Initiate Functional, Non-Functional and Security as CodeFUNCTIONALSubset/Mask Test DataCreate/Reserve Test DataTest Automation LibraryEnsure Mobile Experience INSIGHT-DRIVENCONFIG/DEPLOYProvision Entire StackConfirm ConfigurationsApprove ChangesSuccessfully DeployInternal or External CloudMEASURE/FEEDBACKCustomer ExperienceBusiness Service ViewApplication ViewInfrastructure ViewDynamic CapacityFeedback loopINTEGRATIONRemove Constraints with Virtual ServicesMobile, Web, App Server, Middleware, Backend, MF3rd Party Systems / APIsCODEDevelop and Commit Code, Scan Code, Version Control, Continuous Integration. Complete Build and Initiate ReleaseAUTOMATIONAUTOMATIONAUTOMATIONSpeed/Time-to-MarketQuality/AvailabilityAUTOMATIONCost/Financial MixRisk/Compliance

RequirementsEnvironmentsDataAutomation

CustomerExperience

NON-FUNCTIONALPerformance EngineeringSimulate Backend LoadTest Outlier ConditionsEnsure Mobile ExperienceSecurity / Penetration Common GoalsBig Picture IssuesDESIGNSHIFT-LEFTSHIFT-RIGHTOPS

Node.TestAutomation.TestTDDBDDATDD

BPMNNimbusVisio


20

idea

DEVELOPMENT

OPERATIONS

CUSTOMER EXPERIENCE

TESTING

DesignDevTestOpsAgility across all multi-modal delivery modes Incubate, Scale and Enhance

Continuous Testing

Continuous Improvement

Continuous Delivery

Continuous Intelligence

Continuous Assessment

Continuous Learning

Continuous InnovationDESIGN

Shift-Up Connected IntelligenceShift-Right the Digital Ecology Shift-Left Rapid Evolution feat. DesignOps Shift-Down Data Archaeology (legacy)

CA API ManagementManage APIs and create a directory of virtual APIs for secure access.

CA Service VirtualizationVirtualize third-party APIs and unavailable systems for agile testing.

CA Application TestEdit and extend API tests without writing code, and test the full technology stack.

CA Test Data Manager Find, create and provision test data automatically and fast.

CA Agile Requirements Designer Automatically generate and maintain the smallest set of test cases needed for maximum coverage.

# 2016 CA. All rights reserved.However, its really about DevTestOps. Its an end-to-end practice for taking an idea, planning for it, building it, testing it to ensure quality, orchestrating its delivery into production and the ongoing operational practice that follows. Doing that successfully across the entire toolchain will eliminate points of friction across the software delivery lifecycle, enabling you to deliver code quickly and efficiently, while making sure it is aligned with the organizations ability to support it.

What we see is that Testing is really the final frontier of DevOps.

21

Source DevOps Uncovered, September 2016, http://go.infuse.it/WF-2016-10DevOpsUncovered_LP-On-demand.html

# 2016 CA. All rights reserved.DESIGNOPS

Continuous Delivery - Sub-Value Streams Summary

1 Continuous Delivery

2 Continuous Testing

3 Continuous Staging4 Continuous Release

# 2016 CA. All rights reserved.The old adage about how do you eat an elephant one piece at a time. 23

% of Sprint User Stories ModeledDEV% of User Stories with a Definition of Done% of Prioritized User StoriesDeployment Frequency to QAChange Lead TimeChange Failure RateMTTR*% of Successful Code Builds% of BVT PassedQA Feedback Time (Time to Fully Test a Build Target:

Technology

STARWest - Think you can just ‘Test’ that API? Think again