29
“Delivering flexible IT solutions & services to help you be more successful.” March 30, 2022 Ajilon Capabilities Overview Quality Management

Flexible On Demand Software Testing

Embed Size (px)

Citation preview

“Delivering flexible IT solutions & services to help

you be more successful.”

April 18, 2023

Ajilon Capabilities Overview

Quality Management

2

Quality Management Professional Services Overview

Introductions

Capabilities

Software Testing

Test Automation

Performance Testing

Delivery Models

Sample Projects

Questions & Discussion

Agenda

3

Ajilon Consulting is a Global, Top Tier, IT services organization with over 40 years of experience in helping clients achieve their business objectives through the appropriate use and implementation of technology.

• Westinghouse Excellence Award• DaimlerChrysler Quality Excellence Award• Ford Motor Company’s Q1 Award• Eastman Kodak Q-1 Silver Award • Verizon Supplier of Excellence Award

Industry Recognition

Global, Top Tier IT Services Provider

ISO 9001-2000 Certified

Operational for 40 years

Headquartered in Melville, New York

Over 13,000 IT professionals worldwide

2008 Global IT Revenues over € 1.173B

Divisions in U.S., UK, Canada, Europe, Australia

Over 50 offices in U.S. and Canada

Preferred vendor to 67 of the Fortune 100

Value-driven IT Solutions customized to clients’ industry and business

Who We Are

4

Number 1 in 8 of the world’s premier marketplaces

Highest levels in service revenue, cash flow and market capitalization in the industry

Annual sales of € 19.65B

More than 6,000 offices in 60+ countries and territories

31,000 Adecco Colleagues

500,000 Associates on payroll daily

Up to 145,000 clients served daily

Ajilon Consulting is part of the Adecco group with the capability to leverage Adecco’s global resources, as required, to provide a complete, cost effective solution.

Global Business Lines

Who We Are

• IT Consulting & Professional Services• Global Solutions Centers• Permanent and temporary IT staffing solutions

• Workforce strategy development• Temporary/contract talent recruitment• Training and management • Across all major industries

• Recruitment of professional finance/office/legal talent• Temporary/part-time staff recruitment• Training/management

• Career transition/outplacement• Leadership consulting/executive coaching• Career development solutions

5

• Transaction Based• Single or Multiple Resources• Client Manages Project & Timelines

• Project Based• Ajilon Owns Project Deliverables• Ajilon Provides Thought Leadership• Ajilon Provides Technical leadership• Ajilon Project Director Manages Engagement

Ajilon provides consulting services across the “Service Delivery Continuum”.

Provide customized solutions tailored to the individual needs of our clients Leverage our experience, technology and thought leadership throughout the project life cycleMaximize value to the client

• Project Based• Flexible Staffing• Ajilon Thought Leaders Available• Client Manages Project Deliverables• Ajilon ensures resource availability at key

milestones

This flexibility allows us to:

Our Delivery Capability

Ajilon Consulting has a robust Quality Practice that enables our clients to maximize their testing dollars while greatly improving quality and time to market with their key software development initiatives.

Quality Services

Software Testing

Test Automation

Performance Testing

Proven testing capabilities

Off-Site, On-site & On-Demand Testing

Development of testing strategies

Expertise in leading testing tools

Dedicated test facility

Quality thought leadership

Solid project management expertise

6

7

Requirements Design Code Internal Test

External Test

Deployed

1

10

100

0.75x

1.0x

2.0x

12.0x

60.0x

100.0x

Normalized Cost of Defect Remediation

Indirect CostDirect Cost

Ajilon’s Quality Management Practice enable our clients to increase the maturity of their Quality Lifecycle Management practices. Transforms your effort from reactive to proactive.

Software Quality Assurance(Defect Prevention)

Software Testing(Defect Removal)

Quality Management Process

8

Quality Services

Ajilon’s Quality Management services are Product Line, ADL and SDLC independent.

RUPAgile

9

Ajilon works to help customers reduce testing costs by sequentially addressing the four Return on Investment (ROI) Enablers.

1. Process Improvement

Improve Testing Efficiency – A Single Unified, Repeatable Process

Identify Defects Earlier in the SDLC and Manage Risk

Eliminate Redundancies (Who is Testing What)

Targeted Testing (Critical Business Scenarios, Complexity, Risk)

2. Economies of Scale

Multiple Applications – One Team

Resources Applied Only During Test – “On Demand”

3. Automation

Automated Manually Intensive Test Activities

Automate Test Activities Prone to Failure via Human Error

Automate Validation of Expected Values

Automate Result Tracking and Reporting

4. Lower Cost Resources

Remaining Manual Tasks in Simple Steps

Offsite Resource Rates

Return on Investment

10

Ajilon’s Software Testing Services include all types of testing for any type of Software Development Life Cycle (SDLC).

Unit Testing

System Testing

Functional/Regression Testing

White Box/Black Box

Cause/Effect

State Transition

Positive Negative

Interoperability

Usability/Accessibility

User Acceptance Testing

All Test Phases

On Site

Near Shore

Offshore

Combination

Delivery Options

Test Analysis

Test Preparation

Test Execution

Test Measurement

Traditional Waterfall

Iterative (RUP, Agile, etc)

V Model, W Model

Custom

SDLC

Manual Testing Services

Analyze

PrepareMeasure

Execute

New Functionality

1. Reduce the number of defects found in production2. Identify defects earlier in the product lifecycle

Software Testing Services

Goals:

11

Software Testing

Ajilon’s Software Testing Services are customized to provide the best Return on Investment possible for your organization.

Tailor the methodology to client culture

Apply industry best practices

Align the test strategy with primary business needs

Evaluate the technical environment

Apply test organization & planning techniques

Establish communication procedures

Develop a top-down test strategy to verify that applications support the business operations

Test development is derived from critical business scenarios

Prioritization of requirements and test cases

Focus limited resources on critical aspects

Establish solid Test Project Reporting with effective Test Metrics

Guiding Principles

Test Strategy and Plan

Test Cases

Test Progress Report

Test Procedures or Scripts

Key Metrics

Defects in Production vs. Other Phases of SDLC

Trends – Time to fix, Arrival rate, reliability

Code Metrics - % coverage, static analysis

Test Effort Metrics – Automation Included

12

Test Automation & Performance Testing

Ajilon’s Test Automation & Performance Test Services are based on formal methodologies and can be applied to any target technology and/or application. Ajilon methodologies are design to help our customers meet their Return on Investment (ROI) Goals.

Knowledge Transfer is a key component of all Test Automation & Performance Test Services.

Test Automation ROI Accelerators

Performance Testing ROI Accelerators

Increase Test Coverage

Reduce Manual Test Costs

Reduce Test Cycles

Reduce Total Cost of Ownership (TCO) of developed software

Reduce Production Support Costs

Reduce Automation Maintenance Costs

Accelerate Project/Software Delivery

Align Work Effort to Demand

Reduce Total Resource Costs

Reduce Project Costs

Gain Reliable Access to Skilled, Trained Resources

Increase Reusability of Tests

Meet Additional Performance Test Goals of Reliability Testing, Stress Testing and/or Capacity Planning

Reduce Project/Application Risks

Ajilon maintains partnerships with all the major tool vendors

Test Automation and Performance Testing

13

Test Automation Maintenance

Build Maintainability into the Architecture

Function Based and Data Driven Architectures - Two architectures that compliment each other

Function Based creates “maintainability” by working off the GUI objects rather than key strokes

Data Driven creates “flexibility” and script create/execution speed by allowing non-automation testers to create different test “cases” in a spreadsheet to drive the variable test parameters and expected results

Build Maintainability into the Process

Analyze

PrepareMeasure

Execute

New Functionality

To maximize the Return on Investment (ROI) of automation, the automation must be maintainable. There are two critical success factors for maintainability: Architecture Design and Process.

Automation Tasks are Integrated with the overall test process

Automation and Manual Test Resources are all part of the same integrated team

Test Team Manager must understand role of automation

Test Team Manager must know how to implement and integrate automation

Manual Test Resources and end users can contribute to the automation effort

Test Automation Approach

14

Analyze Prepare MeasureExecute• Determine Business

Goals/Evaluate Risks• Review SDLC and Test Processes• Evaluate Available Metrics• Evaluate Application/Code

Maturity/Stability• Adjust Test Goals and Processes• New Functionality Testing• Analyze New Functionality• Determine Complexity/Effort• Determine New Scripts Required• Evaluate Automation Potential• Regression Testing• Review Metrics from Last

Release• Add Last Release to Regression• Determine Impact on

Regression• Determine Req.

Testing/Changes• Find Automation Opportunities

(Entire Regression Set)

• Create/Update Project Plan• Write New Manual Scripts Based on

New Functionality• Review New Functionality Scripts

from Last Release to Determine Changes to the Regression Set

• Update Regression Set Manual & Automated Scripts based on New Additions/Modifications

• Review Regression Set to Determine Automation Candidates

• Automate (Develop, Test, Baseline)• Determine Release Acceptance

Criteria (Metrics)• Adjust Regression Set based on

Automation Gains, Release Goals and Risk Assessment

• Execute New Manual Scripts Recording Results and Timings

• Execute Automated and Manual Regression Set – Record Results and Timings

• Record and Communicate (Manage) Defects to Development

• Adjust Plan as Necessary for Additional Planned Iterations

• Record and Communicate Test Results (Metrics versus Acceptance Criteria) to Stakeholders

• Determine Total Cost of Ownership (TCO) of software from Previous Release (s) for all SDLC Phases

• Determine Impact of Latest Release to TCO (trend & amount)

• Measure Impact of Automation - Changes in Test Cycle, Iterations, % Test Coverage, Man Hours (includes all participating teams)

• Measure Defects found in Production versus other SDLC Phases

• Measure Production Support Costs and impact to cost of the latest changes

• Via Quality/Peer Reviews - • Adjust SQA/SQC Processes

Based on Results (CPI)

Ajilon recommends integrating Automation Process steps into the existing Test Processes.

High Level Methodology

15

Test Automation Service Options

1. Automation Proof of Concept (POC)

Assess the viability of Automation

Validate or select an Automation tool

Build Custom test harness and/or libraries as required

Establish Maintainable Architecture - Data driven/Function based/Variable Driven

2. Automation “Kick Start” – In addition to the POC:

Validate Architecture through use

Build Initial Library of Automation

3. Automation Projects – In addition to the Pilot:

Automation regression test case development and maintenance

Re-engineer Existing Automation - from Record/Playback to Maintainable Architecture

Stand Alone Service or Part of a Total Test Effort (including manual testing and test leadership)

One Time Project or ongoing Service Level Agreement

Assisted Support or Outsourced Project

Knowledge Transfer is a key component of all Automation Services.

Ajilon can help your organization meet its automation goals a number of ways regardless of your current experience level.

Test Automation Service Options

16

Load - How will the system perform given expected work load? (users, transactions, DB lookups, etc)

Stress – How will the system respond when normal work load is exceeded? (Break points, graceful failure, error management, etc)

Reliability – How will the system respond over extended periods of time and/or given partial failure?

Capacity Planning - How much scalability, additional capacity is available? Where is next investment? (hardware and/or software)

Service Management Testing – Are Systems Management and Disaster Recovery Plans adequate?

Ajilon’s Performance Testing

Ajilon has a proven “Testing Methodology” that addresses all aspects of performance testing required.

Performance Testing Approach

17

Performance Test Service Options

Ajilon can help you establish a Performance Test group or provide Performance Test Services.

1. Performance Test “Kick Start”

Validate or select a Performance Test Tool

Establish the Load Farm and Performance Test Development Environment

Assess the viability of Performance Testing

Build a Performance Test Strategy

Validate Strategic and Technical Approach while creating Partial Scope Baseline

2. Performance Test Projects – In addition to the Pilot

Full Scope Performance Test(s) – Baseline or Ongoing Test

Includes full execution of Ajilon’s Five Phase Performance Test Methodology

One Time Projects or Service Level Agreements

Assisted Support or Outsourced Project

Knowledge Transfer is a key component of all Performance Test Services.

Performance Testing Service Options

18

Ajilon’s Global Solution Center in Nashua, New Hampshire offers an “On Demand” Solution for accessing Ajilon’s Software Testing, Test Automation and Performance Testing methodologies and resources.

Ajilon can “fill in the gaps” due to the inherent peaks and valleys of software testing activity, so clients don’t pay for downtime

The Ajilon GSC is an “On Demand” resource that aligns supply to demand

Clients can use the Nashua GSC for as little as one week as opposed to traditional staffing minimums of 3 month contracts

“On Demand” - Pay only for what you use

Physical plant - Over 15K sq. ft of secure lab space; $5M in infrastructure

Resources- Over 50 Consultants with 10+ years experience

SW environments - All Windows, IBM, HP, Sun, OVMS, True64, Unix, Linux, multiple databases

Software Tools - Mercury, Compuware, Radview

HW environments - Compaq, Sun, IBM, HP, Dell, Gateway, Micron, Toshiba, Acer

Network environments - Gigabit Ethernet, Multiple T-1 lines, DSL

20+ Years of Operations

Scalable

Flexible

Responsive

Reusable

Global Solution Center

19

On Demand

Our On Demand service provides a cost effective means for clients to maintain access to a specified skill set for services that do not require the need for full time costly resources. The solution can provide project sourcing or an as required (On Demand) need for IT professionals.

Geographical Location

Nashua, New Hampshire

Skills/Support Available

Manual Testers

Test Leads

Test Automation Architects/Developers

Performance Test Architects

Support Types

Testing Center of Excellence

Software Releases/SLA

Single Software Testing Event

Test Automation Projects or Services

Performance Tests/Services

Nashua

20

On Demand – Ajilon’s Value Statements

Ajilon enables you to realize significant cost savings in software testing, often 25% or more over your own internal cost.

Ajilon’s approach eliminates idle time between releases.

Ajilon provides the capability to ramp-up resources to meet planned or unplanned demand that you don’t have the bandwidth for.

Ajilon provides you with one contact point for scheduling and managing all Testing resources and events, with one consolidated status and one bill.

21

Ajilon’s standard engagement model includes project phases to address knowledge transfer to and from the Ajilon team.

Engagement Project Phases

1. Planning

Gather Project Information

Gain Access to Systems Environments

Build Transition Plan

2. Transition In

Follow Transition Plan (See methods on next slide)

3. Execution

Establish Current Benchmark/Metrics

Deliver Services (Analyze, Prepare, Execute, Measure)

Measure/Adjust/Improve/Repeat

4. Transition Out

Build Transition Plan

Follow Transition Plan

Turnover Remaining Documents/Artifacts

Complete Project Closeout Steps

22

Customized Processes

Phased Approach

Defined Deliverables and/or Service Levels

Single Point of Contact for Delivery

Local Relationship Management

Our flexible Methodologies and scalable Center of Excellence Model, developed over the past 17 years, are instrumental to the success of our Quality Management Services.

Flexible Delivery Model

Industry Best Practices

Benchmarking/Metrics

Continuous Process Improvement

Skilled Resources

Leverage Appropriate Tools

Guiding Principles

OFFSITEONSITE

Steering Committee

ClientSponsors

AccountManager

Lab DirectorTechnologyManager

ClientProject Team

Core Test TeamClientProject Leads

Flex TeamTest Leads

Client Resource Ajilon Resource

TestCoordinator

23

Recent Projects

Description Solution and Value

A Medical Publishing Company was struggling to meet their compatibility testing needs for all the various handhelds on the market for their PDA application.

Ajilon leveraged our PDA/Smartphone experience and created an approach that included twelve environments to execute a test matrix to address the following variables:

Ajilon provides PDA testing experience, industry best practices, speed to market and contingent “On Demand” resources – all at a significant cost savings to our customer.

An insurance company’s Claim System had moved to a quarterly release schedule and needed to support the releases at a low cost while maintaining quality.

Ajilon uses the On Demand model to apply the right number of resources for right time period. Rather that having 2 full time testers – and those testers needed 6 weeks to partially test (75%) each iteration, the Ajilon team of 10 resources can execute 2 iterations of 100% of the tests in less than 10 days...all at a significant cost savings.

A medical company needed testing ongoing support for small discreet development projects.

Ajilon continues to provide testing support for small projects (4-12) weeks. To date, Ajilon has provided test planning, management and execution for 17 different projects in the last 3 years.

An insurance company was facing high local labor rates and a number of different types and sizes of releases.

Ajilon’s offsite/On Demand model continues to be an excellent solution for this company’s testing needs. The team has flexed between 4 and 10 resources over the last three years.

24

Recent Projects - Continued

Description Solution and Value

A Financial Services Company needed occasional Performance Tests but did not want to maintain a team.

Ajilon uses the On Demand model with remote resources to execute Performance Test for different applications when needed. Each project is small - approximately 6 weeks total. Ajilon is able to offer further savings by using part time resources for the high end role of Performance Test architect.

An insurance company’s Claim System had moved to a quarterly release schedule and needed to support the releases at a low cost while maintaining quality.

Ajilon uses the On Demand model to apply the right number of resources for right time period. Rather that having 2 full time testers – and those testers needing 6 weeks to partially test (75%) each iteration, the Ajilon team of 10 resources executes 2 iterations of 100% of the tests in less than 10 days...all at a significant cost savings.

A student loan company was facing high onsite costs and three major releases over the next 2 years.

Ajilon used a combination onsite/offsite delivery model with the majority of the offsite resources working in an On Demand capacity. Ajilon’s ability to provide timely manual testing, test automation and performance testing at the appropriate stages of the project resulted in significant cost savings and the right alignment of effort and skilled resources to need.

A manufacturing company needed independent 3rd party validation to fit within a narrow three week test/ validation window. The company was also seeking process improvement for their validation processes.

Ajilon’s solution provides a cost effective, onshore workforce solution (Nashua GSC) which gave the customer the flexibility to scale up testing to meet their deadlines. The Ajilon approach resulted in a cost effective solution while at the same time reducing the customer’s risk. Ajilon provides the consistent test team from release to release to maximize delivery efficiencies.

25

Recent Projects - Continued

Description Solution and Value

A banking software company was struggling to build test automation to support their primary banking application.

Ajilon worked closely with the existing test teams to build a maintainable test automation framework and script library that they could continue to expand and support. The key component of the project was Ajilon’s ongoing Knowledge Transfer that included “on the job” training and an extensive project closeout.

A legal publishing company was looking for a partner to take responsibility for testing activities.

Since the customer had determined that software testing should not be one of their core competencies, Ajilon continues to provide On Demand software testing for releases, test automation development and maintenance and performance testing.

A major airline was looking to lower their software testing costs while increasing test coverage.

Ajilon implemented an onsite/offsite delivery model and continues to provide On Demand manual and automated testing services. Ajilon has also completed stand-alone test automation effort to convert a large number of automation to a new platform.

A medical company needed ongoing testing support for small discreet development projects.

Ajilon continues to provide testing support for small projects (4-12) weeks. To date, Ajilon has provided test planning, management and execution for 17 different projects in the last 3 years.

An insurance company was facing high local labor rates and a number of different types and sizes of releases.

Ajilon’s offsite/On Demand model continues to be an excellent solution for this company’s testing needs. The team has flexed between 4 and 10 resources over the last three years.

26

Scalable and Responsive• Ajilon can quickly procure the necessary resources to meet our customer’s needs

• Ajilon willingly adjust our Service and Process Levels to match our customer’s goals

Supplemental• Ajilon teams can work in conjunction with, not replacing, customer software test teams

Project Acceleration• Ajilon’s can apply large numbers of resources over short time frames to shorten test cycles – reducing project

timelines and reducing overall costs

Quality & Efficiency• Ajilon’s Solution Center customers get better long-term value through knowledge retention versus hiring “one-

off” contractors

“On Demand” - Pay Only for What You Use• Ajilon can “fill in the gaps” due to the inherent peaks and valleys of software testing activity

• Ajilon “On Demand” customers pay only for what they use

• Ajilon’s Nashua Global Solution Center can accommodate engagements as short as one week as opposed to traditional staffing minimums of 3 month contracts

Flexible• Ajilon differentiates through our willingness and ability to flex to adapt to changing customer needs

Cost effective• The combination of small market rates and “On Demand” results in pricing is typically at least 25% less than

most local markets

Ajilon Value

27

Our ValueWhat sets Ajilon Consulting apart?

Dedicated, experienced leadership

Proven, flexible delivery methodologies that consistently meet budgets, timelines and quality parameters

Internal project management office and guidelines including ISO Certification

Project success rate in the 90th Percentile (exceptional rating within the industry)

Staff augmentation Managed services Professional services

Industry-leading recruiters Ajilon works to understand the Thought leadershipproject vs. just supplying resources

Proven resources and skill sets Ajilon leverages similar experiences Reduced risk

Sound business knowledge Ajilon shares responsibility for Cost and scope managementrecruiting and placement,reducing the burden on you

Proven resources and skill sets Knowledge transition

Sound business knowledge Increased quality of deliverables

Flexible staffing model Proven and repeatable processes

Industry and technology expertise

Opens up your resourcesEngagements managed under Engagements managed undera statement of work a statement of work

ISO-2001 processes across all aspects of service delivery

Value point pricing across all aspects of service delivery

Client Value Continuum

28

Rae Brand– Account Manager 404-729-4805

Jim Lester – Practice Executive, Quality Management (585) 755-4758

Contact Us

“Delivering flexible IT solutions & services to help

you be more successful.”

Questions & Discussion

29