11
Abstract In the current business environment, organizations face multiple challenges including outdated systems, newer technologies, and changing business processes. The airline industry is no exception. To manage passenger expectations and demand for seamless personalized services at each stage of the journey, a number of airlines are migrating current systems to different Passenger Service Systems (PSS). PSS migration programs are complex and critical as they impact most of the other applications and can potentially affect airline operations. One of the key factors to successful PSS migration is management of the test data and test environment at all stages of testing. Accelerate PSS Migration Testing through Smart Test Data Management www.niit-tech.com At the Heart of Testing Effectiveness

At the Heart of Testing - NIIT Technologies - Testing... · Abstract In the current business environment, organizations face multiple challenges including outdated systems, newer

Embed Size (px)

Citation preview

Abstract In the current business environment, organizations face multiple challenges including outdated systems, newer technologies, and changing business processes. The airline industry is no exception. To manage passenger expectations and demand for seamless personalized services at each stage of the journey, a number of airlines are migrating current systems to different Passenger Service Systems (PSS). PSS migration programs are complex and critical as they impact most of the other applications and can potentially affect airline operations. One of the key factors to successful PSS migration is management of the test data and test environment at all stages of testing.

Accelerate PSS Migration Testing through Smart Test Data Management

www.niit-tech.com

At the Heart of Testing

Effectiveness

Ushering Fundamental Change

PSS governs critical airline systems such as airline reservation system, airline inventory system, and a Departure Control System (DCS).

PSS holds a wide range of product information, as well as important passenger data (such as journey history and customer preferences) that flows across applications. Changes in business strategy and obsolescence of existing systems necessitate the need for PSS migration. PSS migration involves business change, IT system change, and data migration, all of which trigger the need to train the business team. Changes in the airline industry are driving both large airlines and low cost carriers to

consider migration to PSS. Cathay Pacific Airways and Singapore Airlines migrated from their in-house Mainframe systems to Amadeus; the LAN Group and Etihad left Amadeus for Sabre; Virgin Australia moved from Amadeus and Navitaire to Sabre.

PSS migration entails a fundamental change in the way airlines operate. Its successful implementation requires Test Data Management (TDM). TDM ensures that parallel testing activities can take place without impacting each other. This is particularly important for migration projects where it is critical that migrated data is not being modified by other processes. Parallel modifications may potentially result in incorrect test results and require additional effort in defect analysis.

Testing determines quality andreliability in PSS programs toensure smooth transition

Migrations are complex, data mustbe protected, correctly migrated,

and unmodified to avoid any impact on operations and test results

69% of IT professionals useproduction data for testing of

their applications

Data-related tasks occupy about40-50% of application developmentand testing time

Only 10% of production data can be madeavailable in test environment for testing

50% of business data is considered confidentialand cost about a million dollar databreach to a company

Figure : Test Data Insights

This paper explores an effective approach to test data management for smooth PSS migration that reduces the effort spent in test data creation, maintenance, and idle wait time. It proposes that test data managers can ensure that test data is available to all without overlap and invalidation.

Containing Chaos: The Challenge of Migrating Data

The complexity of PSS migration has made TDM even more challenging. It is, therefore, crucial to maintain secure integrated data over repeated test cycles and other non-production environments. Ineffective governance policies results in the following challenges: Limited availability of environment while

multiple teams are accessing the same data There are only two to three environments

available to perform development, testing, and training. Among these, one environment is designated for production.

PSS data is accessed by a number of teams simultaneously viz. testing team, business team, PSS owner, and interfacing application owners. This means that there

will be a number of user groups performing different activities in each environment. An integrated test environment poses the risk of test data overstepping, making the data invalid for other users.

Aggressive delivery plan does not allow time delay or wastage Data mining, data preparation, and other

data-related tasks consume around 40-50% of development lifecycle time. This means that the user groups must follow data management guidelines to ensure that there is no chaos or misconception when using data, especially migrated data in each environment.

Specific data may be required for validating application functionality. User groups must also have a clear idea of their data requirements ensuring data variety, test coverage, and scheduled delivery.

Non-production environments have space and performance constraints With full dump of production data not

advisable for use due to storage constraints, a subset of production data is migrated.

Given the large volume of data flowing across applications and interacting with the PSS and numerous other transactions generated from different use groups, performance is of vital importance.

Judicial use of space necessitates liaising with different user groups and selection of correct subset of production data—ensuring full coverage of test cases and fulfillment of user groups requirements.

All environments reside in a multi-hosted client environment These environments have maintenance

activities occurring at scheduled times and user groups must work within this maintenance schedule.

Any transactional or new data created by user will not be stored for use in later test cycles; hence test schedules and refresh cycles need to be properly aligned.

TDM protects the usage of migrated data, ensuring that all user groups working in each environment can access both migrated and new data that suits their work scenarios and perform activities without impacting data of other user groups. Absence of TDM would result in chaos between the teams using test data indiscriminately, invalidating the test data created for other purposes. It would also result in delays arising from insufficient test data and conflicting test data requirements.

Test Data Management to the Rescue

Effective Test Data Management, a coordinated and easy-to-manage process, improves testing effectiveness and reduces time and cost of providing high quality, safe test data for smooth PSS migration. Our TDM framework depicts different components of test data management in sequential manner. The objective is to cater to the challenges user groups face and define best practices of test data management.

Workflow management system for request provisioning

Understanding data requirements

Develop a TDM process to support filter-based data extraction, data creation, workflow, and data management

Publish data management guidelines to avoid any chaos for data usage and reservation

Timely data availability in various environments considering execution schedule and environment maintenance and data refreshes

Leverage TDM tools and techniques to simplify, automate, optimize the test data use and new data creation

Apply data subsetting techniques based on filter criteria to extract realistic data

Apply data privatization techniques to safeguard customer privacy/security

Quickly and periodically refresh data in Test environments

Maintain reference copy for reuse across testing phases

Core Objectives of Test Data Management Approach

Test Data Management Framework

Capture Data Request Define Filter Criteria Transform and Load Data Maintain Data

Criteria for production data

Criteria for new data generation

Communicate filter criteria

Manage and define request for interfacing systems

Extract data based on filter

Subsetting and Masking

Load data in different environments

Run utilities to generate new data

Notify users

Guidelines or search criteria to access data

Configuration management backup and versioning

Data quality audits

Periodic data refresh

Figure: Test Data Management Framework

Actively managing test data requests for applications and setting up data sets as per the master test strategy to ensure there are no delays in testing

Ensuring that all user groups in each environment can access the required data and perform activities without impacting other user groups’ data.

We also leverage on Test Data Management Governance approach that describes actions for effective test data management in PSS projects.

The PSS owner performs the following tasks to counter the challenges faced in test data preparation: Data extraction Data subsetting and masking Data loading in different environments Configuration management Quality audits and data refresh

To ensure coordination and communication, organizations need a Test Data Manager who is responsible for: Availability of test data for all test phases Coordinating with the Environment Test

Manager and ensuring that the test data is available for testing

User Groups

Data RequestsTest Data Manager

Interfacing Third Parties PSS Owner

NewData

requests

PSSData

requests

TrainingData

requests TestEnvironment

1

TestEnvironment

2

WorkflowManagement

System

Dev QA Training

Masked prodSubset

New DataGeneration

Data Request basedon filter criteria

Different users perform different tasks in the test data management framework.

Task Objective Tasks Owner Tools

1. Capture Request 1.1 Different user groups provide test data requests to Test Data Manager in predefined data templates. There is a common interface for placing test data requests and data management activities.

1.2 We use centralized test management tools such as JIRA and TFS for workflow management. The tools provide visibility to the test data management activities including status of data requests, interface for calendar publication within the test environment refresh periods and other broadcasts.

1.3 The requests need to be made two weeks in advance for the Test Data Manager to comply with the requirement. Ideally, test data requirements should be made during the test design phase.

1.4 Specific requests for data reservation requirements need to be made. For example, a user wants to test a scenario of overbooking a flight. The user needs to book the whole flight and bar further booking on the flight by some other user. Similarly ‘cancel’ flight or ‘close’ flight scenarios may need such reservations to be made. This is mandatory to avoid data-overstepping.

• JIRA/TFS(workflowmanagement)

• Predefinedtemplates(datarequests)

User Groups (QA/Dev/Training)

1.5 Test Data Manager discusses with different user groups to understand data requests, if needed.

1.6 Liaise with business SMEs as they have a good understanding of data.

Test Data Manager

2. Define FilterCriteria for PSS

2.1 Depending on the data requirements of each user group in different environments, the Test Data Manager may need to define separate filters for each environment.

2.2 Define criteria for selecting the PNR records to be migrated to different environments for each data refresh. Filter should be based on flight numbers, and markets covering domestic and international, short-haul and long-haul flights for a specified departure period.

2.3 Coordinate with data migration team to identify data in the production system that satisfies the requirements.

Test Data Manager

PSS owner

Define Filter Criteria

2.7 If there is insufficient variety of data scenarios that can be picked out of the selected data, then there is an option of creating specific data in the current production systems for data migration and loads during data refresh. The Test Data Manager needs to manage this data in order to avoid a situation where this data affects ‘live’ data.

2.8 Test Data Manager holds calls, meetings and formal reviews of documents to ensure alignment of all teams on test data requirements.

2.9 Test Data Manager will communicate filter criteria with the PSS owner.

2.10 The Test Data Manager will specify the filter for selecting and moving PNR records from production to different test environments.

3.1 Data requests involving the interfacing third parties should be specifically managed to ensure that the data in these interfacing systems are synchronized with the data in the PSS environment.

3.2 The Test Data Manager will liaise with respective user groups and owners of the interfacing systems as well as the Test Environment Manager to determine these requirements. This will hopefully enable the interfacing systems to be tested or training on these modules to be performed without impacting the actions that are taking place in the test environment.

Test Data Manager

3. Request/Response for Third Party Interfaces

4.1 PSS owner will move PNRs from production to different environments based on the filter criteria provided.

PSS owner CA Test Data Manager

4. Load Migrated Data as per filter criteria

Transform and Load data

Task Objective Tasks Owner Tools

• Ensure that the data is sanitized to cater the privacy regulations

• Take latest production snapshot to avoid issues withobsolete data

• Script for any defect fixes is executed before using the data

2.4 Create dummy flight and PNR using tools/APIs/script, if required for specific testing needs. This may include bulk PNR data requirement in different environments. The data specification details should be placed in the spreadsheet/data template.

2.5 Carefully define filter(s) to ensure that the selection of data contains enough scenarios to allow user groups to work with each of the environments.

2.6 Manage requests for creating new data for user groups and coordinate to load data for these requests. These requests may be for new data such as PNR (possibly) or data scenarios that cannot be found in the environment. There are some new functionalities that are not productive. For example, data related to check-in of international passengers may not be found in production environment if the international route has been rolled out recently.

Task Objective Tasks Owner Tools

4.2 PSS owner will consider data subsetting and privacy regulations for production data.

5.1 Test Data Manager validates and approves test data creation and management tools.

5.2 PNR generation test data utilities will be used to create new test data in different environments.

5.3 Command-based emulators may be used for bulk PNR generation. Shell scripts and SQL procedures may also be used for this purpose.

PNR generation utilities/SQL procedures/Shell scripts

Test Data Manager

5. New Data Generation

6.1 Test Data Manager will notify the user group that the data is set up for use. This will be reflected through workflow status as part of the workflow management system.

JIRA/TFSTest Data Manager

6. Notify

7.1 Establish simple guidelines for accessing migrated PNR / flight data in different environments so that user groups can use migrated data for their activities without interfering with one another. Any data reserved for a particular user group needs to be clearly specified.

TFSTest Data Manager

7. Post Data Setup

Maintain Data

7.2 Test environment manager or PSS owner to store the copy/backup of data, assign a version number to the data and then make a note of the version number along with data details. This allows restoration of the environment to original condition with minimum effort, as and when required throughout the testing phase. Due to factors such as execution of negative scenarios during execution, some inconsistency may creep into the test environment and may require restoration.

PSS owner

8.1 TDM process documentation

8.2 Best practices to be followed

8.3 Lead time required for any type of data request

Test Data Manager/ PSS owner

8. Transition of TDM Post Cutover

Reduced time-to-market with no delays in test data delivery

Increased defect detection efficiency due to availability of correct, timely data

Improved productivity and overall efficiency Higher customer satisfaction and growth

See the Bigger PictureSeveral benefits are envisaged by following a streamlined process where all requests are funneled through the TDM team: Reduced effort involved in the overall TDM

process due to workflow automation, data request templates, and process improvement

No rework and data overstepping with reservation and distribution of test data

Reduced efforts with reusable tools

The NIIT Technologies Thought Board:Accelerate PSS Migration Testing through Smart Test Data Management

Which Processes are Governed by Passenger Service Systems?

Data extraction Data subsetting and masking

Data loading in different

environments

Configuration management

Quality audits and data refresh

What Tasks does a PSS Owner Need to Perform?

What Tasks is a Test Data Manager Responsible for?

Capture requests

Define filter

criteria

Request/respond to third-party

interfaces

Load migrated

data as per the filter criteria

Generate new data

Notify user groups when

the data is available for

use

Post data setup

Transition TDM post cut-over

What Actions should be Performed for Effective Test Data Management inPSS Projects?

Reservation processes Inventory processes Departure control processes

Round-the-clock availability of

test data

Coordination with environment test

manager

Management of test data

requests for applications

Setting up of data sets as per the master test

strategy

Accessibility of required data by

different user groups

Permitting user groups to

perform activities without any

impact on other groups data

Streamlining Data Management

Effective test data management is crucial to ensure success of PSS migration projects. Dedicated test data management teams managing the test data setup and administration through appropriate TDM frameworks would help ensure accurate test data is provided in the test environment as per user requirements. The challenges in test data management can be addressed through implementation of a workflow-based request provisioning system for timely test data request, status and provisioning, tools for test data generation, effective coordination with user groups, improved defect detection, and increased customer satisfaction.

Tools providing a holistic solution to test data manage-ment like CA Test Data Manager can be leveraged to automate the test data management process. Data acquisition, subsetting, masking, test data generation, test data matching and coverage are some of the vital features of this tool toward improving the testing efficiency.

References

1. http://www.niit-tech.com/industries/travel-transpor-tation/airlines/services/pss-migration

2. http://www.ca.com/in/devcenter/ca-test-data-man-ager/details.aspx

3. http://www.sita.aero

4. http://www.amadeus.com/blog/13/01/migrating-air-line-passenger-service-system/

5. http://www.amadeus.com/nablog/2015/01/5-guid-ing-princi-ples-airline-teams-follow-passenger-service-systems-migrations/airlines

For more information, contact [email protected]

© 2016 NIIT Technologies. All rights reserved.

NIIT Technologies is a leading global IT solutions organization, differentiated on the strength of domain expertise; it services clients in travel and transportation, banking and financial services, insurance, manufacturing, and media verticals. Leading with its service vision “New Ideas, More Value,” NIIT Technologies is committed to delivering new ideas combined with operational excellence to provide exceptional value to its clients. The Company is focused on helping businesses design sustainable, optimizable and winning digital operating models, enabling them to become agile, scalable, and flexible. Visit us at www.niit-tech.com

Stay connected:

D_1

33_1

7061

6