23
www.analytixds.com 1 © Copyright 2014 AnalytiX DS Dare to dream… Do the math… AnalytiX™ DS ETL conversion AnalytiX™ DS ETL conversion

LiteSpeed ETL Conversion and Migration

Embed Size (px)

DESCRIPTION

ALC allows clients to easily move from their current ETL Platform to an new ETL platform. Our automated process uses the power of AnalytiX Mapping Manager to reverse engineer out of any platform, and forward engineer into the ETL tool of choice! Eliminating the costly barrier to ETL platform migration! ALC 4.5 and higher is compatible with the following DI ETL tool platforms: · IBM Info Sphere Data Stage 7.5 and greater · Informatica 9.0 and greater · Microsoft SQL Server SSIS 2008 and greater · Talend 7.1 and greater · Oracle Data Integrator (ODI) 11 · Convert SQL Procedures (coming soon) **If your ETL tool platform is not listed – please contact [email protected] and find out where it is on the technology roadmap.

Citation preview

Page 1: LiteSpeed ETL Conversion and Migration

www.analytixds.com 1

© Copyright 2014 – AnalytiX DS

CONFIDENTIAL – DISCLOSURE WITH NDA

Dare to dream… Do the math…

AnalytiX™ DS ETL conversion

AnalytiX™ DS ETL conversion

Page 2: LiteSpeed ETL Conversion and Migration

www.analytixds.com 2

© Copyright 2014 – AnalytiX DS

Company Overview

Source: <___>

• Nearly 50% of Fortune 1000

• Global customer base

• Global government install base

Founded 2006 :

Headquarters Chantilly, VA :

Employees 200 :

Offices USA, India (Hyderabad) :

Leadership >30 years in Data integration :

>1000 Customers

Market Leader Enterprise Data Mapping :

• Relation with Top 5 System Integrators and

Off-shore Integrators

• 20+ resellers globally (HP Global Reseller)

Partners/Resellers

2010 Winner ; Innovation award

2012 Nominated; Technology innovation award

2012; Most valuable partner

AnalytiX reduces costs & accelerate project delivery by automating the data mapping process to make it

Faster, More Manageable & Collaborative while Auto-Generating ETL Jobs for leading ETL Tool Providers

Page 3: LiteSpeed ETL Conversion and Migration

www.analytixds.com 3

© Copyright 2014 – AnalytiX DS

AnalytiX DS Product Leadership Team

Page 4: LiteSpeed ETL Conversion and Migration

www.analytixds.com 4

© Copyright 2014 – AnalytiX DS

Revolutionary products

ETL Platform Conversion

AnalytiX LiteSpeed Conversion (ALC) The industry’s first customizable ETL Conversion Software (SaaS)

• Ease of conversion from legacy ETL platform to New ETL Tool

• Automated process to reverse engineer and forward engineer; driven by

the power and customization of AnalytiX DS!

• Eliminating the costly barrier to ETL migration!

AnalytiX Mapping Manager (AMM) The industry’s first Pre-ETL Source to Target Mapping Software

• Create mapping designs using scanned meta data and group

• Categorize and auto-generate your ETL jobs

• Maintain version control and auditability, Impact Analysis & Lineage

AnalytiX Data Services (ADS) Global Delivery

• Low cost and tool specific expertise

• No job is too big – vast pool of highly talented data experts

• We do it right the first time, and at the right price!

SaaS

available

Page 5: LiteSpeed ETL Conversion and Migration

www.analytixds.com 5

© Copyright 2014 – AnalytiX DS

MappingManager® | Add-on Modules

AnalytiX DS

add-ons

Agile

Third Party

add-ons

Free and

Customizable

add-ons

XLS ETL Code-Gen

Customizable

ETL integration

App Plug-In

Create Custom

applications

Document

Standards API’s

DataVault

Testing Automation Agile BI Code-Gen and Training Services

CSM | RDM

Reference

Data Manager

RM

Release

Manager

LiteSpeed

Conversion™

XConnect

AMM X-Connect

Metadata

Manager

BI Discovery

BI reporting

SAP X-Connect

SAP integration

The Add-On modules are intended to extend the Mapping Manager’s capabilities beyond the core “out the box” capabilities.

Page 6: LiteSpeed ETL Conversion and Migration

www.analytixds.com 6

© Copyright 2014 – AnalytiX DS

Technology board of advisors

Distinguished Panel of Subject Matter Experts

AnalytiX invites select customers with exception standards in data

integration and key members of customer integration teams to represent

our customer advisory board and contribute to our technology roadmap.

Dr. John R. Talburt is Professor of Information Science Program and

heads the Data Quality Program with MIT. He is also the Executive

Director of the UALR Laboratory for Advanced Research in Entity

Resolution and Information Quality (ERIQ LAB).

Hewlett-Packard (HP) Enterprise Information Solutions Group Software is

a Software & Solutions Reseller & Technology Contributor

Complimentary

technology

partners

Page 7: LiteSpeed ETL Conversion and Migration

www.analytixds.com 7

© Copyright 2014 – AnalytiX DS

Customers

Over 1000+ enterprises & 50% of the FORTUNE 1000 enterprises rely on AnalytiX

Mapping Manager to manage and govern the data mapping process of data integration

projects. Some of our featured customers include:

Page 8: LiteSpeed ETL Conversion and Migration

www.analytixds.com 8

© Copyright 2014 – AnalytiX DS

Awards

2012 – Marketplace MVP contest

2010 – Marketplace innovation drive

2012 – Informatica innovation award

Technology categories : 8

Technology solutions : 1000+

Grand Prize Winner :

AnalytiX MappingManager

Solution Automates Pre-ETL Mappings &

Generates ETL Jobs

The Informatica Marketplace connects buyers and sellers to share data integration solutions

within an open and comprehensive ecosystem of more than 100,000 active users :

https://community.informatica.com/solutions/1077?cid=ADS

Page 9: LiteSpeed ETL Conversion and Migration

www.analytixds.com 9

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion® | What it means?

Consistency | Time Savings | Costs Savings

Auto documentation means consistency, better quality outcomes, and lowered cost per job

Custom code generation using proprietary AnalytiX LiteSpeed conversion® code takes the

cost-per-job from an average of nearly $2000, to just $200 – Saving Millions and creating

better quality output!

Estimated savings on this conversion - $3.5M – Not including the maintenance you will no

longer pay for your prior ETL Platform Maintenance!

2000 jobs

$3.5 m

savings

‘AnalytiX LiteSpeed Conversion defines

“Working Smarter, not Harder”

- the math makes it a clear choice.’

Page 10: LiteSpeed ETL Conversion and Migration

www.analytixds.com 10

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion® (ALC)

Software as a

service: get to

where you need

to be!

AMM keeps you in

the driver’s seat

• ALC State-of-the-Art Software that auto-

mates the conversion of ETL Tool platforms

• Enabling fast and AUTOMATED conversion

between one ETL platform and another

• Built in features

− Job documentation

− Profiling measures

− Status reports

− Lineage impact and analysis

• ETL logic delivered in the instance of AMM

Manage ahead with

efficiency and

additional ROI

• Reverse and forward engineered jobs are

NOT delivered in spreadsheets

• Comes in a purpose-built mapping repository

• Enables the use of custom templates in auto-

generation of code going forward!

• Save additional time and Money!

“There is no magic here –

Just really great code

generation, created by

great developers with really

great experience… making

ETL Platform Conversion

possible, at a really

great price”

LiteSpeed Conversion + MappingManager Bundled offering

Page 11: LiteSpeed ETL Conversion and Migration

www.analytixds.com 11

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion®

Software as a Service – Cloud

Platform

ETL Tool

Customizable Code-

Gen Templates

Import

In

LiteSpeed Conversion®

1 2 3 4

DBMS sync to local Converted

ET XML

ETL

Mapping

Custom

SQL Query

Distributed environment

AnalytiX DS MappingManager (Enterprise Edition)

License Key

1

AMM

License Key

2

AMM

License Key

3

AMM

License Key

4

AMM Application Layer

(Customername.war)

Database Layer

(Customername.dbms)

Page 12: LiteSpeed ETL Conversion and Migration

www.analytixds.com 12

© Copyright 2014 – AnalytiX DS

Parallel ETL Conversion Plan

The swim-lanes below details which tool the work will be preformed in

ETL Job Conversion

Convert Repository

DS AMM INFA

Validate/rework

AMM INFA

Unit test ETL Job

INFA

Approve converted ETL

Logic

Approval (AMM)

Custom: Dictionary

Repository Update

AMM

Custom: Teradata

Code-Gen template

AMM

Assemble Job

Workflows

AMM INFA

Validate/rework Job

Workflows

AMM INFA

Unit test Job Workflows

INFA

Schedule using

scheduler

Autosys / Control-M

other

Workflows , Job Sequencing and scheduling

Custom: Workflow

TemplateAMM

Unit test ETL Job

INFA

System test Job

Workflows

AMM INFA

System Test Scheduler

Auto-Sys

Testing

Page 13: LiteSpeed ETL Conversion and Migration

www.analytixds.com 13

© Copyright 2014 – AnalytiX DS

AnalytiX DS – Screenshots

MappingManager® Data Mapping & ETL Conversion Tool

Converted ETL Logic: All ETL Conversion logic is stored, organized and presented in the mapping manager repository.

Customizable Code-Gen templates: Conversion is 1-1 or customizable code-gen templates be created to “augment” converted Jobs.

All ETL Jobs are organized by Project

& reverse engineered as mappings

ETL Logic is represented in easy to

read source to target mapping format

Data Glossaries are organized with

Lineage & Impact Analysis Views

Project & Mapping Browser ETL Mapping Data Grid Data Glossaries & Discovery

Page 14: LiteSpeed ETL Conversion and Migration

www.analytixds.com 14

© Copyright 2014 – AnalytiX DS

AnalytiX DS – Screenshots

ETL Integration Library: Customizable Code Generation

ETL Conversion

• Once the mappings have been reversed engineered from Legacy ETL Tools, they can be quickly and easily exported to Informatica

to auto-generate ETL Jobs.

Generate ETL Jobs from Source to Target Mappings

• Creating “Pre-ETL Source to target Mappings is easy, fast and versioned using Mapping Manager.

• Once these pre-ETL mappings are created , just like Converted DS Jobs, they can quickly be exported to Informatica using the

“customizable” ETL Integration Library to auto-generate the ETL Jobs

Page 15: LiteSpeed ETL Conversion and Migration

www.analytixds.com 15

© Copyright 2014 – AnalytiX DS

ETL Conversion Assessment

Scope & Assessment Worksheet

Part A – Define the ETL Architecture

Sources

No. SRC

Systems

(XX)

Stage

No. ETL

Jobs

(XX)

ODS EDW

No. ETL

Jobs

(XX)

Data Mart(s)

No. ETL

Jobs

(XX)

Outbound files

No. ETL

Jobs

(XX)

No. ETL

Jobs

(XX)

Complexity

Part B – Assessment Matrix

Mappings Percentage

Low

Medium

High

Custom reverse

engineer templates

Custom forward

engineer templates

2430

131

31

TBD

Y

93.8

5.0

1.2

1 Code gen template to convert from Oracle to Teradata Target

Page 16: LiteSpeed ETL Conversion and Migration

www.analytixds.com 16

© Copyright 2014 – AnalytiX DS

DRAFT WBS & Accountability Plan

Conversion Scope and Accountability

Job Conversion

Unit test

Job approval

Job sequence conversion

Sequence approval

Create custom forms

Others?

Test Jobs

Job sequences

Test Scheduler

Test reports

Test data

Test Add-ons

Pre-UAT

UAT

End-to-end integration test

AnalytiX DS

ETL Conversion

AnalytiX DS

Add-ons

AnalytiX DS

Add-ons

Functional/

Pre-UAT Test

Program

Management

Note: This is a starting point for

project planning purposes

• The following resource plan is

recommended for proper audit,

balance and control of the

conversion initiative

• Team based knowledge transfer

and training will be conducted

using MATRIX RESOURCES

where key resources work

integrated across different work-

streams

STAGE ODS EDW Data Mart

Phase

1 2 3 4

Page 17: LiteSpeed ETL Conversion and Migration

www.analytixds.com 17

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion®

| Deliverables

Automated conversion deliverables enable…Acceleration across all SDLC Phases.

Here are some of the tangible deliverables from LiteSpeed Conversion®…

Legacy ETL Jobs

• Automated Profile Assessment of Legacy ETL Jobs

• Automated Documentation of Legacy ETL Jobs

Converted ETL Jobs (New To Be ETL Tool)

• Auto-Documentation of Converted ETL Jobs

• Deliver fully Converted ETL Jobs from old platform to new ETL Platform

Mapping Manager – Enterprise Edition

• Create, Maintain and Version Source to Target Mappings

Project Management

• Conversion Project Plan

Testing

• Documented Conversion requirements to accelerate testing

Page 18: LiteSpeed ETL Conversion and Migration

www.analytixds.com 18

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion®

| Deliverables

** The above proposal is based on the mapping complexity information received by ADS and assumptions listed

Sample Opportunity

• Converting 2,592 ETL jobs

• Legacy ETL Tool TALEND/DataStage/SSIS/Abinitio/Other Informatica

Delivery Phased Approach

• Convert one Data Mart/Subject Area at a time using a phased iterative delivery approach

Auto-Document Existing Job Auto-Convert Legacy ETL Jobs to New ETL Platform

• Customization of Converted Jobs are supported through “customizing the conversion and

code-generation templates (Included in the SaaS offering)

FULL Test and Cutover to Production Plan

• Turning up of new systems involves running in parallel for a period of time and running

continuous validation testing on “SOURCE” and Informatica platforms

Our Proposal for conversion support:

• Time to completion : XX months (Most completed within 4-6months)

• Cost Estimate : $ xxx,xxx

Month 1 Month 2 Month 3 Month 4 Month 5 Month 6

Onsite resources

(Avg. FTE)

Global delivery

resources (Avg.FTE)

TBD TBD TBD TBD TBD TBD

TBD TBD TBD TBD TBD TBD

Page 19: LiteSpeed ETL Conversion and Migration

www.analytixds.com 19

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion®

Agile delivery methodology

Phase 1

4 weeks

• Analyze

• Design

• Build & Test

• Release 1

Phase 2

4 weeks

• Analyze

• Design

• Build & Test

• Release 2

Phase 3

4 weeks

• Analyze

• Design

• Build & Test

• Release 3

Phase 4

4 weeks

• Analyze

• Design

• Build & Test

• Release 4

Each 4 week sprint is organized into phases and usually associated with your ETL Architecture

Page 20: LiteSpeed ETL Conversion and Migration

www.analytixds.com 20

© Copyright 2014 – AnalytiX DS

Distributed Environment Option

Offsite and Distributed team environments Repository exports can be exported from CLOUD environments

at predetermined milestones of each phase and “Sync” the onsite production instance.

STAGE ODS EDW Data Mart

Phase

1 2 3 4

Application Layer

(Customername.war)

Database Layer

(Customername.dbms)

License Key

AMM

Customer 1

Dev

License Key

AMM

Customer 2

Test

License Key

AMM

Customer 3

Pre-prod

License Key

AMM

Customer n

Prod

Page 21: LiteSpeed ETL Conversion and Migration

www.analytixds.com 21

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion®

Service delivery options

Appendix A: Interested in support services from AnalytiX DS? Flexible support models are below.

Pros Options

Dedicated Team

• Fixed resources onsite/ offsite/ Global Delivery Center (offshore)

• Ability to ramp up/down as needed

• SLA based services / Development Team

Committed hours

• Fixed fee

• Flexibility in fixed time

• Ability to ramp up/down as needed

• SLA based services

Global Delivery

Center

• Flexible cost effective services model.

• High value / low costs solutions for resource intensive projects

• Reduced Risk

• Fixed Scope

• Fixed Fee

• Note: requires diligence and understanding of job complexity and scope Fixed Fee

Page 22: LiteSpeed ETL Conversion and Migration

www.analytixds.com 22

© Copyright 2014 – AnalytiX DS

LiteSpeed Conversion®

Key assumptions

• Estimate based on complexity and no. of ETL jobs provided by client

• Estimate covers ETL mapping conversion only

• A client Business Analyst and or SME will be available to impart knowledge on current mappings in

legacy system

• Low complexity mapping consists one source, one target and one transformer

• Medium complexity mapping consists multiple homogeneous sources , multiple targets and

less than 3 transformers

• High complexity mapping consists multiple sources, multiple targets and multiple transformers

• Conversion will be done using client environment

• All admin activities such as Database management, configuration management and server

management will be handled by client

• Any material change in no. of mappings to be converted, direction, strategy, or deliverables will need to

be assessed for impacts on the initial time line though we strive to accommodate within the timeline.

Page 23: LiteSpeed ETL Conversion and Migration

www.analytixds.com 23

© Copyright 2014 – AnalytiX DS

Contact us

Corporate Headquarters Sales Team Product Support

14175 Sullyfield Circle, Suite #

400 Chantilly, VA 20151 USA

Tel: (800) 656-9860

Email: [email protected]

Tel: (800) 656-9860

(800) 603-4790

Email: [email protected]

Tel: (800) 656-9860

(800) 617-9620

Email: [email protected]