30
www.hyperionguru.com www.bisptrainings.com Delivery By : Presented By : BISP Solutions INC. Oracle Data Integrator 11g Transformation Example Using Aggregate Function 1

Oracle Data Integrator "Aggregate Function Transformation"

Embed Size (px)

DESCRIPTION

BISP is committed to provide BEST learning material to the beginners and advance learners . In the same series , we have prepared a complete end-to end Hands-on guide for building financial data model in Oracle Data Integrator.The document focuses on how the real world requirement should be interpreted. The mapping document template with very simplified steps and screen shots makes the complete learning so Easy . The document focuses on how to calculate the aggregate function .Join our professional training program and learn from experts.

Citation preview

Page 1: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Delivery By :

Presented By : BISP Solutions INC.

Oracle Data Integrator 11g

Transformation Example

Using Aggregate Function

1

Page 2: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Description: BISP is committed to provide BEST learning material to

the beginners and advance learners . In the same series ,

we have prepared a complete end-to end Hands-on guide

for building financial data model in Oracle Data

Integrator.The document focuses on how the real world

requirement should be interpreted. The mapping

document template with very simplified steps and screen

shots makes the complete learning so Easy . The

document focuses on how to calculate the aggregate

function .Join our professional training program and

learn from experts.

2

Page 3: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

S.NO TITLE SLIDE NO.

1 Introduction 4

2 Data Model 5

3 ETL Mapping 10

4 Database Connectivity 13

5 Bringing Metadata 19

6 Creating Interface 23

7 Required Output 28

8 Q&A 30

3

Page 4: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Calculate Aggregate Function in Target in Oracle Data Integrator .

In this example, we calculate aggregate function in Target . There are

following Step to follow to calculate aggregate function in Oracle Data

Integrator.

Create master and work repository in Oracle Data Integrator.

Import source database and Target table .

create mapping and drag and drop source and target table into

mapping designer window.

Establish a connection of source and target technology with that of

particular database.

Create a model and Reverse Engineering the datastore according to

the technology.

Create new interface inside project and then come to mapping tab

and make a mapping between source and target datastores.

Then create aggregate transformation to group by column.

Then come to flow tab and define the knowledge module based on

source and target.

Then save and Execute Interface and see the result in operator

navigator and view the result in target datastore

Introduction

4

Page 5: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Below Is the Data Model of GoSales

5

Page 6: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Source Table Structure This is my Table Structure for the source table ORDER_DETAILS in oracle

database.

6

Page 7: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Source Data

7

Page 8: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Target Table Structure Below is the Table structure of the TRG_ORDER_DETAILS target table in oracle

database.

8

Page 9: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

TARGET DATA

9

Page 10: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

What is ETL Mapping document ?

ETL mapping Documents contains source , staging area , target

and the Business Rules Information and it is most important

document for the developer . And Below is my Mapping Document

which contains

Source File Name

Source Field Name

Source Field Data Type

Source Field Length

Source Field Description

Business Rule

Staging Area

Target Table Name

Target Field Name

Target Field Data Type

Target Field Length

10

Page 11: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Source : Used Oracle as my Source Database.

Staging Area : Used oracle as my Staging Area.

Target : Used Oracle as my Target Database.

After Mapping we have to Review from the EndUser and then sign

off From them.

BEFOREMAPPING_ORDERDETAIL.xlsx

AFTERMAPPING_ORDERDETAIL.xlsx

11

Page 12: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Staging Area: A place where data is processed before entering the warehouse.

Staging Area is temporary location where data from source systems is

copied. A staging area is mainly required in a Data Warehousing Architecture

for timing reasons. In short, all required data must be available before data

can be integrated into the Data Warehouse

Here I have used Scott schema as staging table and you have to define

staging table inside the physical schema at the time when you are establishing

connection between oracle database and oracle data integrator.

12

Page 13: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

DATABASE CONNECTIVITY IN

ORACLE DATA INTEGRATOR

13

Page 14: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Now I have to establish a connection between oracle and ODI .For

establishing A Connection come to the Topology Navigator .select Oracle

as Technology ,Right Click oracle and select New DataServer .In this we

have to provide value to Name , Instance , Dba UserName , Password and

JDBC Driver.

14

Page 15: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

This will establish a connection between oracle and ODI

15

Page 16: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

And Now Right click DataServer and select Physical schema . Here you

have To fill information like Schema and work Schema.

16

Page 17: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

After creating Physical Schema in DataServer which helps in establishing

connection With a particular schema , Now Create a context like Development ,

production and Testing Which helps to make a mapping between physical and

logical Architecture.

How to create context ? Just click on the context tab and then on the Right side of context tab you will

find new Context options ,select that “New Context” and create a context for

Development ,Production and Testing and If anything else is there than create

that one also.

17

Page 18: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

After Context create a Logical Schema for Oracle .

How to create Logical Schema ?

Click on Logical Architecture ,Then select oracle technology .Right Click

oracle and Select logical schema and provide information as shown in

below diagram.

18

Page 19: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

HOW TO BRING METADATA

FROM DATABASE TO

ORACLE DATA INTEGRATOR

19

Page 20: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

After establishing a connection between oracle and ODI ,go to the Designer

Navigator Here you have to bring the metadata of customertrans datastore .For

this you have to create Model folder and sub model for organizing datastore

.Right click LOAD_ORACLE ,

20

Page 21: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

And Select New Model and fill all details provided in previous sheet and then

select Reverse Engineering Button ,It will bring all the datastore available in the

sales schema

21

Page 22: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

After bringing metadata from particular datastore on the

model tab , click on the Project tab and here we have to apply

the Required Business Rules using interfaces How to

implement business rule in project tab ?

Go to the Project tab , Expand first folder .Here you will find

interface . Right click interface and select new interface .It will

open interface window , here you will provide Name of the

Interface , Optimization context . Now click on the mapping

tab . Here you will get 2 window one for the source and other

for target like I am showing in the next

Screen .

22

Page 23: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

CREATING INTERFACE IN

ODI

23

Page 24: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

24

Page 25: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Here I have inactivate all the columns which I don‟t required by just click

Particular column it will open property window and there uncheck Active

Mapping.

25

Page 26: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Click on the flow tab there you have to define required knowledge

module and Make the option true or false depend on your requirement

and then save and execute.By default staging area is in the target

26

Page 27: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

Below is the background code executed by odi for Aggregate Function min using

group by clause.

27

Page 28: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

REQUIRED OUTPUT

28

Page 29: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

After successfully executing the interface select again target interface , Right

Click target interface and select „data‟ .It will show the required output.

29

Page 30: Oracle Data Integrator "Aggregate Function Transformation"

www.hyperionguru.com www.bisptrainings.com

30