IBM Software Group | Tivoli Software© 2012 IBM Corp.

TASP Workshop - Day 1Integration of Data Sources

Sanjay Nayak, Software Architect11 June 2012

IBM Software Group | Tivoli Software© 2012 IBM Corp.2

Agenda

TASP Mediation Architecture Re-cap

Data Sources Integration Options

Note: UDM = Universal Data Mediator (core platform)

IBM Software Group | Tivoli Software© 2012 IBM Corp.3

TASP Mediation Architecture - 1

IBM Software Group | Tivoli Software© 2012 IBM Corp.4

TASP Mediation Architecture - 2

Data Source 1 Data Source 2 Data Source 3

Extractor Job 1 Extractor Job 2

XML File

XML File

Processor Job 1 Processor Job 2

CSV File

CSV File

Resource and Data

Model

TASPDB

IBM Software Group | Tivoli Software© 2012 IBM Corp.5

TASP Mediation Architecture - 3

Common UDM Core consists of common components, e.g.,• Custom Stages• Libraries, JARs, etc

TASP Mediation Packages:• Mediation package• Common Extractor package

Common UDM Core

Extractor Processor Merge

InfoSphere DataStage

IBM Software Group | Tivoli Software© 2012 IBM Corp.6

TASP r1.1 Support

R1.1 supports

– 1 Topic

– 1 Merge instance

– 1 Processor instance

– Multiple Extractor instances

IBM Software Group | Tivoli Software© 2012 IBM Corp.7

Extractor Output XML File Format Extension of 3GPP PM IRP XML File

File name

C20120111.0000-0600-20120111.0015-0600_NTMEMORYGroup_1326271113257.xml

Content

IBM Software Group | Tivoli Software© 2012 IBM Corp.8

Data Source Integration Options Common Extractor as-is

– Subject of this training

Customize Common Extractor

– Requires DataStage training

Custom Extractor

– Produce XSD API conforming XML file

– Not necessary to be DataStage based

– If DataStage based, requires DataStage training

IBM Software Group | Tivoli Software© 2012 IBM Corp.9

What is Common Extractor? Driven from PoC experiences

Objective: support most data-sources by configuration only

Meta-data based job

Designed to support Database and File data sources

– Currently supports ITM

– Being enhanced all the time from PoC experiences

IBM Software Group | Tivoli Software© 2012 IBM Corp.10

Common Extractor as-is Out-of-the-box support for ITM as data source

– ITM Tivoli Data Warehouse (TDW) data-source

– ITM Warehouse Proxy CSV files interface

– ITCAM

Inputs:

– ITM ODI (Object Definition Interchange) files, e.g., dockux, docknt

– Data information (questionnaire template exists)

– Configuration to specify what to extract

IBM Software Group | Tivoli Software© 2012 IBM Corp.11

Data Source Integration Experiences from PoCs

IBM Software Group | Tivoli Software© 2012 IBM Corp.12

References (internal) TASP Documentation (TOP):

https://nc136170.tivlab.austin.ibm.com:8448/help/index.jsp

TASP Common Extractor User Guidehttps://nc136170.tivlab.austin.ibm.com:8448/help/topic/com.ibm.tasp.doc/extractor_common/c_tasp_common_extractor.html

TASP Administration Guide: Extractor output format XSDhttps://nc136170.tivlab.austin.ibm.com:8448/help/topic/com.ibm.tasp.doc/admin_guide/c_tsaa_adminguide.html

SMC wiki:https://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Tivoli%20Analytics%20for%20Service%20Performance/page/Home

TASP PoC Data Source Information Templatehttps://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/Tivoli%20Analytics%20for%20Service%20Performance/page/Proof%20of%20Concept