Upload
adila
View
46
Download
2
Tags:
Embed Size (px)
DESCRIPTION
A Global Leader in Data Migration, Replication, and Integration Solutions. Agenda. tcVISION Overview Architecture Metadata & Modeling Replication tcVISION Demo Q & A. Mainframe Data Replication and Integration without Compromise. Different data formats Different data models - PowerPoint PPT Presentation
Citation preview
1 tcVISION: Enterprise Data Replication Without Compromise
A Global Leader in Data Migration, Replication, and Integration Solutions
2 tcVISION: Enterprise Data Replication Without Compromise
Agenda
• tcVISION• Overview• Architecture• Metadata & Modeling• Replication
• tcVISION Demo
• Q & A
3 tcVISION: Enterprise Data Replication Without Compromise
Mainframe Data Replication and Integration without Compromise
4 tcVISION: Enterprise Data Replication Without Compromise
Data Replication
• Different data formats• Different data models • Large data volumes• Limited batch window• Requirement for up-to-
date information
• Moving/replicating data...• as much as needed• as little...• as transparent...• as flexible...• as secure...• ...AS POSSIBLE
The Problem: The Solution:
...with
5 tcVISION: Enterprise Data Replication Without Compromise
tcVISION Overview
• Innovative software solution to process changed data
• Automatically identifies changes and files
• Continuously propagates the changed data to target systems in real-time or time intervals
• Offers a rich set of processing and control mechanisms
• Contains powerful bulk processors for initial load of mass data or the cyclic exchange of larger data volumes
• Efficient, fast and reliable
• Supports multiple datasources – Oracle, SQL Server, DB/2, IMS/DB, VSAM, DL/I, ADABAS, IDMS, DATACOM, Flat File
6 tcVISION: Enterprise Data Replication Without Compromise
tcVISION Architecture
7 tcVISION: Enterprise Data Replication Without Compromise
Control Board
• MS Windows GUI Interface• Single and central point of
administration• View manager and
transaction logs• Built-in Wizards for mapping
and modeling metadata• Script Generation for bulk
transfer and replication• Monitoring
• Replication status
• Script output
• DBMS extensions
8 tcVISION: Enterprise Data Replication Without Compromise
Wizard-Assisted Metadata Import
Copy Books• VSAM file layout
• IMS/DLI Segment layout
• PS/PDS/SAM file layout
IMS DBD, PSB• Segment hierarchy
• Key information
Dictionaries
• ADABAS PREDICT
• CA-DATACOM
Schema definitions• CA-IDMS
9 tcVISION: Enterprise Data Replication Without Compromise
• Metadata import supported for ADABAS, DATACOM, DB2, Copybooks, IDMS, MySQL, ODBC data sources, Oracle, SQL Server, and tcACCESS data sources
• Automated generation of normalized RDBMS schemata with explicit source column to target column mapping
• Robust modeling and mapping via wizards – normalize, denormalize, substring, concatenate, filter, table lookup, user-exits, operators (+, -, *, /), date/time
• All mapping information stored in a RDBMS-based metadata repository
Mapping & Modeling
10 tcVISION: Enterprise Data Replication Without Compromise
Intuitive Mapping & Modeling
11 tcVISION: Enterprise Data Replication Without Compromise
• Replicate to non-RDBMS databases’ native schema, no schema changes required for target mainframe databases (ADABAS, DATACOM, DB/2, IDMS, IMS & VSAM)
• Sample table replication scenarios:• 1:1 Replication
• 1:n Replication with no dependencies
• 1:n Replication with dependencies (OCCURS and MU/PE)
• n:1 Replication with no dependencies
• n:1 Adjunction replication (source Parent & Child table(s)
• n:1 Combination replication
• n:n Replications
Designed for Bi-Directional Replication
12 tcVISION: Enterprise Data Replication Without Compromise
Support for Complex Replication Scenarios
1:1
1:n
n:1
n:n
Also special cases:• Data Warehouse Replication
• Journal Replication
13 tcVISION: Enterprise Data Replication Without Compromise
Wizard assisted column mapping
14 tcVISION: Enterprise Data Replication Without Compromise
Automatically apply target schema
15 tcVISION: Enterprise Data Replication Without Compromise
Multiple CDC Methods
Data Latency
Data Transfer Volume
16 tcVISION: Enterprise Data Replication Without Compromise
Multiple CDC Methods
• Comparison of data snapshots using checksums
• Efficient transfer of changed data since last processing
• Flexible processing options (SORT etc.)
• Automatic creation of deltas by tcVISION
• IMS/DB, DL/I, VSAM, DB2, Oracle, SQL Server, ADABAS, CA-IDMS, CA-DATACOM, sequential files, ODBC
• Efficient transfer of entire databases
• Analysis for data consistency (verification)
• Initial load (ETL) and periodic mass data transfer
• One-step data transfer• IMS/DB, DL/I, VSAM, DB2,
Oracle, SQL Server, ADABAS, CA-IDMS, CA-DATACOM, sequential files, ODBC
• Transfer of changed data in scheduled time frame
• Generally batch-type process
• Generally run immediately after archive log creation
• IMS/DB, VSAM, DB2, DL/I, Oracle, SQL Server, ADABAS, IDMS, CA-DATACOM, CICS logs
• Real-time capture of changed data directly from the DBMS
• Secure data storage even across DBMS restart
• Flexible propagation methods
• CA-IDMS, IMS/DB, VSAM, DB2, CA-DATACOM, ADABAS, Oracle, SQL Server
17 tcVISION: Enterprise Data Replication Without Compromise
Stage 0:Data in internal raw format
Stage 1:Data in tcVISION format (before and after images)
Stage 2:Data normalized with structure definition
Stage 3: Data in DML or Loader format
Staged Processing
Exit pointsavailable at every stage
18 tcVISION: Enterprise Data Replication Without Compromise
tcVISION - Flexibility
• User defines on WHICH platformstage processing should be done
• Normal implementation: Do as little as possible on the mainframe
• Mainframe: Capture data; Send data (internal format) to target (Stage 0)
• Receiving machine: Process data up to Stage 3
19 tcVISION: Enterprise Data Replication Without Compromise
Cost Savings
• Use Staged Processing to reduce mainframe resource consumption
• Minimum processing on the mainframe – only what is essential
• Process all DBMS Journal and Log datasets on Open System
• Data Transformation is carried out on target platform – Open System; e.g.,
• Data converted from mainframe data types to relational data types
• Generation of SQL / SQL Loader files
• Date-time formatting
• EBCDIC-ASCII translation
20 tcVISION: Enterprise Data Replication Without Compromise
• Real-time CDC – captures the Adabas CLOG using Adabas UEX4 & UEX8. tcVISION uses a Data Collector & Data Pool to collect & temporarily store the CLOG records until they are ready to be processed
• Batch CDC – uses the Adabas PLOG
• Efficient – tcVISION reads the CLOG & PLOG and only transfers transactions for Adabas files defined to tcVISION. All other transactions are ignored.
• Using Staged Processing, transformation of CLOG & PLOG data is performed on open systems, which saves mainframe CPU & DASD
tcVISION – ADABAS CDC
35 tcVISION: Enterprise Data Replication Without Compromise
• Uses ORACLE REDO Logs
• 'Single Instance Mode' supported for 10.1, 10.2 and 11.1
• Log processing may not be on the same processor where the database is running
• may not be on the same archticeture (Little/Big Endian machines)
• may not be on the same operating system (Windows, UNIX, LINUX)
tcVISION – Oracle CDC
36 tcVISION: Enterprise Data Replication Without Compromise
SCN – System Change Number
• This is a sequential counter, identifying precisely a moment in the database. This is the most accurate way to identify a moment in time.
• tcVISION Control Board can be used to display current SCN
• PROLOG script can be used query current SCN from ORACLE and pass to tcSCRIPT
• Using RESTART FILES a "running SCN" is automatically maintained
tcVISION – Oracle CDC
52 tcVISION: Enterprise Data Replication Without Compromise
Summary