Upload
rinky25
View
351
Download
1
Tags:
Embed Size (px)
DESCRIPTION
Citation preview
ETI Built-to-Order Integration for Microsoft SQL Server
Laurie Crossett, VP Business [email protected]; 970-259-0388
“ETI Built-to-Order Connectors provide an efficient and fast way to load data from non Microsoft-based environments into SQL Server 2005”Donald Farmer, Group Program Manager SSIS, Microsoft
2006 Microsoft Partner Awards Program winner in the Customer Experience
award category for the US.
© 2006 ETI All Rights Reserved
Messaging – Our Promise
Customer Information
Business Intelligence
Mergers & Acquisitions Consolidation
Compliance & Governance
Data as a Service
Master Data Synchronization
Value Through Transparency
Enable Revenue Growth Reduce Costs Comply with Regulations Future proof
See the Inventory in your dataSee the Customer in your dataSee the Profits in your dataSee the Future in your data
© 2006 ETI All Rights Reserved
Delivering on the Promise
Product Use Cases
Data Synchronization Data Migration Data Services for SOA
Built-to-Order Pre-BuiltPlatformDeliver & Purchase
Select Customers
Data Quality Services Layer
© 2006 ETI All Rights Reserved
Technology Stack
© 2006 ETI All Rights Reserved
Extending and Complementing
SCM ERP
PackagedApplications
CRM
Partners
SAAS Providers
OutsourcingProviders
Data Marts
Unstructured Data
CustomApplications
Data Warehouses
Databases
Legacy
Mainframe
ETI BTO Connectors • ETI Data Profiler• ETI Data Cleanser Designed to move data in and out of SSIS or SQL05 tables One-to-one or many-to-many interfaces; Mainframe or Relational Business profiling, cleansing and pre-processing load options Cross Platform and Business Applications High Volume and High Performance
Built-to-Order Integration for Microsoft SQL Server
Web site: www.eti.com/products/icenter.htmlEmail: [email protected]: 512.383.3005
© 2006 ETI All Rights Reserved
Built-to-Order Process
ETI Integration Center Process
Engage & Inform
Discovery
Estimate
Detailed Specifications
Purchase
Build & Test
Release & Acceptance
iCenter Portal
Integration Center Comprehensive process to ensure quality Leverages ETI Solution V5 to generate
connectors – no hand coding Staffed with experienced integration engineers Robust testing and validation is performed Guaranteed to run per specification Maintenance and change requests are managed
by ETI in a predictable and cost efficient manner
Customer installation and Deployment
© 2006 ETI All Rights Reserved
Built-to-Order Integration
Deliverables ETI BTO Connector executable file(s) Installation and deployment guide based on customer’s
infrastructure and environment Comprehensive mapping specification Detailed business rules and transformation specification report Test report
Delivered in as little as two weeks Cost effective fixed price Guaranteed to run per specification
Guaranteed
Business Value
© 2006 ETI All Rights Reserved
Performance Results
9 million rows - 1kb (70-90 columns)
Semiconductor Manufacturer Telecommunications Company
11.7 million rows over a 10 Mbps WAN
Teradata
96 min.
11 min.
9X FasterTeradata
315 min.
31 min.
10X Faster
© 2006 ETI All Rights Reserved
Comprehensive Connectivity
Mainframe VSAM IMS COBOL And more
Databases DB2 Oracle SQL Server And more
BI / Reporting SAS Cognos Business Objects And more
Applications SAP Siebel Oracle Financials And more
Technology Web Services Java C++ And more
Industry XML HIPAA EDI And more
Unstructured email Word / Excel PDF And more
Proprietary Custom Applications Telecom switches Web logs And more
File Formats ASCII Binary EBCDIC And more
Messages / Transactions WebSphere webMethods BizTalk And more
ETI Built-to-Order HPCs for SQL Server Hundreds of connectivity options Virtually any data source On any platform
© 2006 ETI All Rights Reserved
Common Use Cases for BTO
Data Synchronization Populate DW and DM Access and aggregate for regulatory compliance Extend mainframe and legacy data Exchange data with partners and outsource providers
Data Migration New application implementation Legacy conversion Systems consolidation CRM and ERP implementation
Data Services for SOA Aggregated data for Web Services Transaction data for EAI, ESB and BPM Business reporting and monitoring Single view of customers, products, inventory, patients and more
© 2006 ETI All Rights Reserved
BTO Key Benefits & Features
Key Benefits Dramatically reduces the cost, complexity and risk in comparison to hand coded interfaces
and enterprise integration software platforms Eliminates the connector deployment bottleneck that is common in most data and application
integration projects Eliminates the “one-size fits none” inherent with generic off-the-shelf adapters with a ready to
run solution Dramatically reduces processing and batch windows for large data loads between systems
Key Features Built-to-order connectors are designed, configured and tested to your exact specifications Up to a 20X performance improvement over generic drivers Maintenance/change requests are managed by ETI in a predictable and cost-efficient manner Documentation for audit, reporting and compliance Comprehensive specification and design documentation including a final test report
© 2006 ETI All Rights Reserved
Built-to-Order Enables SSIS
ETI BTO Connectors for SSIS• Fully integrated as SSIS data flow source or destination adapters• Option of performing data transformations prior to loading SSIS• Option of “pull” (SSIS-triggered step invokes the connector and brings back the results)
or “push” (connector delivers a file or message that SSIS-triggered step loads when needed)
AS400 Source
Mainframe, UNIX, etc.
© 2006 ETI All Rights Reserved
Campaign for Microsoft US Field
• Free: ETI Built-to-Order Connectors 6 in all; 2 per Microsoft Region in USA
• Requirement: SQL Server 2005 as Source or Target
• 60 Day Offer: Sept. 12 – Nov. 17, 2006
$150,000 Investment by ETI in MS Partnership$150,000 Investment by ETI in MS Partnership
© 2006 ETI All Rights Reserved
The Importance of Data Quality
Data is the raw material for information Good business decisions require accurate information Existing data is often re-purposed for new uses
ETI Data Profiler
© 2006 ETI All Rights Reserved
The Hidden Costs of Data Quality
Project Results 83% of all data migration projects fail to meet cost or
schedule plans--Standish Group 50% of all data warehousing and CRM integration
projects are canceled or receive limited acceptance due to data quality problems--Gartner
Successful17%
Overrun49%
Failed34%
Reports have misleading data leading to flawed decisions Duplicate invoices saved one company $1.8 million
Unplanned project costs and delays Data integration projects New application implementations Data and systems consolidation projects
Operational teams are forced to manage issues Impacting customers, critical processes and regulatory compliance
© 2006 ETI All Rights Reserved
Data descriptions
Example data
IssuesAnalysis Results
Reports
Analysis Teams
Analysis Teams
Management Teams
Management Teams
Other Projects
Other Projects
Data & Application Sources
No centralization of analysis information
Tools are applied “ad hoc” High management overhead Increased effort and risk Projects are abandoned as
frustration increases
Traditional Approach
© 2006 ETI All Rights Reserved
Data Sources
ETI Data Profiler
Project Management
Analysis Teams
Analysis Teams
Management Teams
Management Teams
Other Projects
Other Projects
Single point of reference Data & metadata descriptions Analysis findings Issues & documentation
Designed specifically to support analysis activities
Reduced management overheads Increased confidence through
lower risk
Introducing ETI Data Profiler
© 2006 ETI All Rights Reserved
Profiling and Analysis
• DQ management workflow
• Summary views
• ‘Slice and dice’ issue reporting
• Technical collaboration
Issue Management
• Multi-User Concurrency
• Shared Repository
• Scalable
• Data Driven
ETI Data Profiler
• Secure
• Integrated
Key Features
• Automated profiling
• ‘Drill-down’ navigation
• Suspicious value detection
• Issues and notes
© 2006 ETI All Rights Reserved
Data Source n
Data Source 2
Data Source 1
ColumnProfiling
Join Testing
Key/Dependency Testing
Automated Data Analysis
IssueManagemen
t
ETI Data Profiler
Multi-Dimensional Analysis
© 2006 ETI All Rights Reserved
20%
TraditionalAnalysis
Data Analysis Implement QA
Time and Cost
20% 20%
Rework Cycles
15% 30%
30%30%50%50%
ETIData
Profiling
Not Budgeted
Delivery Deadline
Source:Migration Headaches - Standish Group International
Time to Value
35% Reduction
Eliminated Rework and Risk
ETI Data Cleanser
© 2006 ETI All Rights Reserved
Key Features Parse Identify and isolate data elements within data structures Standardize Normalize data values and formats according to your business rules and those of
third-party reference data Correct Verify, scrub and append data based on a set of sophisticated algorithms and fuzzy
logic Enhance Append additional data, thereby increasing the value Match Identify duplicate records within tables or databases Merge/De-duplicate Combine unique data elements from matched records into a single
source
ETI Data Cleanser Key Features & Benefits
Unique Benefits Intuitive interface enables business analysts to take ownership and interact with data on a
daily basis Transparency to enable each and every interaction with the data to be tracked and audited for
regulatory compliance Configurable to handle each data sources idiosyncrasies and differing levels of data quality
challenges Scalable to handle large and complex volumes of data with support for grid computing Tolerant to handle the random nature of insertion, deletion, and transposition errors
© 2006 ETI All Rights Reserved
Use Cases for ETI Data Cleanser
Data Quality Complement to DW and DM initiatives Cleanse, match and merge – customers, addresses, contacts Enrich data with internal and 3rd party sources Single view of customers, citizens, products, accounts
Data Migration New application implementation Legacy conversion Systems consolidation CRM and ERP implementation
Data Forensics Accounting, payroll and financial systems Anti money laundering and other regulatory requirements Intelligence and law enforcement Ad-hoc fuzzy search and retrieval
© 2006 ETI All Rights Reserved
Why Microsoft and ETI
delivers an end-to-end business intelligence platform with integrated analytics including online analytical processing (OLAP); data mining; extract, transformation and load (ETL) tools; data warehousing and reporting functionality.
delivers high performance data integration & connectivity
SQL Server + ETI BTO Connectors = enterprise BI
SSIS + ETI BTO Connectors = enterprise ETL
© 2006 ETI All Rights Reserved
Sales Scenario: Scaling Teradata EDW
Large Telecom Company Pain: Scalability – could not
move data fast enough Environment: Teradata EDW
with SQL Server Analytics and Reporting
Solution: SQL Server 2005 using ETI HPC for Teradata
Results: processing window met; users received faster access to data for reporting purposes
HP
C
HPC
HPC
HPC
© 2006 ETI All Rights Reserved
Sales Scenario: SQL Server 2005 Upgrade
Large State Government Data Warehouse Pain: Scalability – could not move data fast enough Environment: Oracle & SQL Server 2000 at 93 counties sourcing data to
state-level Teradata EDW
Solution: SQL Server 2005 using ETI HPC for Teradata (out performing Oracle to Teradata)
Daily Feeds
Daily FeedsETI HPC
93 C
ount
y S
yste
ms
StatewideData Warehouse
© 2006 ETI All Rights Reserved
IDMS
DB2
Warehouse
Reports
Mobiledata
Daily Feeds
Daily Feeds
Sales Scenario: Teradata Displacement
International Shipping Line Pain: Teradata Warehouse Environment too expensive Current Environment: Data Sourced from Mainframe IDMS & DB2
to Teradata Data Warehouse Pilot Test Environment
ETI HPC migrating data from Teradata to SSIS SQL Server 2005 replacing Teradata ETI Custom Connectors between IDMS & DB2 to SSIS
HPC
HPC
© 2006 ETI All Rights Reserved
Sales Support
Dedicated Web Page: http://www.eti.com/microsoft/ Press Releases Product Data Sheets White Papers Presentations Contact Information Download HPCs
6 month licenses for MTC 2 week trial licenses for customers
Sales Support & Integration Strategy Demo Support (Teradata, Legacy, etc.) POC/Pilot Support
Microsoft Resources: SQL Server Web Directory ISV Quick Reference Card Front Runner BDM: Dan Mannion; 512-291-1301, [email protected]
© 2006 ETI All Rights Reserved
ETI Built-to-Order Connectivity enables BizTalk
Built-to-Order
ETI eliminates the “one-size fits none” inherent with generic off-the-shelf adapters