Upload
dolan
View
19
Download
0
Embed Size (px)
DESCRIPTION
EMC IT BI Strategy Update. Table of Contents. Information Management Core Disciplines Journey to Date Background Vision Progress to Date Example: BI Grid Opportunities Master Data Management / Data Quality. A. B. C. D. Information Management Core Disciplines. - PowerPoint PPT Presentation
Citation preview
1© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT BI Strategy Update
2© Copyright 2009 EMC Corporation. All rights reserved.
Table of Contents
Information Management Core Disciplines
Journey to Date
– Background
– Vision
Progress to Date
– Example: BI Grid
Opportunities
– Master Data Management / Data Quality
A
B
C
D
3© Copyright 2009 EMC Corporation. All rights reserved.
• Guarantees data availability where and when it is required
• Movement and transformation of enterprise information
• Interconnectivity of IT portfolio
• Standardized formats and service interfaces – SOA
Data Data IntegrationIntegration
• Identification and deduplication of shared master data
• Cross-referencing and disambiguation
• Hierarchy management• Data governance framework
and stewardship processes
Master Data Master Data ManagementManagement
• Unstructured data storage and management
• Workflow-based publishing & versioning services
• Tie-in to enterprise portal and user identity / security strategies
Content Content ManagementManagement
• Framework and organization to ensure management of data as a strategic corporate asset
• Data stewardship• Policies and procedures;
monitoring and measuring
Data Data GovernanceGovernance
• Data warehouse methodology – envisioning to deployment
• Business use-case- or function-specific datamarts / reporting solutions
• Moving with agility fromreactive to predictive capability
Business Business IntelligenceIntelligence
• Assurance that trustworthy data is accessible at time of demand
• Standardization& cleansing• Business data rule
enforcement• Stale data refresh• Augmentation from external
sources
Information Information QualityQuality
Information Management Core Disciplines
4© Copyright 2009 EMC Corporation. All rights reserved.
BI Journey to Date
BI Roadmap launched in 2007
Objective:
“Define the target BI and Reporting services delivery model which will serve as the compass for future BI projects, including:
– BI Reference architecture– Services delivered from IT– Delivery Roadmap– Organization structure and processes needed to support delivery model“
Assessment Included Identifying:– Limitations in the existing BI and Reporting environment– Capability gaps– Opportunities to improve efficiency and quality of service
TOC
2007“Assess”
2008
“Enable”
2009
“Prove”
2010
“Get Value”
2011…
5© Copyright 2009 EMC Corporation. All rights reserved.
Architecture Findings:
•Existing tool set was obsolete•Lacked advanced visualization•Aging infrastructure unable to scale•Redundant hardware and data•Disparate BI architectures•Complex support structure•Multiple points of reconciliation •No tiering or archiving strategy
Business Impact:
•Customer dissatisfaction -> Shadow•Data is incomplete / quality•Increased infrastructure costs•Increased support costs•Increased Business costs
Architecture Findings
Oracle 11.0.3
Source SystemsSource Systems
Oracle 11i
Peoplesoft
SABA
eTime
EAS
NRT
DW SystemsDW Systems
IDW
EDW
CQDM
GS
Finance
HR
Marketing
Sales
ETLETL
6© Copyright 2009 EMC Corporation. All rights reserved.
Governance Findings
Business
BTG
Delivery
Assets
Governance Findings:
•Limited cross functional awareness •No cross functional prioritization•Inconsistent collaboration•Master Data management / data quality ownership•Functional bottom up reporting
Business Impact:
•Business lacks confidence in data •Reverts to gut based decisions•Analysts “fixing” data vs. using data•Redundant / wasted effort•Inconsistent metrics
NRTSales / TS
IDWFinance
EDWGS
IQDFCQ
ERG COPSERG G & A
ERG GS ERG CQ
BTGSales
BTGTS
BTGFinance
BTGGS
BTGCQ
Sales TS Finance GS CQ
7© Copyright 2009 EMC Corporation. All rights reserved.
BI Cloud Vision
Oracle 11.0.3
Source SystemsSource Systems
Oracle 11i
Peoplesoft
SABA
eTime
EASEnterprise Information
Business Information
ETL
Business Intelligence
Business
Rules
Analyze
Operational Users
Management Users Analytical Users
C O M MNO
AC C E S S
L A Y E R
Cleansed – Standardized – Consolidated - Reliable
Business Rules Applied – Actionable - Measures
Planning – Forecasting – Trending – Performance Management
8© Copyright 2009 EMC Corporation. All rights reserved.
Progress to Date
Projects:•OBI Enterprise Infrastructure•OBI POC w/ SMF
Value: Foundational
Projects:•SMF•HR Analytics•GS Skills•BI Grid Replatform•FARM Tool
Value: NPV $4M
Projects:•GDW Wave 1 (CS)•GDW Wave 2 (Sales & Finance)•Corporate Quality•TS
Value: NPV $18.2M
* Requested in budget
9© Copyright 2009 EMC Corporation. All rights reserved.
BI Grid: Live November 2009
Platform for FuturePlatform for Future
DMX to V-MAX ArchitectureDMX to V-MAX ArchitectureFirst Deployment of EFD and First Deployment of EFD and Tiered Data LayoutTiered Data Layout Unix to Linux Migration with 6 Unix to Linux Migration with 6 Node GridNode GridSun Solaris to X-86 ArchitectureSun Solaris to X-86 ArchitectureData ILMData ILMServices Configured for each Services Configured for each Major FunctionMajor Function
Massive Massive Performance GainsPerformance Gains
10x Performance Gains for Day 10x Performance Gains for Day 1 Processing1 Processing180% improvement in batch job 180% improvement in batch job performanceperformanceDatamart update times cut in halfDatamart update times cut in half200% improvement in dashboard 200% improvement in dashboard renderingrendering2-3x performance improvement 2-3x performance improvement in reporting cube build timein reporting cube build time
Seamless CutoverSeamless Cutover
15 Billion Rows/10TB of 15 Billion Rows/10TB of Data MigratedData MigratedEnd to end Leverage of End to end Leverage of EMC TechnologyEMC Technology110 hour Cutover110 hour Cutover
Significant Significant Reduction in TCOReduction in TCO
3X Reduction in Storage 3X Reduction in Storage footprintfootprintServer footprintServer footprintConsolidation of Databases Consolidation of Databases
IT Proven IT Proven
IT and Engineering IT and Engineering Collaboration Collaboration Development and Validation of Development and Validation of Engineering Best PracticesEngineering Best PracticesPublication of White Paper Publication of White Paper Engagement with Partners Engagement with Partners (Informatica and ZettaPoint)(Informatica and ZettaPoint) Reduction in backup time from Reduction in backup time from 16 to 4 hours 16 to 4 hours
10© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT – Consolidated Oracle optimized Warehouse using Symmetrix V-MAX
EFD (R5)
FC, SATA (R10)
FC, SATA (R5)
SATA (R5)
BCV/CloneBCV/Clone
Dynamic SRDF PRODUCTION
Perf
Global Data Warehouse
BACKUP Copy
TEST
Primary Site Secondary Site
GOLD Copy
BCV/CloneBCV/Clone BCV/CloneBCV/Clone
DRFC, SATA (R10)
FC, SATA R(10)
SATA (R5)
SATA (R5)
EMC Symmetrix V-MAXEMC Symmetrix V-MAX512 GB Cache512 GB Cache
400 GB 400 GB Flash DrivesFlash Drives
300 GB - 15K RPM 300 GB - 15K RPM Fibre DrivesFibre Drives
1 TB - 7200 RPM 1 TB - 7200 RPM SATA DrivesSATA Drives
DEV
Global Data Warehouse
Flash DrivesFlash Drives – Objects with – Objects with most stringent response timemost stringent response time
Fibre DrivesFibre Drives – Objects from – Objects from current & recent few quarterscurrent & recent few quarters
SATA DrivesSATA Drives – Historical data – Historical dataNRT Dev
REVD PASD
NRT Prod
REVP PASP OICP
NRT Test
REVT PAST OICT
FC, SATA (R10)
SATA (R5)
SATA (R5)
11© Copyright 2009 EMC Corporation. All rights reserved.
EMC IT - BI Grid DB - Environment Architecture
Primary SitePrimary Site
Production
Backup Copy Gold Copy
Development Test
DR
Performance
Dynamic SRDF
Secondary SiteSecondary Site
BCV/CloneBCV/Clone
7 am
7 am
7 pm7 pm
BCV / CloneBCV / Clone
Production
6 x Dell 710
Development & Test
4 x Dell 710
DR & Performance
6 x Dell 710
ST
AT
N5K-PAC-1200W
FAIL
OK
N5K-PAC-1200W
FAIL
OK
FAN STATUS
N5K-C5020-FAN
1
FAN STATUS
N5K-C5020-FAN
2
FAN STATUS
N5K-C5020-FAN
3
FAN STATUS
N5K-C5020-FAN
4
FAN STATUS
N5K-C5020-FAN
5
PS
1P
S2
ST
AT
N5K-PAC-1200W
FAIL
OK
N5K-PAC-1200W
FAIL
OK
FAN STATUS
N5K-C5020-FAN
1
FAN STATUS
N5K-C5020-FAN
2
FAN STATUS
N5K-C5020-FAN
3
FAN STATUS
N5K-C5020-FAN
4
FAN STATUS
N5K-C5020-FAN
5
PS
1P
S2
Cisco Nexus 5020s for 10G RAC Interconnect
ST
AT
N5K-PAC-1200W
FAIL
OK
N5K-PAC-1200W
FAIL
OK
FAN STATUS
N5K-C5020-FAN
1
FAN STATUS
N5K-C5020-FAN
2
FAN STATUS
N5K-C5020-FAN
3
FAN STATUS
N5K-C5020-FAN
4
FAN STATUS
N5K-C5020-FAN
5
PS
1P
S2
ST
AT
N5K-PAC-1200W
FAIL
OK
N5K-PAC-1200W
FAIL
OK
FAN STATUS
N5K-C5020-FAN
1
FAN STATUS
N5K-C5020-FAN
2
FAN STATUS
N5K-C5020-FAN
3
FAN STATUS
N5K-C5020-FAN
4
FAN STATUS
N5K-C5020-FAN
5
PS
1P
S2
Cisco Nexus 5020s for 10G RAC Interconnect
BC
V /
Clo
ne
BC
V /
Clo
ne
BC
V/C
lone
BC
V/C
lone
BCV/Clo
ne
BCV/Clo
ne
FibreSATAFlash
FibreSATA
Oracle 11g RAC, ASM & RDBMSOracle 11g RAC, ASM & RDBMS
Fibre SATA SATA
SATA SATA
RMAN Backup HostRMAN Backup Host
DB Subset HostDB Subset Host
FibreSATA
Fibre
EDLEDL
Flash DrivesFlash Drives – Objects with – Objects with most stringent response timemost stringent response time
Fibre DrivesFibre Drives – Objects from – Objects from current & recent few quarterscurrent & recent few quarters
SATA DrivesSATA Drives – Historical data – Historical data
Fibre
2 TB
/ H
r
2 TB
/ H
r
12© Copyright 2009 EMC Corporation. All rights reserved.
Highlights 67% reduction on Incremental NRT Batch (56 min), improvement of nearly 2 hours Near 62% reduction in processing time for OIC Batch 58% reduction on average in processing time for PAS Procedures, some as high as 87%
BI Grid Production Stats – NRTM
in
Min
Before After
13© Copyright 2009 EMC Corporation. All rights reserved.
APPENDIX
14© Copyright 2009 EMC Corporation. All rights reserved.
Findings
• Existing tool set (Brio) was old technology sunsetted by Oracle• EMC culture of bottoms up “roll your own” reporting• No support for dashboarding, KPIs, advanced visualization• Aging infrastructure unable to scale to meet growth of EMC
Delivery
• Multiple data warehouses with embedded business rules• Business rules embedded in reports• No enterprise approach for management of key data assets• No sense of ownership for upstream data quality
Data Quality
• Limited cross functional awareness of BI initiatives• No cross functional prioritization of initiatives• No cross functional collaboration on delivery
Governance
• Multiple hardware and DB environments hosting same data• Multiple teams supporting redundant data sets & reports• Multiple points of reconciliation consuming IT and Business
resources• No tiering or archiving strategy
TCO
15© Copyright 2009 EMC Corporation. All rights reserved.
Business Impact
16© Copyright 2009 EMC Corporation. All rights reserved.
Scorecard
17© Copyright 2009 EMC Corporation. All rights reserved.
BI Replatform: Performance Highlights
Overall Job runtime reduced by 2.5 hrs
SMF MV’s completes 45 min earlier
BookBill report finishes 3 hrs earlier than old production
CCA batch takes 50% of original time, from 3 hrs to 1.5 hrs
78% improvement in OBI Dashboard rendering and 74% improvement in OBI Drill down performance
IDWIDW
NRTNRT
EssbaseEssbase
NRT REV Batch and NRT OIC Batch jobs gained approximately 2 hrs
NRT PAS Batch shows improvement of 58% on average across the individual jobs
NRT Book Bill Report delivered 3.5 hrs earlier and NRT Sales Rev Report delivered 3 hrs earlier than old production
Channels Data Mart now updates in half the original time
SMF Essbase Cube build improved by 1.5 hrs, from 2 hrs to 30 min
Farm cube update down to 9 min from 3 hrs