Upload
vonhu
View
216
Download
0
Embed Size (px)
Citation preview
<Insert Picture Here>
Petabyte DWH Erfahrungsberichte
aus Europa mit Exa-Stack
Reiner ZimmermannDirector, Product ManagementOracle Data Warehouse Development
Oracle
Exadata
Oracle
Exalytics
Oracle Platform for Information Architecture
Oracle Big Data
Appliance
Oracle
Big Data
ConnectorsOptimized for
Analytics & In-Memory Workloads
“System of Record”
Optimized for DW/OLTP
Optimized for Hadoop,
R, and NoSQL Processing
Oracle Enterprise
Performance Management
Oracle Business Intelligence
Applications
Hadoop
Open Source R
Oracle Big Data Connectors
Da
tab
as
e A
na
lyti
cs
Da
tab
as
e A
na
lyti
cs
Oracle
Advanced
Analytics
Stream Acquire Organize Discover & Analyze
Oracle Business Intelligence
Tools
Oracle Endeca Information
Discovery
Open Source R
Applications
Oracle NoSQL
Database Oracle DataIntegrator In
-Da
tab
as
e A
na
lyti
cs
In-D
ata
ba
se
An
aly
tic
s
Data
Warehouse
Oracle
Database
DW Technologies
• Warehousing has advanced • Columnar DB
• In-Memory DB• Warehousing has advanced incrementally for 20 years
• Problem: all vendors just focus on some technologies
• In-Memory DB
• Smart Storage
• Flash Memory
• Columnar Compression
• Ultra Fast Networking
• Chip-based Encryption
• high scalability
New Trends in DW Technologies
Exadata combines them all!
• Smart StorageOffload processingStorage Index
• In-Memory DB11.2 - RAC shared memory
• Flash MemoryExadata Flash cards
• Columnar DB / Compression• Columnar DB / CompressionHybrid columnar compression
• Ultra Fast NetworkInfiniband
• Chip-based Encryptionnew Intel Chip generation
• Highly scalable1000 TB+
• 77.
8
Example Exadata DW clientsmembers of DW Global Leades program in EMEA
• Ease of deployment• Speed of deployment• Ease of maintenance• Performance
- Query
Customer motivation:
- Query- Load
• Storage reduction• Consolidation
- Mixed workloads
• TCO / ROI
Example Exadata DW clientsReduce Load time – step 2
Source: Presentation: DW Global Leaders WebSeminar – 31.10.12 - Seçil Öncü: Event Aggregation with GoldenGate for Proactive Customer Relationship
Example Exadata DW clientsReduce Load time – step 2
Source: Presentation: DW Global Leaders WebSeminar – 31.10.12 - Seçil Öncü: Event Aggregation with GoldenGate for Proactive Customer Relationship
Example Exadata DW clientsCreate business value with CEP
Source: Presentation: DW Global Leaders WebSeminar – 31.10.12 - Seçil Öncü: Event Aggregation with GoldenGate for Proactive Customer Relationship
Example Exadata DW clientsSpeed of deployment
Source: Presentation: DW Global Leaders WebSeminar – 05.06.09 - Rafał Kudliński : Allegro’s DWH Implementation on HP Oracle Database Machine with OWB & OBIEE
Example Exadata DW clientsSystem Architecture
Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro
Example Exadata DW clientsSystem Architecture
Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro
Example Exadata DW clientsSocial network analysis
Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro
Example Exadata DW clientsRecommendation Engine
Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro
Example Exadata DW clientsEase of maintenance
Source: Presentation: DW Global Leaders Event – Athens – 08.06.11 – Jim Duffy: Electronic Markets DWH with Exadata v2
Example Exadata DW clientsEase of maintenance
Source: Presentation: DW Global Leaders Event – Athens – 08.06.11 – Jim Duffy: Electronic Markets DWH with Exadata v2
Example Exadata DW clientsQuery performance
Source: Presentation: DW Global Leaders Event – Krokow – 10.06.10 – Eric Nagel: Experience about Implementation of the Database Machine (Exadata)
Example Exadata DW clientsstorage cost
Source: Presentation: DW Global Leaders WebSeminar – 26.01.12 – Jörg Otto: Extending Memory & Disk on Exadata @ IDSIDS Customer Snapshot: http://www.oracle.com/us/corporate/customers/customersearch/ids-exadata-snapshot-405106-de.html
Example Exadata DW clientsBI Domain Architecture
Reporting
MSTR
ETL
AB Initio
Oracle ODISource
DBsOracle
DWH
Amount Of Data • 3 Billion CDR per Day
• 600 -1000 GB raw data extracted from 20+ source database
• 5 TB Data on file system processed
• 3-4 TB loaded into databases, all into Exadata
• Approximately 600 TB Customer data stored in multiple Databases• 600 TB (60 TB compressed) on Exadata (6 databases)
Advanced
Analysis
SAS / Oracle
CEP
Oracle
Example Exadata DW clientsSuccess Story in phases – Phase 1
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
June 2010 July 2010
Server Model Sun M9000 Exadata V2
EMC DMX-470 TB
HITACHI USP-V50 TB
Sun M9000 Sparc 7176 Threads
ORACLE Exadata V2
Example Exadata DW clientsSuccess Story in phases – Phase 1
Cpu Type Sun Sparc 7 2.52 GHz Xeon E5540 2.53 GHz
# Of Cpu Threads 176 128
Storage Used 120 TB 25 TB
# of disks 650 168
Max IO Throughput 5 GB/s 21 GB/s
Total RACKS 11 Racks 1 Racks
# of reports/month 50K 50K
Avg Report Time 27 min 3 min
CDR per Day 1.5 Billion 1.5 Billion
# of reporting users 300 300
# of adhoc users 40 40
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
Example Exadata DW clientsSuccess Story in phases – Phase 1
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
Example Exadata DW clientsSuccess Story in phases – Phase 2
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
DW Architecture
June 2010 July 2010 March 2011 April 2011
Server Model Sun M9000 Exadata V2 Exadata V2 2*Exadata X2-2
EMC DMX-470 TB
HITACHI USP-V50 TB
Sun M9000 Sparc 7176 Threads
ORACLE Exadata V2
Cpu Type Sun Sparc 7 2.52 GHz Xeon E5540 2.53 GHz Xeon E5540 2.53 GHz Xeon E5540 2.53 GHz
# Of Cpu Threads 176 128 128 2*128 (only 184 used)
Storage Used 120 TB 25 TB 32 TB 60 TB
# of disks 650 168 168 336
Max IO Throughput 5 GB/s 21 GB/s 21 GB/s 50 GB/s
Total RACKS 11 Racks 1 Racks 1 Racks 2 Racks
# of reports/month 50K 50K 65K 65K
Avg Report Time 27 min 3 min 7 min 3 min
CDR per Day 1.5 Billion 1.5 Billion 3 Billion 3 Billion
# of reporting users 300 300 300 300
# of adhoc users 40 40 40 40
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
Example Exadata DW clientsSuccess Story in phases – Phase 3
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
Example Exadata DW clientsProject Status – end 2012 – all together roughly 1 PB raw!
Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey
Built-in Analytics Secure, Scalable Platform for Advanced Analytics
Oracle Data Mining
Oracle OLAPAnalyze and summarize
• Complex and predictive analytics embedded into Oracle Database 11g
• Reduce cost of additional hardware, management resources
• Improve performance by eliminating data movement and duplication
Oracle Data MiningUncover and predict
Prepaid Churn Prediction
Source: Presentation: DW Global Event, Athens – 09.06.10 - Hasan Tonguç Yılmaz : Processing Turkcell Mobile Network Data with Oracle CEP
Example Exadata DW clientsROI
Source: Turkcell ROI Study: http://www.oracle.com/us/corporate/customers/turkcell-1-exadata-case-study-456284.pdf
Example Exadata DW clientsROI
Source: Turkcell ROI Study: http://www.oracle.com/us/corporate/customers/turkcell-1-exadata-case-study-456284.pdf
Largest Production Exadata DW SystemSK Telekom – South Korea
Source: Presentation: DW Global Event, Hangzhou, China – 06.06.11 - nTel: Architecting 1 PB DW System
Summarywhat you should take away
• Exadata is proven and widely deployed
• Exadata scales
• Exadata is the defacto standard for Oracle DW architectures
• Exadata gives you more performance / more space than • Exadata gives you more performance / more space than “traditional” systems
• Exadata is easy to deply
• Exadata saves you money