38
<Insert Picture Here> Extreme Performance Extreme Performance

- doag.org · ... BI Domain Architecture Reporting MSTR ETL AB Initio Oracle ODI Source DBs ... HITACHI USP-V 50 TB Sun M9000

  • Upload
    vonhu

  • View
    216

  • Download
    0

Embed Size (px)

Citation preview

<Insert Picture Here>

Extreme PerformanceExtreme Performance

<Insert Picture Here>

Petabyte DWH Erfahrungsberichte

aus Europa mit Exa-Stack

Reiner ZimmermannDirector, Product ManagementOracle Data Warehouse Development

DW Global Leaders in EMEA

Oracle

Exadata

Oracle

Exalytics

Oracle Platform for Information Architecture

Oracle Big Data

Appliance

Oracle

Big Data

ConnectorsOptimized for

Analytics & In-Memory Workloads

“System of Record”

Optimized for DW/OLTP

Optimized for Hadoop,

R, and NoSQL Processing

Oracle Enterprise

Performance Management

Oracle Business Intelligence

Applications

Hadoop

Open Source R

Oracle Big Data Connectors

Da

tab

as

e A

na

lyti

cs

Da

tab

as

e A

na

lyti

cs

Oracle

Advanced

Analytics

Stream Acquire Organize Discover & Analyze

Oracle Business Intelligence

Tools

Oracle Endeca Information

Discovery

Open Source R

Applications

Oracle NoSQL

Database Oracle DataIntegrator In

-Da

tab

as

e A

na

lyti

cs

In-D

ata

ba

se

An

aly

tic

s

Data

Warehouse

Oracle

Database

DW Evolution

7

1995 2000 2005 2010 2015

DW Evolution in Size

DW Technologies

• Warehousing has advanced • Columnar DB

• In-Memory DB• Warehousing has advanced incrementally for 20 years

• Problem: all vendors just focus on some technologies

• In-Memory DB

• Smart Storage

• Flash Memory

• Columnar Compression

• Ultra Fast Networking

• Chip-based Encryption

• high scalability

New Trends in DW Technologies

Exadata combines them all!

• Smart StorageOffload processingStorage Index

• In-Memory DB11.2 - RAC shared memory

• Flash MemoryExadata Flash cards

• Columnar DB / Compression• Columnar DB / CompressionHybrid columnar compression

• Ultra Fast NetworkInfiniband

• Chip-based Encryptionnew Intel Chip generation

• Highly scalable1000 TB+

• 77.

8

Standard DW Reference ArchitectureExadata supports all layers

Example Exadata DW clientsmembers of DW Global Leades program in EMEA

• Ease of deployment• Speed of deployment• Ease of maintenance• Performance

- Query

Customer motivation:

- Query- Load

• Storage reduction• Consolidation

- Mixed workloads

• TCO / ROI

Example Exadata DW clientsReduce Load time – step 1

Example Exadata DW clientsReduce Load time – step 2

Source: Presentation: DW Global Leaders WebSeminar – 31.10.12 - Seçil Öncü: Event Aggregation with GoldenGate for Proactive Customer Relationship

Example Exadata DW clientsReduce Load time – step 2

Source: Presentation: DW Global Leaders WebSeminar – 31.10.12 - Seçil Öncü: Event Aggregation with GoldenGate for Proactive Customer Relationship

Example Exadata DW clientsCreate business value with CEP

Source: Presentation: DW Global Leaders WebSeminar – 31.10.12 - Seçil Öncü: Event Aggregation with GoldenGate for Proactive Customer Relationship

Example Exadata DW clientsSpeed of deployment

Source: Presentation: DW Global Leaders WebSeminar – 05.06.09 - Rafał Kudliński : Allegro’s DWH Implementation on HP Oracle Database Machine with OWB & OBIEE

Example Exadata DW clientsSystem Architecture

Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro

Example Exadata DW clientsSystem Architecture

Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro

Example Exadata DW clientsSocial network analysis

Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro

Example Exadata DW clientsRecommendation Engine

Source: Presentation: DW Global Leaders Event – Stockholm – 04.06.12 - Rafał Kudliński : How Oracle Exadata Data Warehouse drives the business of Allegro

Example Exadata DW clientsEase of maintenance

Source: Presentation: DW Global Leaders Event – Athens – 08.06.11 – Jim Duffy: Electronic Markets DWH with Exadata v2

Example Exadata DW clientsEase of maintenance

Source: Presentation: DW Global Leaders Event – Athens – 08.06.11 – Jim Duffy: Electronic Markets DWH with Exadata v2

Example Exadata DW clientsQuery performance

Source: Presentation: DW Global Leaders Event – Krokow – 10.06.10 – Eric Nagel: Experience about Implementation of the Database Machine (Exadata)

Example Exadata DW clientsstorage cost

Source: Presentation: DW Global Leaders WebSeminar – 26.01.12 – Jörg Otto: Extending Memory & Disk on Exadata @ IDSIDS Customer Snapshot: http://www.oracle.com/us/corporate/customers/customersearch/ids-exadata-snapshot-405106-de.html

Example Exadata DW clientsBI Domain Architecture

Reporting

MSTR

ETL

AB Initio

Oracle ODISource

DBsOracle

DWH

Amount Of Data • 3 Billion CDR per Day

• 600 -1000 GB raw data extracted from 20+ source database

• 5 TB Data on file system processed

• 3-4 TB loaded into databases, all into Exadata

• Approximately 600 TB Customer data stored in multiple Databases• 600 TB (60 TB compressed) on Exadata (6 databases)

Advanced

Analysis

SAS / Oracle

CEP

Oracle

Example Exadata DW clientsSuccess Story in phases – Phase 1

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

June 2010 July 2010

Server Model Sun M9000 Exadata V2

EMC DMX-470 TB

HITACHI USP-V50 TB

Sun M9000 Sparc 7176 Threads

ORACLE Exadata V2

Example Exadata DW clientsSuccess Story in phases – Phase 1

Cpu Type Sun Sparc 7 2.52 GHz Xeon E5540 2.53 GHz

# Of Cpu Threads 176 128

Storage Used 120 TB 25 TB

# of disks 650 168

Max IO Throughput 5 GB/s 21 GB/s

Total RACKS 11 Racks 1 Racks

# of reports/month 50K 50K

Avg Report Time 27 min 3 min

CDR per Day 1.5 Billion 1.5 Billion

# of reporting users 300 300

# of adhoc users 40 40

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

Example Exadata DW clientsSuccess Story in phases – Phase 1

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

Example Exadata DW clientsSuccess Story in phases – Phase 2

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

DW Architecture

June 2010 July 2010 March 2011 April 2011

Server Model Sun M9000 Exadata V2 Exadata V2 2*Exadata X2-2

EMC DMX-470 TB

HITACHI USP-V50 TB

Sun M9000 Sparc 7176 Threads

ORACLE Exadata V2

Cpu Type Sun Sparc 7 2.52 GHz Xeon E5540 2.53 GHz Xeon E5540 2.53 GHz Xeon E5540 2.53 GHz

# Of Cpu Threads 176 128 128 2*128 (only 184 used)

Storage Used 120 TB 25 TB 32 TB 60 TB

# of disks 650 168 168 336

Max IO Throughput 5 GB/s 21 GB/s 21 GB/s 50 GB/s

Total RACKS 11 Racks 1 Racks 1 Racks 2 Racks

# of reports/month 50K 50K 65K 65K

Avg Report Time 27 min 3 min 7 min 3 min

CDR per Day 1.5 Billion 1.5 Billion 3 Billion 3 Billion

# of reporting users 300 300 300 300

# of adhoc users 40 40 40 40

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

Example Exadata DW clientsSuccess Story in phases – Phase 3

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

Example Exadata DW clientsProject Status – end 2012 – all together roughly 1 PB raw!

Source: Presentation: DW Global Leaders Event – San Francisco – 04.10.12 – MERT ŞENGÜNER : Turkcell’s Exadata Journey

Built-in Analytics Secure, Scalable Platform for Advanced Analytics

Oracle Data Mining

Oracle OLAPAnalyze and summarize

• Complex and predictive analytics embedded into Oracle Database 11g

• Reduce cost of additional hardware, management resources

• Improve performance by eliminating data movement and duplication

Oracle Data MiningUncover and predict

Prepaid Churn Prediction

Source: Presentation: DW Global Event, Athens – 09.06.10 - Hasan Tonguç Yılmaz : Processing Turkcell Mobile Network Data with Oracle CEP

Example Exadata DW clientsROI

Source: Turkcell ROI Study: http://www.oracle.com/us/corporate/customers/turkcell-1-exadata-case-study-456284.pdf

Example Exadata DW clientsROI

Source: Turkcell ROI Study: http://www.oracle.com/us/corporate/customers/turkcell-1-exadata-case-study-456284.pdf

Largest Production Exadata DW SystemSK Telekom – South Korea

Source: Presentation: DW Global Event, Hangzhou, China – 06.06.11 - nTel: Architecting 1 PB DW System

Summarywhat you should take away

• Exadata is proven and widely deployed

• Exadata scales

• Exadata is the defacto standard for Oracle DW architectures

• Exadata gives you more performance / more space than • Exadata gives you more performance / more space than “traditional” systems

• Exadata is easy to deply

• Exadata saves you money

<Insert Picture Here>

Extreme PerformanceExtreme Performance