Upload
jonjon
View
213
Download
0
Embed Size (px)
Citation preview
7/29/2019 72937066 Etc Exadata Big
1/94
Sun Oracle Exadata and Database Machine Overview
Copyright 2009, Oracle Corporation and/or its affiliates
7/29/2019 72937066 Etc Exadata Big
2/94
Enterprise Technology Center
The Architecture of the FutureMassively Parallel Grid
Best for Data WarehousingBest for OLTPBest for Consolidation
7/29/2019 72937066 Etc Exadata Big
3/94
Enterprise Technology Center
Database Machine Success
Database Machine is succeeding in all geographies andindustries against every competitor
7/29/2019 72937066 Etc Exadata Big
4/94
Enterprise Technology Center
The Oracle Database Machine is an ideal cost-effectiveplatform to meet our speed and scalability needs .
Ketan Parekh, Manager Database Systems
After carefully testing several data warehouse platforms, wechose the Oracle Database Machine. Oracle Exadata was able tospeed up one of our critical processes from days to minutes ..
Brian Camp, Sr. VP of Infrastructure Services
A query that used to take 24 hours to complete now runs inless than 30 minutes. The Oracle Database Machine beatscompeting solutions on bandwidth, load rate, disk capacity,and transparency.
Christian Maar, CIO
Database Machine Success
7/29/2019 72937066 Etc Exadata Big
5/94
Enterprise Technology Center
Agenda
Overview Exadata Based Product Offerings Exadata Architecture and Features
Best Data Warehousing Machine Best OLTP Machine Best Consolidation Machine
7/29/2019 72937066 Etc Exadata Big
6/94
Enterprise Technology Center
The Products Exadata Storage Server & Database Machine
Exadata Storage Server Storage Product Optimized for Oracle
Database Extreme I/O and SQL Processing
performance Combination of hardware and
software Exadata Storage Server Software
Sun Oracle Database Machine Pre-Configured High Performance Balanced performance
configuration Takes the guess work out of
building an Oracle deployment Exadata Storage Server Software Oracle Database 11.2
7/29/2019 72937066 Etc Exadata Big
7/94
Enterprise Technology Center
Business Value of Exadata
Extreme Performance : Dramatic performanceimprovements (10-100X) for your data warehouses.Dramatic performance improvements (20X) for OLTPapplications
Linear Scalability : Performance scales linearly with
increase in data volumes. Enterprise Ready : Get up and running quickly with a
complete system containing all the required hardware andsoftware. Single enterprise level support for all hardwareand software from Oracle.
Standard: Works transparently with existing applications.Manage your databases and applications the same wayyou do today.
7/29/2019 72937066 Etc Exadata Big
8/94
Enterprise Technology Center
Storage Bottlenecks
Today, database performance is limited by storage Storage systems limit data bandwidth from storage to servers Storage Array internal bottlenecks SAN bottlenecks
Random I/O bottlenecks due to physical disk speeds Data Bandwidth limits severely restrict performance for data
warehousing Random I/O bottlenecks limit performance of OLTP applications
7/29/2019 72937066 Etc Exadata Big
9/94
Enterprise Technology Center
Exadata Smart StorageBreaks Data Bandwidth and Random I/O Bottleneck
Oracle addresses data bandwidthbottleneck 3 ways
Massively parallel storage grid of high performanceExadata storage servers (cells).
Data bandwidth scales with data volume
Data intensive processing runs in Exadata storage. Queries run in storage as data streams from
disk, offloading database server CPUs Columnar compression reduces data volume up to
10x Exadata Hybrid Columnar Compression
provides 10x lower cost, 10x higher performance
Oracle solves random I/O bottlenecks usingExadata Smart Flash Cache
Increase random I/Os by factor of 20X
Exadata Storage Cells
7/29/2019 72937066 Etc Exadata Big
10/94
Enterprise Technology Center
Exadata Based Product Offerings
7/29/2019 72937066 Etc Exadata Big
11/94
Enterprise Technology Center
Sun Oracle Database Machine Grid is the architecture of the future
Highest performance, lowest cost, redundant, incrementally scalable Sun Oracle Database Machine delivers the first and only complete
grid architecture for all data management needs
Exadata Storage Server Grid 14 High-performance low-cost
storage servers 100 TB raw SAS disk storage
or 336 TB raw SATA disk storage
5TB+ flash storage!
RAC Database Server Grid 8 High-performance low-cost
compute servers 2 Intel quad-core Xeons each
InfiniBand Network 40 Gb/sec fault-tolerant unified
server and storage network
7/29/2019 72937066 Etc Exadata Big
12/94
Enterprise Technology Center
Sun Oracle Database Machine
Exadata Storage Server Grid 21 GB/sec disk bandwidth 50 GB/sec flash bandwidth 1 million I/Os per second
RAC Database Server Grid Millions of transactions
per minute Tens of millions of queries
per minute Billions of rows per minute
InfiniBand Network 880 Gb/sec aggregate
throughput
Extreme Performance
7/29/2019 72937066 Etc Exadata Big
13/94
Enterprise Technology Center
Start Small and Grow
FullRack
Half Rack
Quarter Rack
7/29/2019 72937066 Etc Exadata Big
14/94
Enterprise Technology Center
Scale Performance and Capacity
Scalable Scales to 8 rack database machine
by just adding wires More with external
InfiniBand switches Scales to hundreds of storage servers
Multi-petabyte databases
Redundant and FaultTolerant
Failure of any componentis tolerated Data is mirrored across
storage servers
7/29/2019 72937066 Etc Exadata Big
15/94
Enterprise Technology Center
Drastically Simplified Deployments
Database Machine eliminates thecomplexity of deploying databasesystems
Months of configuration, troubleshooting, tuning
Database Machine is ready on dayone
Pre-built, tested, standard, supportable configuration Runs existing applications unchanged
Extreme performance out of the boxMonths toDays
7/29/2019 72937066 Etc Exadata Big
16/94
Enterprise Technology Center
Sun Exadata Storage Server Hardware
Building block of massively parallel Exadata Storage Grid Up to 1.5 GB/sec raw data bandwidth per cell Up to 75,000 IOPS with Flash
Sun Fire X4275 Server 2 Quad-Core Intel Xeon E5540 Processors 24GB RAM Dual-port 4X QDR (40Gb/s) InfiniBand card Disk Options
12 x 600 GB SAS disks (7.2 TB total) 12 x 2TB SATA disks (24 TB total)
4 x 96 GB Sun Flash PCIe Cards (384 GB total) Software pre-installed
Oracle Exadata Storage Server Software Oracle Enterprise Linux Drivers, Utilities
Single Point of Support from Oracle 3 year, 24 x 7, 4 Hr On-site response
Sun Exadata Storage
Server Hardware
Hardware by
Software by
7/29/2019 72937066 Etc Exadata Big
17/94
Enterprise Technology Center
Sun Exadata Storage Server Hardware
24 GB DRAM
12 x 3.5 Disk Drives
2 Quad-Core IntelXeon Processors
Pre-installed Software:
Oracle Exadata Storage Server Software
Oracle Enterprise Linux
Drivers
Disk Controller
HBA with 512Mbattery backedcache
InfiniBand QDR(40Gb/s) dualport card
ILOM
Dual-redundant, hot-swappable power supplies
4 x 96GB SunFlash PCIeCards
7/29/2019 72937066 Etc Exadata Big
18/94
Enterprise Technology Center
Sun Oracle Database Machine Full RackPre-Configured for Extreme Performance
8 Sun Fire X4170 Oracle Database servers 14 Exadata Storage Servers (All SAS or all
SATA) 3 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s) switch
1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant Power Distributions Units (PDUs) Single Point of Support from Oracle
3 year, 24 x 7, 4 Hr On-site response
Add more racks for additional scalability
7/29/2019 72937066 Etc Exadata Big
19/94
Enterprise Technology Center
4 Sun Fire X4170 Oracle Database servers 7 Exadata Storage Servers (All SAS or all
SATA) 2 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s) switch
1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant PDUs Single Point of Support from Oracle
3 year, 24 x 7, 4 Hr On-site response
Can Upgrade to a Full Rack
Sun Oracle Database Machine Half RackPre-Configured for Extreme Performance
7/29/2019 72937066 Etc Exadata Big
20/94
Enterprise Technology Center
2 Sun Fire X4170 Oracle Database servers 3 Exadata Storage Servers (All SAS or all
SATA) 2 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s)
InfiniBand switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant PDUs Single Point of Support from Oracle
3 year, 24 x 7, 4 Hr On-site response
Can Upgrade to an Half Rack
Sun Oracle Database Machine Quarter RackPre-Configured for Extreme Performance
7/29/2019 72937066 Etc Exadata Big
21/94
Enterprise Technology Center
Sun Oracle Database Machine Basic SystemEntry Level non-HA Configuration
1 Sun Fire X4170 Oracle Database servers 1 Exadata Storage Servers (All SAS or allSATA)
1 Sun Datacenter InfiniBand Switch 36 36-port Managed QDR (40Gb/s)
InfiniBand switch InfiniBand Cables Installed in Customer supplied Rack Customer supplied Ethernet and KVM
Infrastructure Single Point of Support from Oracle
3 year, 24 x 7, 4 Hr On-site response
7/29/2019 72937066 Etc Exadata Big
22/94
Enterprise Technology Center
Standalone Exadata Storage Servers
Purchase Exadata Storage Servers from Oracle Customer supplied standard 19 inch rack Customer supplied x86 64-bit Linux Database
Servers
Hardware installation more complex No single point of support for entire deployment
7/29/2019 72937066 Etc Exadata Big
23/94
Enterprise Technology Center
Exadata Product CapacitySingle Server Quarter Rack Half Rack Full Rack
Raw Disk 1 SAS 7.2 TB 21 TB 50 TB 100 TB
SATA 24 TB 72 TB 168 TB 336 TB
Raw Flash 1 384 GB 1.1 TB 2.6 TB 5.3 TB
User Data 2(assuming nocompression)
SAS 2 TB 6 TB 14 TB 28 TBSATA 7 TB 21 TB 50 TB 100 TB
1 Raw capacity calculated using 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes.
2 - User Data: Actual space for end-user data, computed after single mirroring (ASM normal redundancy) and after allowing space for database structures such as temp, logs, undo, and indexes. Actual user data capacity varies byapplication. User Data capacity calculated using 1 TB = 1024 * 1024 * 1024 * 1024 bytes.
7/29/2019 72937066 Etc Exadata Big
24/94
Enterprise Technology Center
Exadata Product PerformanceSingleServer
Quarter Rack
Half Rack Full Rack
Raw Disk DataBandwidth 1,4
SAS 1.5 GB/s 4.5 GB/s 10.5 GB/s 21 GB/sSATA 0.85 GB/s 2.5 GB/s 6 GB/s 12 GB/s
Raw Flash Data Bandwidth 1,4 3.6 GB/s 11 GB/s 25 GB/s 50 GB/s
Max User Data Bandwidth 2,4(10x compression & Flash)
36 GB/s 110 GB/s 250 GB/s 500 GB/s
Disk IOPS 3,4 SAS 3,600 10,800 25,000 50,000
SATA 1,440 4,300 10,000 20,000
Flash IOPS 3,4 75,000 225,000 500,000 1,000,000
Data Load Rate 4 0.65 TB/hr 1 TB/hr 2.5 TB/hr 5 TB/hr
1 Bandwidth is peak physical disk scan bandwidth, assuming no compression.
2 - Max User Data Bandwidth assumes scanned data is compressed by factor of 10 and is on Flash.
3 IOPs Based on IO requests of size 8K
4 - Actual performance will vary by application.
7/29/2019 72937066 Etc Exadata Big
25/94
Enterprise Technology Center
Exadata Architecture and Features
7/29/2019 72937066 Etc Exadata Big
26/94
Enterprise Technology Center
Exadata Configuration
Each Exadata Cell is a self-contained server which houses diskstorage and runs the Exadata software
Oracle Databases are deployed across multiple Exadata Cells Oracle Database enhanced to work in cooperation with Exadata
Storage Server No practical limit to number of Cells that can be in the grid
Exadata Cell
InfiniBand Switch/Network
Single-InstanceDatabase
RACDatabase
Exadata Cell Exadata Cell
7/29/2019 72937066 Etc Exadata Big
27/94
Enterprise Technology Center
Exadata Architecture
DB Server
DB Instance DBRM
ASM
Single-Instance
Database
RAC
DatabaseDB Server
DB Instance DBRM
ASM
DB Server
DB Instance DBRM
ASM
OEL CELLSRV MS
RS
IORM
iDB Protocol overInfiniBand with
Path FailoverInfiniBand Switch/Network
CellControl
CLI
EnterpriseManager
OEL CELLSRV MS
RS
IORM
OEL CELLSRV MS
RS
IORM
Exadata Cell
Exadata Cell
Exadata Cell
7/29/2019 72937066 Etc Exadata Big
28/94
Enterprise Technology Center
Exadata Software Features Exadata Smart Scans
10X or greater reduction in data sent to database servers Exadata Storage Indexes
Eliminate unnecessary I/Os to disk Hybrid Columnar Compression (HCC)
Efficient compression increases effective storage capacity and increasesuser data scan bandwidths by a factor of 10X
Exadata Smart Flash Cache Breaks random I/O bottleneck by increasing IOPs by 20X Doubles user data scan bandwidths
I/O Resource Manager (IORM) Enables storage grid by prioritizing I/Os to ensure predictable performance
Inter-leaved Grid Disks Enables storage grid that allows multiple applications to place frequently
accessed data on faster portions of the disk
7/29/2019 72937066 Etc Exadata Big
29/94
Enterprise Technology Center
Exadata Smart Scan
Exadata cells implement scan offload to greatlyreduce the data sent to database servers
Row filtering based on where predicate Column filtering Join filtering
Incremental backup filtering Scans on encrypted data Data Mining model scoring
10x data reduction is common
Completely application transparent Even if cell or disk fails during a query
11.2
11.2
7/29/2019 72937066 Etc Exadata Big
30/94
Enterprise Technology Center
Traditional Scan Processing Smart Scan Example:
Telco wants to identifycustomers that spend
more than $200 on asingle phone call The information about
these premium customersoccupies 2MB in a 1terabyte table
With traditional storage, alldatabase intelligence residesin the database hosts
Very large percentage of datareturned from storage isdiscarded by database
servers Discarded data consumesvaluable resources, andimpacts the performance of other workloads
I/Os Executed:
1 terabyte of datareturned to hosts
DB Host reduces
terabyte of data to 1000customer names thatare returned to client
Rows Returned
SELECT
customer_nameFROM calls
WHERE amount > 200;
Table
ExtentsIdentified
I/Os Issued
7/29/2019 72937066 Etc Exadata Big
31/94
Enterprise Technology Center
Exadata Smart Scan Processing
Only the relevant columns
customer_nameand required rows where amount>200are are returned to hosts
CPU consumed by predicate
evaluation is offloaded toExadata
Moving scan processing off thedatabase host frees host CPUcycles and eliminates massive
amounts of unproductivemessaging Returns the needle, not the
entire hay stack
2MB of datareturned to server
Rows Returned
Smart Scan
Constructed AndSent To Cells
Smart Scanidentifies rows and
columns withinterabyte table that
match request
Consolidated
Result SetBuilt From All
Cells
SELECT
customer_nameFROM calls
WHERE amount > 200;
7/29/2019 72937066 Etc Exadata Big
32/94
Enterprise Technology Center
Smart Scan Transparency Smart scans are transparent to the application
No application or SQL changes required Returned data is fully consistent and transactional If a cell dies during a smart scan, the uncompleted portions
of the smart scan are transparently routed to other cellscontaining a replica of the data
Smart Scans correctly handle complex cases including Uncommitted data and locked rows Chained rows Compressed tables National Language Processing
Date arithmetic Regular expression searches Partitioned tables
High Throughput, Reduced Overhead, No Complex Tuning
7/29/2019 72937066 Etc Exadata Big
33/94
Enterprise Technology Center
Exadata Smart Scans:Offloaded data mining scoring
Data mining scoring executed in Exadata:
All data mining scoring functions offloaded to Exadata Up to 10x performance gains
Reduced CPU utilization on Database Server
select cust_idfrom customerswhere region = US and prediction_probability(churnmod, Y using *) > 0.8;
Scoring functionexecuted in
Exadata
11.2
7/29/2019 72937066 Etc Exadata Big
34/94
Enterprise Technology Center
Exadata Storage IndexTransparent I/O Elimination with No Overhead
Exadata Storage Indexes maintain summaryinformation about table data in memory
Store MIN and MAX values of columns Typically one index entry for every MB of disk
Eliminates disk I/Os if MIN and MAX can never match where clause of a query
Completely automatic and transparent
A B C D
1
35
5
8
3
Min B = 1Max B =5
Table Index
Min B = 3Max B =8
Select * from Table where B
7/29/2019 72937066 Etc Exadata Big
35/94
Enterprise Technology Center
Data Growth Challenges
IT must support exponentiallygrowing amounts of data Without hurting performance
Without growing cost
Powerful and efficientcompression is key
7/29/2019 72937066 Etc Exadata Big
36/94
E d H b id C l C i
7/29/2019 72937066 Etc Exadata Big
37/94
Enterprise Technology Center
Exadata Hybrid Columnar CompressionHow it works
Tables are organized into sets of a few thousandrows called Compression Units (CUs)
Within Compression Unit, data is Organized byColumn and then compressed
Column organization brings similar values closetogether, enhancing compression
Useful for data that is bulk loaded and queried Update activity is light
ReducesTable Size4x to 40x
4x to 50xReduction
CompressionUnit
7/29/2019 72937066 Etc Exadata Big
38/94
Enterprise Technology Center
Exadata Hybrid Columnar CompressionWarehousing and Archiving
Warehouse Compression
10x average storage savings 10x Scan I/O reduction
Archive Compression
15x average storagesavings
Up to 50x on some data Some access overhead For cold or historical data
Optimized for Speed Optimized for Space
Smaller WarehouseFaster Performance Reclaim 93% of DisksKeep Data Online
Can mix compression types by partition for ILM
7/29/2019 72937066 Etc Exadata Big
39/94
Enterprise Technology Center
10 10 10 1116 19 19 19
20 2129
43
05
101520253035404550
S i z e
R e d
u c
t i o n
F a c
t o r
b y
T a
b l e
OLTP Compression (avg=3.3)
Query Compression (avg=14.6)
Archive Compression (avg=22.6)
Real-World Compression RatiosOracle Production E-Business Suite Tables
Columnar compression ratios Query = 14.6X Archive = 22.6X Vary by application and table
52
7/29/2019 72937066 Etc Exadata Big
40/94
Enterprise Technology Center
The Disk Random I/O Bottleneck
Disk drives hold vast amounts of data
But are limited to about 300 I/Os per second
Flash technology holds much lessdata
But can run tens of thousands of I/Osper second
Ideal Solution Keep most data on disk for low cost Transparently move hot data to flash Use flash cards instead of flash disks to avoid disk
controller limitations Flash cards in Exadata storage
High bandwidth, low latency interconnect
300 I/O per Sec
Tens of Thousands of I/Os per Second
7/29/2019 72937066 Etc Exadata Big
41/94
Enterprise Technology Center
Exadata Smart Flash Cache
Caches Hot Data Transparently inthe 4 Flash Cards
Use PCI Express based FlashCards for greater throughput andIOPs and avoid disk controller limitations
Smart Caching Smarter than basic LRU algorithm
Knows when to skip caching objects toavoid polluting or flushing the cache
Allows applications to explicitlyoptimize caching
11.2
4 x 96 GB Flash Cards
7/29/2019 72937066 Etc Exadata Big
42/94
Enterprise Technology Center
Exadata I/O Resource ManagementMixed Workload Environments
With traditional storage,creating and
managing shared storage ishampered by the inability to balancethe work between users on the samedatabase or on multiple databasessharing the storage subsystem
Hardware isolation is the
approach to ensure separation Exadata I/O resource managementensures different users and taskswithin a database are allocated thecorrect relative amount of I/Oresources
For example: Interactive: 50% of I/O resources Reporting: 30% of I/O resources ETL: 20% of I/O resources
DatabaseServer
Exadata Cell
InfiniBand Switch/Network
Exadata Cell Exadata Cell
7/29/2019 72937066 Etc Exadata Big
43/94
Enterprise Technology Center
Exadata I/O Resource ManagementMulti-Database Environment
Ensure different databases areallocated the correct relative amount of I/O bandwidth
Database A: 33% I/O resources Database B: 67% I/O resources
Ensure different users and tasks withina database are allocated the correctrelative amount of I/O bandwidth
Database A: Reporting: 60% of I/O resources ETL: 40% of I/O resources
Database B: Interactive: 30% of I/O resources Batch: 70% of I/O resources
Exadata Cell
InfiniBand Switch/Network
Database A Database B
Exadata Cell Exadata Cell
7/29/2019 72937066 Etc Exadata Big
44/94
Enterprise Technology Center
Exadata Scale-Out Storage Grid
Dynamic virtualized storageresources using Automatic StorageManagement (ASM)
Simple and non-intrusive resourceallocation, and reallocation, enablingtrue enterprise grid storage
Database work spread acrossstorage resources for optimalperformance
Powerful storage allocation optionsand management
Flexible configuration for performance and availability
Exadata Cell
InfiniBand Switch/Network
Single-InstanceDatabase
RACDatabase
Exadata Cell Exadata Cell
7/29/2019 72937066 Etc Exadata Big
45/94
Enterprise Technology Center
Exadata Storage Layout
Cell
Disk
Sys Area Sys AreaGrid Disk n
Grid Disk 1
ASM disk
ASM disk
Physical disks map to Cell Disks
Cell Disks partitioned into one or multiple Grid Disks Grid Disks created in order of hottest first to coldest portion of the
disk last ASM diskgroups created from Grid Disks Transparent above the ASM layer
Physical
Disk
7/29/2019 72937066 Etc Exadata Big
46/94
Enterprise Technology Center
Exadata Storage Layout ExampleASM Mirroring and Failure Groups
Example shows cell disks divided into two grid disks hot and cold
Two ASM disk groups created across the two sets of grid disks ASM striping evenly distributes I/O across the disk groups ASM mirroring is used to protect against disk failures ASM failure groups are used to protect against cell failures
Exadata Cell Exadata Cell
Hot Hot Hot
Cold Cold Cold
ASMDisk Group
ASMFailure Group
Hot Hot Hot
Cold Cold Cold
ASMFailure Grou
7/29/2019 72937066 Etc Exadata Big
47/94
Enterprise Technology Center
Interleaved Grid Disks
Grid disks are optionally split andinterleaved to place frequently accesseddata in all grid disks on higher performingouter tracks
All applications benefit from higher performance outer tracks of disks
Grid Disk 2Hot Data, Cold Data
Grid Disk 1 Hot Data, Cold Data
11.2
7/29/2019 72937066 Etc Exadata Big
48/94
Enterprise Technology Center
Exadata Storage Management & Administration
Enterprise Manager Manage & administer Database and ASM
Exadata Storage Plug-in Enterprise Manager Grid Control Plug-in to monitor & manage
Exadata Storage Cells
Comprehensive CLI Local Exadata Storage cell management Distributed shell utility to execute CLI across multiple cells
Sun Embedded Integrated Lights Out Manager (ILOM) Remote management and administration of hardware
7/29/2019 72937066 Etc Exadata Big
49/94
Enterprise Technology Center
Exadata Storage Plug-in
Enterprise Manager Grid Control Plug-in to monitor &
manage Exadata Storage Cells Works with Enterprise Manager Grid Control 10.2.0.3and later versions
7/29/2019 72937066 Etc Exadata Big
50/94
Enterprise Technology Center
Data Protection Solutions
All single points of failure eliminated by the Exadata Storage architecture
Hardware Assisted Resilient Data (HARD) built in to Exadata Storage Prevent data corruption before it happens
Data Guard provides disaster protection and data corruption protection Automatically maintains one or more copies of the database
Flashback provides human error protection Snapshot-like capabilities to rewind database to before error
Recovery Manager (RMAN) provides backup to disk Archiving and corruption protection Can be used with Oracle Secure Backup (OSB) or third party tape backup
software These work just as they do for traditional non-Exadata storage
Users and database administrator use familiar tools
7/29/2019 72937066 Etc Exadata Big
51/94
Enterprise Technology Center
Exadata Co-Existence and Migration
Databases can be concurrentlydeployed on Exadata andtraditional storage Tablespaces can exist on Exadata
storage, traditional storage, or acombination of the two, and is
transparent to database applications SQL offload processing requires allpieces of a tablespace reside onExadata
Online migration if currently using
ASM and ASM redundancy Migration can be done usingRMAN or Data Guard
Non-Exadata
DatabaseServer
Online Migration
Exadata
7/29/2019 72937066 Etc Exadata Big
52/94
Enterprise Technology Center
Best Data Warehouse Machine
7/29/2019 72937066 Etc Exadata Big
53/94
Enterprise Technology Center
Best Data Warehouse Machine
Massively parallel high volume hardware toquickly process vast amounts of data
Exadata runs data intensive processingdirectly in storage
Most complete analytic capabilities OLAP, Statistics, Spatial, Data Mining, Real-timetransactional ETL, Efficient point queries
Powerful warehouse specific optimizations Flexible Partitioning, Bitmap Indexing, Join indexing, Materialized Views, Result
Cache
Dramatic new warehousing capabilitiesData Mining
OLAP
ETL
New
7/29/2019 72937066 Etc Exadata Big
54/94
Enterprise Technology Center
Exadata Storage Features Exadata Smart Scans
10X or greater reduction in data sent todatabase servers
Exadata Storage Indexes Eliminate unnecessary I/Os to disk
Hybrid Columnar Compression Efficient compression increases user data scan
rates
Flash doubles scan rates Combined with Hybrid Columnar Compression,
scan rate is 20X more
7/29/2019 72937066 Etc Exadata Big
55/94
Enterprise Technology Center
In-Memory Parallel Execution
A single database machine has over 400GB of memory usable for caching
Database release 11.2 introduces parallelquery processing on memory cached data
Harnesses memory capacity of entire database cluster for queries
Foundation for world record 1TB TPC-H
Exadata Hybrid Columnar Compressionenables multi-terabyte tables or partitionsto be cached in memory
315,842
1,018,321
1,166,976
ParAccel Exasol Oracle
QphH: 1 TB TPC-H
Faster than in-memoryspecialized startups
Memory has 100x more bandwidth than Disk
Source: Transaction Processing Council, as of 9/14/2009:Oracle on HP Bladesystem c-Class 128P RAC, 1,166,976 QphH@1000GB, $5.42/QphH@1000GB, available 12/1/09.Exasol on PRIMERGY RX300 S4, 1,018,321 QphH@1000GB, $1.18/QphH@1000GB, available 08/01/08.ParAccel on SunFire X4100 315 842 hH 1000GB $4.57 / hH 1000GB available 10/29/07.
11.2
f l l
http://www.tpc.org/tpch/results/tpch_result_detail.asp?id=107102903http://www.tpc.org/tpch/results/tpch_result_detail.asp?id=1071029037/29/2019 72937066 Etc Exadata Big
56/94
Enterprise Technology Center
Benefits Multiply
1 TBwith compression
10 TB of user dataRequires 10 TB of IO
100 GBwith partition pruning
20 GBwith Storage Indexes
5 GBwith Smart Scans
Subsecond On Database
Machine
Data is 10x Smaller, Scans are 2000x faster
S S l bl Sh d il S
7/29/2019 72937066 Etc Exadata Big
57/94
Enterprise Technology Center
DBFS - Scalable Shared File System
Database Machine comes with DBFS shared Linux file system Shared storage for ETL staging, scripts, reports and other application files
Files stored as SecureFile LOBs in database tables stored inExadata
Protected like any DB data mirroring, DataGuard, Flashback, etc.
5 to 7 GB/sec file system I/O throughput
ETL Files in DBFS
Load into databaseusing External Tables
ETL
More File Throughput than High-End NAS Filer
11.2
7/29/2019 72937066 Etc Exadata Big
58/94
Enterprise Technology Center
Best OLTP Machine
B OLTP M hi
7/29/2019 72937066 Etc Exadata Big
59/94
Enterprise Technology Center
Best OLTP Machine
Only Oracle runs real-world businessapplications on the Grid
Unique fault-tolerant scale-out OLTPdatabase
RAC, Data Guard, Online Operations
Unique fault-tolerant scale-out storagesuitable for OLTP
ASM, Exadata
Dramatic New OLTP Capabilities
Exadata Flash
7/29/2019 72937066 Etc Exadata Big
60/94
Enterprise Technology Center
Exadata FlashSolves the Random I/O Bottleneck
Oracle is the First FlashOptimized Database
11.2
Sun Oracle Database Machine has
5+ TB of flash storage Exadata Smart Cache caches hotdata
Database Machine achieves: 20x more random I/Os
Over 1 million per second 2x faster sequential query I/O
50 GB/sec 10x better I/O response time
Sub-millisecond Greatly Reduced Cost 10x fewer disks for IOPS Lower Power
C l t O I t t d A il bilit
7/29/2019 72937066 Etc Exadata Big
61/94
Enterprise Technology Center
WAN
Complete, Open, Integrated AvailabilityMaximum Availability Architecture
Protection from Server Failures Storage Failures Network Failures Site Failures
Real-time remote standby open for queries
Human error correction Database, table, row, transaction level
Online indexing and table redefinition Online patching and upgrades
RealApplication
Clusters
ASM
FastRecovery Area
ActiveData Guard
SecureBackup
C l t O I t t d S it
7/29/2019 72937066 Etc Exadata Big
62/94
Enterprise Technology Center
Complete, Open, Integrated Security
DataMasking
AdvancedSecurity SecureBackup
Encryption and Masking
DatabaseVault
LabelSecurity
Access Control
ConfigurationManagement
AuditVault TotalRecall
Monitoring
7/29/2019 72937066 Etc Exadata Big
63/94
Enterprise Technology Center
Best Consolidation Machine
C lid ti
7/29/2019 72937066 Etc Exadata Big
64/94
Enterprise Technology Center
Consolidation
Biggest driver of ongoingcost is
Multitudes of special-purpose systems
Consolidate onto DatabaseMachine
High performance for all applications Low cost platform for all applications Predictable response times in a shared
environment Handles all data management needs Complete, Open, Integrated
ERP
CRM
Warehouse
Data MartHR
CRMERP
Warehouse Data Mart
HR
B t C lid ti M hi
7/29/2019 72937066 Etc Exadata Big
65/94
Enterprise Technology Center
Best Consolidation Machine
Consolidation mixes many different
workloads in one system Warehouse oriented bulk data processing OLTP oriented random updates Multimedia oriented streaming files
The Sun Oracle Database Machinehandles any combination of workloadswith extreme performance
And predictable response times
Dramatic new consolidationcapabilities
ERP
CRM
Warehouse
Data Mart
HR
Consolidate Storage
7/29/2019 72937066 Etc Exadata Big
66/94
Enterprise Technology Center
Consolidate Storage
Exadata and ASM allow all storage servers to beshared across databases
Shared Configuration Advanced data striping spreads every database across
all storage servers
Eliminates hot-spots and captive unused space Full storage grid performance available to all databases Database or cluster level storage security
Predictable Performance Exadata I/O resource manager prioritizes I/Os to
ensure predictable performance At user, job, application, or database level
No need for isolated storage islands
ERP
CRM
Warehouse
Data Mart
HR
Consolidate Servers
7/29/2019 72937066 Etc Exadata Big
67/94
Enterprise Technology Center
Consolidate Servers
Many databases can run on DatabaseMachine servers
Shared Configuration Applications connect to a database service that
runs on one or more database nodes Services can grow, shrink, & move
dynamically Large databases can span nodes using RAC Multiple small databases can run on a single node
Predictable performance Instance caging provides predictable CPU
resources when multiple databases run on thesame node
Restricts a database to subset of processors
ERP CRM
Warehouse
Data
Mart
HR
7/29/2019 72937066 Etc Exadata Big
68/94
Enterprise Technology Center
The Architecture of the FutureMassively Parallel Grid
Best for Data WarehousingBest for OLTPBest for Consolidation
Resources
7/29/2019 72937066 Etc Exadata Big
69/94
Enterprise Technology Center
Resources
Oracle.com:http://www.oracle.com/exadata
Oracle Exadata Technology Portal on OTN:http://www.oracle.com/technology/products/bi/db/exadata
Oracle Exadata white papers:http://www.oracle.com/technology/products/bi/db/exadata/pdf/exadata-technical-whitepaper.pdf
http://www.oracle.com/technology/products/bi/db/exadata/pdf/migr ation-to-exadata-whitepaper.pdf
7/29/2019 72937066 Etc Exadata Big
70/94
Customer Tests on Oracle Exadata
7/29/2019 72937066 Etc Exadata Big
71/94
Enterprise Technology Center
On average 26x faster than DB2
Benchmark workload with 21Business Objects queries
Longest running query on DB2runs 47x faster on a DatabaseMachine
Less tuning, DB2 schema with200 indexes, DB Machine withonly 12 indexes
Information & Technology US
7/29/2019 72937066 Etc Exadata Big
72/94
Enterprise Technology Center
Up to 10x faster for queries than Sybase IQ
A query using where clausesfor de-duplication ran 10x faster on a Database Machine
A query using Soundexcomparisons ran 10x faster ona Database Machine
Marketing US
7/29/2019 72937066 Etc Exadata Big
73/94
Enterprise Technology Center
Up to 11x faster than customer set targets
Database Machine purchased byone of the largest Teradatacustomers in APAC
Target time for a set of CDRqueries is 3 hours. DatabaseMachine Half Rack ran workloadin 47 minutes, 3.8x faster
Data load rates of ~3 TB/hour
Telecommunications APAC
l
7/29/2019 72937066 Etc Exadata Big
74/94
Enterprise Technology Center
80x faster than Oracle-on-IBM for cross-selling analysis
A complex PL/SQL analysistaking 12 hours or more ran in12 minutes on a Half Rack
Database Machine, 80x faster
Index builds were on average16x faster
Retail EMEA
T l i i EMEA
7/29/2019 72937066 Etc Exadata Big
75/94
Enterprise Technology Center
Full rack DB Machine is 5x faster than Oracle onSun M-series
One of the most run queries is19x faster on a DatabaseMachine
An ETL batch job that requiredwell over 3 hours runs in 50minutes, 3.6x faster
Telecommunications EMEA
R il APAC
7/29/2019 72937066 Etc Exadata Big
76/94
Enterprise Technology Center
A full rack DB Machine delivers on average 3x better performance than Netezzas 2 rack NPS10200
A full rack database machineoutperforms a NetezzaNPS10200 by 9x on analyzing3TB for cross selling analysis
Database machine loads dataon average 25% faster
Retail APAC
T i EMEA
7/29/2019 72937066 Etc Exadata Big
77/94
Enterprise Technology Center
On average 6x faster than an 8 node Teradata 5450*
50 queries on 3TB that run 8hours on Teradata, run justover 1 hour on a DatabaseMachine, 6x faster
Scale out test query on 6xdata volume (18TB) did notcomplete on Teradatas 5550 ,query ran in 3 minutes on afull rack database machine
Transportation EMEA
* Two Teradata systems were involved, a 5450 and a 5550 (see notes for details)
T l i i APAC
7/29/2019 72937066 Etc Exadata Big
78/94
Enterprise Technology Center
Up to 80x faster than Greenplum on a Sun X4500
177M rows in daily SMS queryruns in 1 minute, compared to16 minutes on Greenplum,16x faster
Capabilities to run real-timeinserts of 37M rows withindividual commits in 27minutes. Impossible on
Greenplum .
Telecommunications APAC
R t il US
7/29/2019 72937066 Etc Exadata Big
79/94
Enterprise Technology Center
Exadata improved IBM DB performance by more
than 20 X The move to Exadata allowed
daily PoS analysis to becompleted by 7:00 am, instead of 12 Noon
Projected to result in $ 25Mannual revenue growth andbottom line improvement of $ 1.8 M
Also projected to reduce inventoryinvestment capital by $ 4.5 M
CIO quote Exadata is as
advertised, and then some
Retail - US
R t il US
7/29/2019 72937066 Etc Exadata Big
80/94
Enterprise Technology Center
Exadata improved query performance by
approximately 170 X The move to Exadata will allow
this retailer to scale Point-of-Saledata from 1TB to 100TB
Gathering daily instead of weekly
PoS data will allow better inventory replenishment andreduction of out-of-stockoccurrences
Exadata completes queries thatcurrently take 6 hours in a little
over 2 minutes
Retail - US
High T h M f t i g US
7/29/2019 72937066 Etc Exadata Big
81/94
Enterprise Technology Center
In benchmark against Netezza, Exadata ran 4.7 X
faster Application was analysis of QA
data in cell phone manufacturing
Parametric queries ran 4.7 Xfaster on Exadata
Benchmark was executed with2.9 TB of data, with a full rack, andSAS drives
High Tech Manufacturing US
Ph rm ce tic ls US
7/29/2019 72937066 Etc Exadata Big
82/94
Enterprise Technology Center
Exadata beat the current client timings by 218 X
Exadata beat current clienttimings by 218 X, 19.8 minutes tocurrent 72 hours
Client target was 24 hours, whichExadata handily beat by 73X
This was executed with 50GB,1.6 B rows across 17 tables
Pharmaceuticals US
Insurance US
7/29/2019 72937066 Etc Exadata Big
83/94
Enterprise Technology Center
Multiple queries were executed, up to 2.6 X faster
than Teradata In this competive benchmark,
Exadata beat both Netezza andTeradata
This was executed with 5.0 TB of data, with a full rack, and SATAdrives
Insurance US
Telecommunications US
7/29/2019 72937066 Etc Exadata Big
84/94
Enterprise Technology Center
Exadata was 4.5 X faster than in-house for total
batch cycle, savings of 33 hours Exadata outperformed in-house
benchmarks in all areas
initial data load, by 2.3 X
daily run, by 12X
large DB query, 18.7 X
overall, 4.5 X (9.5 hours to 42.5 hours)
Telecommunications - US
Telecommunications US
7/29/2019 72937066 Etc Exadata Big
85/94
Enterprise Technology Center
Average speed-up due to Exadata was 186 X faster
Exadata executed one test queryin 10 seconds
Customer executed same queryin 4,162 seconds
Speed-up of 416 X
Telecommunications - US
Healthcare US
7/29/2019 72937066 Etc Exadata Big
86/94
Enterprise Technology Center
On average, Exadata was 7.9 X faster for a national
healthcare research institution 26 "Reverse POV" queries were
run
Exadata performance rangedfrom 3.3 X faster to 26.0 X faster
Healthcare - US
Healthcare State Government
7/29/2019 72937066 Etc Exadata Big
87/94
Enterprise Technology Center
Overall, Exadata was 10 X faster than client
26 "Reverse POV" queries wererun
Exadata performance rangedfrom 2X faster to 34X faster
Healthcare State Government
Financial US
7/29/2019 72937066 Etc Exadata Big
88/94
Enterprise Technology Center
Exadata ranged from 14 X to 752 X faster than client
for query sets One query within a set that ran
in 4 hours and 40 minutes, wasrun by Exadata in 17 seconds,988 X faster
Largest single table created andloaded was 330GB
Financial - US
Federal Financial US
7/29/2019 72937066 Etc Exadata Big
89/94
Enterprise Technology Center
Exadata ranged from 15 X to 186 X faster than client
Application was a datawarehouse application
Exadata completed one particular query in 49 seconds , thecustomer completed the samequery in 3.5 hours
Speed-up of 256X
Federal Financial - US
Healthcare - US
7/29/2019 72937066 Etc Exadata Big
90/94
Enterprise Technology Center
Exadata 8X faster than IBM P570
For one query, Exadata was 26X faster than IBM
Over 26 queries, Exadataaveraged 8X faster than IBM
All 26 queries faster on Exadata
POV was a Reverse POV, with200GB
Healthcare - US
3
78
0
10
20
30
40
50
60
70
80
90
DB Machine IBM P570
Entertainment (V2) US
7/29/2019 72937066 Etc Exadata Big
91/94
Enterprise Technology Center
Exadata was 74X faster than current environment(combination of Oracle and SQL Server)
One query that could not finish in5 hours , Exadata completed in 52seconds
Exadata queries were 29x faster
than SQL Server One query currently takes 81minutes, Exadata completed in 19seconds ( 256x faster)
Current environment is Oracle10gand SQL Server 2005
POV simulated 25 concurrentusers, on Exadata V2
Entertainment (V2) US
7/29/2019 72937066 Etc Exadata Big
92/94
Retail (V2) US
7/29/2019 72937066 Etc Exadata Big
93/94
Enterprise Technology Center
Exadata V2 up to 13.5X faster than Teradata
A series of queries that Teradatacompleted in 4 hours, Exadatacompleted in 17.6 minutes, Exadata13.5X faster
Exadata outperformed Teradata in allthree benchmark tests
o 49 sequential queries 3.0X faster o 695 concurrent queries 1.6X faster o 5 surprise ad hoc queries 13.5X faster
Teradata 13TB compressed to 5.3TBusing Exadata Advanced Compression
POV database was 5.3TB, 62 tables, 84billion rows
17.6
238.0
0.0
50.0
100.0
150.0
200.0
250.0
DB Machine Teradata
Retail (V2) US
Financial (V2 - OLTP) US
7/29/2019 72937066 Etc Exadata Big
94/94
In an OLTP execution, Exadata is 1.5X faster than IBM
Exadata achieved over 6,000 inserts per second during an OLTP execution, IBMreached only 4,000, Exadata 1.5X moreinserts over the same period
POV database had 6 tables. One tablehad 256M rows. Other tables were 20Mand 10M rows
HCC compression was used in POV
Customer initially tuned machine,however Exadata performed better when allowed to self-tune
6000
4000
0
1000
2000
3000
4000
5000
6000
7000
DB Machine IBM Pseries
Financial (V2 OLTP) US