29
1 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

Embed Size (px)

Citation preview

Page 1: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

1

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 2: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

2

Page 3: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

<Insert Picture Here>

Aim High with Oracle Real World Performance Andrew Holdsworth Director Real World Performance Group Server Technologies

Page 4: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

4

This Week of Interest

•  Tuesday 16/8/2011 –  Andrew Holdsworth “Aim High” 10:15 AM Bayside Gallery B –  Tom Kyte “Efficient PL/SQL” 12:30 PM Bayside Gallery B

•  Wednesday 17/8/2011 –  Graham Wood “ASHes of DB Time” 10:00 AM Bayside Gallery B –  Andrew Holdsworth, Graham Wood, Tom Kyte “Meet the Experts” 2:45 PM

Exhibition Hall –  Tom Kyte “SQL Techniques” 4:00 PM Bayside Gallery B

•  Thursday 18/8/2011 –  Andrew Holdsworth, Graham Wood, Tom Kyte “A Day of Real World

Performance” Bayside 105

Page 5: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

5

<Insert Picture Here>

Real World Performance Agenda

•  Thinking Strategically about Performance •  The Fork Lift Upgrade •  Data Warehouse Systems •  Operational Systems •  Getting Serious about Performance

Page 6: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

6

Airport/Economist 10X

Page 7: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

7

Airport/Economist 11X

Page 8: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

8

Airport/Economist 17X

Page 9: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

9

State of the Art Intelligent HW and SW EXADATA

•  HW –  Intel Westmere and Nehalem

Xeon CPUs –  Infiniband –  10G Network Cards –  Disks

•  SW –  Hybrid Columnar Compression –  Offloaded Queries ( Column

reduction and predicates ) –  SW Smarts for disk I/O and User

Space I/O

Page 10: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

10

Changing The Culture

Page 11: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

11

Thinking Strategically About Performance

•  To much hope and see approach to performance –  Systems put together without much thought as to how to

achieve performance targets –  Culture of looking for the magic silver bullet –  Lack numerate discussions, decisions made by strength of

personality –  Lack of understanding of what can be achieved –  Unaware of today’s/current systems limitations

Page 12: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

12

•  Learning to set expectations higher then Moore’s Law –  Learn how to move the decimal point –  Learn to choose the appropriate weapons –  What things never change

Changing the Culture

Page 13: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

13

•  Hacking Culture –  Performance is seen as glamorous until it gets hard –  Tuning by Google –  Running a different database product different to the one

developed and supported

Changing the Culture

Page 14: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

14

•  Need to change the Culture of “Good Enough” –  “Good Enough” is NOT and will NOT be “Good Enough”

tomorrow –  Good Performance Engineers are relentless and don’t leave

performance on the table –  Always looking to move the decimal point –  In summary “Aim High”

Thinking Strategically About Performance

Page 15: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

15

The Forklift Upgrade

Page 16: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

16

The Forklift Upgrade

The Fork Lift Upgrade

•  Concept: Just migrate your existing applications without change onto a new faster platform –  It should run faster –  It should be able to exploit new technologies –  It should eliminate my scaling and cost challenges –  The code I run has been running in production and so must

perfect or “Good Enough” –  I have spent a fortune developing this application with cheap

developers, who have since left anyway and nobody knows to maintain it!

Page 17: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

17

•  Just because a system runs satisfactorily today do not assume it will scale

•  Faster equipment will move bottlenecks to new places •  Poor coding techniques WILL get exposed faster •  How much is your Old Code holding you back •  How much performance is left on the Table •  How many existing Oracle version changes •  How many Architecture issues will I have to absorb

e.g RAC

The Fork Lift Upgrade

Page 18: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

18

The Fork Lift Upgrade

•  Now I have scared you, what should we be looking to exploit and where ? –  DW – Target rich environment with the biggest potential for

dramatic performance improvement –  OLTP – Steady gains but huge chance to make the systems

more reliable and predicable

Page 19: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

19

Data Warehouse Systems

Page 20: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

20

Data Warehouse Systems

•  The Wrong HW pathology –  To few CPUs to drive multi million row queries 10X –  I/O not balanced with CPUs 10X –  Incorrect Networking strategies 10X

•  Queries –  Incorrect Query strategy 10X

•  ETL and Loading Degraded –  Slowdowns and serialization –  Database size bloat

•  Desire to make the systems look productive –  Overloaded query streams 10X

Page 21: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

21

•  Learn the basic skills of Large numbers of rows vs small numbers of rows –  Scans vs Index access •  Index Driven Query retrieving 1,000,000 rows –  Assume the Index is cache and the data is not. –  1,000,000 random IOPS @ 5ms per I/O –  This required 5000 Seconds to Execute –  This is why queries may take over an hour

•  How much data could you scan in 5000 Seconds with a fully sized I/O system able to scan 28 Gig/Sec ?

–  Hash techniques vs row by row ( Join and Sort )

Data Warehouse Systems

Page 22: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

22

•  Having eliminated the Hardware Bottlenecks –  Resource Management •  Keeping the system safe •  Allocating resources by priority •  Learn about query queuing –  Historically the Queue was the I/O subsystem

•  ETL and Data Loading –  Row by Row processing –  Direct Path vs Transactional SQL –  Compression techniques

•  Are you the problem ? –  All that experience is it holding you back ?

Data Warehouse Systems

Page 23: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

23

Operational Systems

Page 24: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

24

•  Eliminating the Seeks –  Flash devices and large buffer caches

•  Exploiting the CPUs –  L2 caches •  Moore’s law upgrades •  Fewer processes •  Less stalling on memory access

•  Resource Management –  Preventing run away systems

OLTP and Operational Systems

Page 25: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

25

Getting Serious about Performance

Page 26: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

26

Getting Serious about Performance

5x 10x

50x

100x

500x

1000x CPU Upgrade

from latest generation Intel Processors

I/O Balanced, Minimized, Optimized by Capacity Planning, Compression, Caching and Offload

Exploitation of parallel query techniques

DML re-written as CTAS or IAS

Parallel Set based processing

Page 27: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

27

Getting Serious about Performance

•  Performance Techniques as Disruptive Technologies –  10x Minutes to Seconds –  100x Hours to Minutes –  1000x Hours to Seconds

•  Will these speed ups mean ? –  Speed to market –  Less deferred batch –  Increased operational agility –  Early detection of mistakes

•  Now Make your systems GO FAST !

Page 28: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

28

This Week of Interest

•  Tuesday 16/8/2011 –  Andrew Holdsworth “Aim High” 10:15 AM Bayside Gallery B –  Tom Kyte “Efficient PL/SQL” 12:30 PM Bayside Gallery B

•  Wednesday 17/8/2011 –  Graham Wood “ASHes of DB Time” 10:00 AM Bayside Gallery B –  Andrew Holdsworth, Graham Wood, Tom Kyte “Meet the Experts” 2:45 PM

Exhibition Hall –  Tom Kyte “SQL Techniques” 4:00 PM Bayside Gallery B

•  Thursday 18/8/2011 –  Andrew Holdsworth, Graham Wood, Tom Kyte “A Day of Real World

Performance” Bayside 105

Page 29: Database & Technology 1 | Andrew Holdsworth | Orace Database Performance.pdf

29

The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.