50

Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through
Page 2: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Monitoring Made Easy for DBAs: Diagnosing Performance Problems

Anirban Chatterjee Sriram PalapudiSenior Product Manager Consulting Member of Technical Staff

Page 3: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Page 4: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Program Agenda

• Why DBAs Need to Monitor Storage? • Storage Systems Monitored by EM• Storage Best-Practices for DBAs• Diagnosing Performance Problems• Storage Plug-in Architecture• Q/A

Page 5: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Why DBAs Need to Monitor Storage?

Database Host S torage

• Insure

• Storage meets throughput needs

• Storage has adequate I/O capacity

• Storage capacity can scale up

• Diagnose performance problems

Page 6: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Visualize Database to Storage Relation

Page 7: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Visualize Database to Storage Relation Top Down Application Management

Page 8: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Visualize Database to Storage Relation

• Enterprise Manager helps you meet the challenges of managing application infrastructure

• Comprehensive visibility into your infrastructure

Page 9: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Diagnose Performance Problems

• Enterprise Manager helps you meet the challenges of managing application infrastructure

• Comprehensive visibility into your infrastructure

• Rapid, accurate diagnosis & resolution of complex problems

Page 10: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Integrate With Helpdesk Systems

• Enterprise Manager helps you meet the challenges of managing application infrastructure

• Comprehensive visibility into your infrastructure

• Rapid, accurate diagnosis & resolution of complex problems

• Seamless integration into your operations tools & processes

Help Desk

System

Connector

Page 11: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Oracle Enterprise ManagerIncreases Business Efficiency

• Manage applications top-down, from the business perspective by understanding user experiences and business impact of IT issues

• Manage entire application lifecycle to increase business agility with comprehensive application quality management and compliance solutions

• Reduce operational costs through intelligent diagnostics and automated IT processes

Page 12: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

• Leader in the complete enterprise application stack

• Built-in manageability into every tier

• Integrated manageability across the entire stack

Oracle’s Complete Enterprise Application StackBuilt-in & Integrated Manageability

Page 13: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Program Agenda

• Why DBAs need to monitor storage? • Storage systems monitored by EM• Storage best practices for DBAs• Diagnose data I/O and throughput problem• Storage Plug-in Architecture• Q/A

Page 14: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Comprehensive Storage Monitoring BreadthStorage Systems:

• EMC Celerra• EMC Clariion• EMC Symmetrix DMX• NetApp Filer• Pillar Axiom*• Onaro SANScreen*• Veritas Cluster Server *• Symantec Storage Foundation* • HP Storage EVA* (coming soon)• IBM DS4000 Storage* (coming soon)• NEC Storage* (coming soon)

* Partner developed

Page 15: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database to Storage Mapping

Database Host Storage

DISKS

Page 16: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database to Storage Mapping Reports Mapping Database to several StorageSystems

Symantec Storage Foundation

NEC Storage

EMC Symmetrix DMX Storage

Page 17: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Configuration MonitoringVeritas Cluster Server NEC Storage

• Comprehensive depth of configuration information

IBM DS4000

EMC Clariion

Page 18: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Performance Reports

IBM DS4000

NEC Storage

Page 19: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Program Agenda

• Why DBAs need to monitor storage? • Storage Systems Monitored by EM• Storage Best Practices for DBAs• Diagnose Performance problems• Storage Plug-in Architecture• Q/A

Page 20: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Key players

DisksLUNVolumes/

Filesystems/Diskgroups

DatafilesTablespace

DATABASE STORAGE

Page 21: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Databases layout on storage

DisksLUNVolumes/

Filesystems/Diskgroups

DatafilesTablespace

Page 22: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database Storage Layout Best PracticeSpread database components such as table spaces, data files and ASM

disk groups across all available disks

Storage Device and Host Volume Mapping

Page 23: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database Storage Layout Best Practice What is in your Storage System?

LUNs

Disks

Disk Adapters

Cache

Host Adapters

Processors

Page 24: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database Storage Layout Best PracticeSpread Tablespace across Host Adapters and Ports

Host Adapter

Page 25: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database Storage Layout Best Practice….contd

Check for RAID Protection

Check for Host Volume Sharing

Page 26: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database Layout Best Practices

Considerations

• Databases sharing storage disks, front-end ports

• LUNS spread across disks• I/O throughput spread across

Host Adapters and Ports • Disks spread over Disk Adapters• Proper RAID protection• Host volume sharing

LUNs

Disks

Disk Adapters

Cache

Host Adapters

:Port #

Processors

Page 27: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Program Agenda

• Why DBAs Need to Monitor Storage? • Storage Systems Monitored by EM• Storage best practices for DBAs• Diagnose Performance Problems• Storage Plug-in Architecture• Q/A

Page 28: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database Performance – ADDM Report

Automatic Diagnostic Engine

Snapshots inAutomatic Workload

Repository

Self-Diagnostic Engine

ADDM Log File

Page 29: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Performance

0049:13B:1

LUNs (Hyper)

FrontEnd Adapter Port

Disks

Page 30: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

LUN(Hyper) Performance

Disk Adapters

0049:13B:1

LUN

ADDM Log File

Page 31: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Front End Adapter Performance

Host Adapter:Port #

0049:13B:1ADDM Log File

Page 32: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage System

Diagnosing Storage System Errors

Disks : Data Sector Invalidations, RAID Errors, Spares Availability

Disk Adapters : Status and Availability

Host Adapters : Status (Active, Failed) Ports Online, Dead,Offline)

ADDM Log File

Page 33: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

PersonalizationSelect the metric alerts for the components that are of interest

• Targeted Monitoring

• Default Thresholds

• Modifiable Thresholds• Different Notification

Methods

• E-Mail

• SNMP

Page 34: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Diagnosing Performance ProblemsView charts of related targets on one screen

DB Host Storage

Page 35: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Diagnosing Configuration Changes

Page 36: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Configuration ManagementKnow what you have and know what you’re running

• Storage Microcode Version• Model• Model Type• Agent Version• Cache Read State• Firmware Version• Cache Information• Disk Status• Disk Capacity• Total Capacity• Number of Storage Processors• Number of Disks• Number of Spare Disks• Parity Raid Configuration• Raid5 Configuration

Configuration Management Database (CMDB)

Software Installations

SW and HW Configurations

Resource Relationships

Certified Configurations

Best Practices

• CMDB reports• CMDB Statistics• Policy standards• Audit Reports• Decision support

for incident, problem, change, and release management

Page 37: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Did something changed in my storage configuration today?

Storage Configuration Analysis

Page 38: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Program Agenda

• Why DBAs need to monitor storage? • Storage Systems Monitored by EM• Storage Best Practices for DBAs• Diagnose data I/O and throughput problem• Storage Plug-in Architecture• Q/A

Page 39: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Device

Custom

Storage Plug-in ArchitectureSystematic way to extend Enterprise Manager

storage

ORACLE DB ORACLE MIDDLEWARE ORACLE APPS

Page 40: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Plug-in Architecture

• READ-only view of Storage• Single agent for multiple arrays

• Configurable collection frequency• Native Storage CLI Calls

HostHost EM AGENT: for DB/ASM/Host monitoring

ASM/DB ASM/DB

Storage System

EM Client OMS REPOSITORY

Page 41: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Plug-in Security

Storage Security• Lightweight “Read-only” Monitoring• Separate OS user for metric collection scripts

EM Security• Users and Roles limiting access to Storage targets• View Privileges Only

Page 42: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Plug-in Benefits

• Enables DBA & Storage Administrator work together efficiently• Eliminates finger pointing

• Better root-cause-analysis• Through end-to-end tracing of dependent storage

components• Quicker diagnosis

• Through correlated performance metrics across database, host and storage

• Higher quality of service• Through single unified view of database, host and

storage• Reduces of total cost of ownership of system

management

Page 43: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Application Infrastructure Management Broad management for all application-dependent compon ents

DatabasesDatabases MiddlewareMiddleware

Extended Infrastructure Management:PlugExtended Infrastructure Management:Plug --insins

NetworkNetwork

OperatingOperatingSystemsSystems

ServersServers

• Dell PowerEdge

• Linux• All Unix• Microsoft• MVS

• IBM DB2 • MS SQL Server• Sybase ASE• MySQL*

• Check Point Firewall• Juniper NetscreenFirewall• F5 BIG-IP• Nortel Alteon *

ApplicationsApplications

• Microsoft Exchange • SAP *

Virtual ServersVirtual Servers

• VMWare

• Oracle VM (coming soon)

StorageStorage

• NetApp Filer• EMC Celerra, Clariion, Symmetrix DMX• Pillar Axiom*• Onaro SANScreen *• Veritas Cluster Server *• Symantec Storage Foundation* • HP Storage EVA * (coming soon)• IBM DS4000 Storage * (coming soon)• NEC Storage * (coming soon)* Partner Developed

• IBM WebSphere Application Server• IBM WebSphere MQ• JBoss Application Server • Apache Tomcat• Microsoft IIS• Microsoft Active Directory• Microsoft .NET Framework• Microsoft Exchange Server• Microsoft Commerce Server• Microsoft BizTalk Server• Microsoft ISA Server• Citrix Presentation Server*• Blue Lane PatchPoint*• Apache Tomcat

Page 44: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

For More Information

search.oracle.com

or

oracle.com

Page 45: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

<Insert Picture Here>

Questions?

Page 46: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Database mapping report

File Systems

RAW Devices

Volume Managers

ASM Disk Groups

ASM Disks

RAC Databases

Single Instance

Page 47: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through
Page 48: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Capacity analysis

Storage

Used

Free

DatabaseBalanced

DatabaseUnder-

Capacity

Over-Capacity

ASM Database

Balanced

StorageUsed

Free

Page 49: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Storage Capacity Analysis

• What other databases am I sharing storage with?

• Analyze • storage allocated

• storage used• storage capacity

available.

• Helps in • planning and

provisioning storage

IBM DS4000

Page 50: Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through end-to-end tracing of dependent storage components • Quicker diagnosis • Through

Host and ASM Metrics

• Disk Activity• Average Disk I/O Service Time

(ms)• Disk Block Writes (per second)• Disk Blocks Reads (per

second)• Disk Device Busy (%)• Disk Reads (per second)• Disk Writes (per second)

• Disk Group/ Disk Performance• I/O per second• IO Throughput• Read Response Time• Read Throughput• Reads per second• Response Time• Write Response Time• Write Throughput• Writes per second

Host ASM