Storage Monitoring Made Easy for DBAs: Diagnosing ... · • Better root-cause-analysis • Through...

Storage Monitoring Made Easy for DBAs: Diagnosing Performance Problems

Anirban Chatterjee Sriram PalapudiSenior Product Manager Consulting Member of Technical Staff

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

<Insert Picture Here>

Program Agenda

• Why DBAs Need to Monitor Storage? • Storage Systems Monitored by EM• Storage Best-Practices for DBAs• Diagnosing Performance Problems• Storage Plug-in Architecture• Q/A

Why DBAs Need to Monitor Storage?

Database Host S torage

• Insure

• Storage meets throughput needs

• Storage has adequate I/O capacity

• Storage capacity can scale up

• Diagnose performance problems

Visualize Database to Storage Relation

Visualize Database to Storage Relation Top Down Application Management

Visualize Database to Storage Relation

• Enterprise Manager helps you meet the challenges of managing application infrastructure

• Comprehensive visibility into your infrastructure

Diagnose Performance Problems

• Enterprise Manager helps you meet the challenges of managing application infrastructure

• Comprehensive visibility into your infrastructure

• Rapid, accurate diagnosis & resolution of complex problems

Integrate With Helpdesk Systems

• Enterprise Manager helps you meet the challenges of managing application infrastructure

• Comprehensive visibility into your infrastructure

• Rapid, accurate diagnosis & resolution of complex problems

• Seamless integration into your operations tools & processes

Help Desk

System

Connector

Oracle Enterprise ManagerIncreases Business Efficiency

• Manage applications top-down, from the business perspective by understanding user experiences and business impact of IT issues

• Manage entire application lifecycle to increase business agility with comprehensive application quality management and compliance solutions

• Reduce operational costs through intelligent diagnostics and automated IT processes

• Leader in the complete enterprise application stack

• Built-in manageability into every tier

• Integrated manageability across the entire stack

Oracle’s Complete Enterprise Application StackBuilt-in & Integrated Manageability

<Insert Picture Here>

Program Agenda

• Why DBAs need to monitor storage? • Storage systems monitored by EM• Storage best practices for DBAs• Diagnose data I/O and throughput problem• Storage Plug-in Architecture• Q/A

Comprehensive Storage Monitoring BreadthStorage Systems:

• EMC Celerra• EMC Clariion• EMC Symmetrix DMX• NetApp Filer• Pillar Axiom*• Onaro SANScreen*• Veritas Cluster Server *• Symantec Storage Foundation* • HP Storage EVA* (coming soon)• IBM DS4000 Storage* (coming soon)• NEC Storage* (coming soon)

* Partner developed

Database to Storage Mapping

Database Host Storage

DISKS

Database to Storage Mapping Reports Mapping Database to several StorageSystems

Symantec Storage Foundation

NEC Storage

EMC Symmetrix DMX Storage

Storage Configuration MonitoringVeritas Cluster Server NEC Storage

• Comprehensive depth of configuration information

IBM DS4000

EMC Clariion

Storage Performance Reports

IBM DS4000

NEC Storage

<Insert Picture Here>

Program Agenda

• Why DBAs need to monitor storage? • Storage Systems Monitored by EM• Storage Best Practices for DBAs• Diagnose Performance problems• Storage Plug-in Architecture• Q/A

Key players

DisksLUNVolumes/

Filesystems/Diskgroups

DatafilesTablespace

DATABASE STORAGE

Databases layout on storage

DisksLUNVolumes/

Filesystems/Diskgroups

DatafilesTablespace

Database Storage Layout Best PracticeSpread database components such as table spaces, data files and ASM

disk groups across all available disks

Storage Device and Host Volume Mapping

Database Storage Layout Best Practice What is in your Storage System?

LUNs

Disks

Disk Adapters

Cache

Host Adapters

Processors

Database Storage Layout Best PracticeSpread Tablespace across Host Adapters and Ports

Host Adapter

Database Storage Layout Best Practice….contd

Check for RAID Protection

Check for Host Volume Sharing

Database Layout Best Practices

Considerations

• Databases sharing storage disks, front-end ports

• LUNS spread across disks• I/O throughput spread across

Host Adapters and Ports • Disks spread over Disk Adapters• Proper RAID protection• Host volume sharing

LUNs

Disks

Disk Adapters

Cache

Host Adapters

:Port #

Processors

<Insert Picture Here>

Program Agenda

• Why DBAs Need to Monitor Storage? • Storage Systems Monitored by EM• Storage best practices for DBAs• Diagnose Performance Problems• Storage Plug-in Architecture• Q/A

Database Performance – ADDM Report

Automatic Diagnostic Engine

Snapshots inAutomatic Workload

Repository

Self-Diagnostic Engine

ADDM Log File

Storage Performance

0049:13B:1

LUNs (Hyper)

FrontEnd Adapter Port

Disks

LUN(Hyper) Performance

Disk Adapters

0049:13B:1

LUN

ADDM Log File

Front End Adapter Performance

Host Adapter:Port #

0049:13B:1ADDM Log File

Storage System

Diagnosing Storage System Errors

Disks : Data Sector Invalidations, RAID Errors, Spares Availability

Disk Adapters : Status and Availability

Host Adapters : Status (Active, Failed) Ports Online, Dead,Offline)

ADDM Log File

PersonalizationSelect the metric alerts for the components that are of interest

• Targeted Monitoring

• Default Thresholds

• Modifiable Thresholds• Different Notification

Methods

• E-Mail

• SNMP

Diagnosing Performance ProblemsView charts of related targets on one screen

DB Host Storage

<Insert Picture Here>

Diagnosing Configuration Changes

Configuration ManagementKnow what you have and know what you’re running

• Storage Microcode Version• Model• Model Type• Agent Version• Cache Read State• Firmware Version• Cache Information• Disk Status• Disk Capacity• Total Capacity• Number of Storage Processors• Number of Disks• Number of Spare Disks• Parity Raid Configuration• Raid5 Configuration

Configuration Management Database (CMDB)

Software Installations

SW and HW Configurations

Resource Relationships

Certified Configurations

Best Practices

• CMDB reports• CMDB Statistics• Policy standards• Audit Reports• Decision support

for incident, problem, change, and release management

Did something changed in my storage configuration today?

Storage Configuration Analysis

<Insert Picture Here>

Program Agenda

• Why DBAs need to monitor storage? • Storage Systems Monitored by EM• Storage Best Practices for DBAs• Diagnose data I/O and throughput problem• Storage Plug-in Architecture• Q/A

Device

Custom

Storage Plug-in ArchitectureSystematic way to extend Enterprise Manager

storage

ORACLE DB ORACLE MIDDLEWARE ORACLE APPS

Storage Plug-in Architecture

• READ-only view of Storage• Single agent for multiple arrays

• Configurable collection frequency• Native Storage CLI Calls

HostHost EM AGENT: for DB/ASM/Host monitoring

ASM/DB ASM/DB

Storage System

EM Client OMS REPOSITORY

Storage Plug-in Security

Storage Security• Lightweight “Read-only” Monitoring• Separate OS user for metric collection scripts

EM Security• Users and Roles limiting access to Storage targets• View Privileges Only

Storage Plug-in Benefits

• Enables DBA & Storage Administrator work together efficiently• Eliminates finger pointing

• Better root-cause-analysis• Through end-to-end tracing of dependent storage

components• Quicker diagnosis

• Through correlated performance metrics across database, host and storage

• Higher quality of service• Through single unified view of database, host and

storage• Reduces of total cost of ownership of system

management

Application Infrastructure Management Broad management for all application-dependent compon ents

DatabasesDatabases MiddlewareMiddleware

Extended Infrastructure Management:PlugExtended Infrastructure Management:Plug --insins

NetworkNetwork

OperatingOperatingSystemsSystems

ServersServers

• Dell PowerEdge

• Linux• All Unix• Microsoft• MVS

• IBM DB2 • MS SQL Server• Sybase ASE• MySQL*

• Check Point Firewall• Juniper NetscreenFirewall• F5 BIG-IP• Nortel Alteon *

ApplicationsApplications

• Microsoft Exchange • SAP *

Virtual ServersVirtual Servers

• VMWare

• Oracle VM (coming soon)

StorageStorage

• NetApp Filer• EMC Celerra, Clariion, Symmetrix DMX• Pillar Axiom*• Onaro SANScreen *• Veritas Cluster Server *• Symantec Storage Foundation* • HP Storage EVA * (coming soon)• IBM DS4000 Storage * (coming soon)• NEC Storage * (coming soon)* Partner Developed

• IBM WebSphere Application Server• IBM WebSphere MQ• JBoss Application Server • Apache Tomcat• Microsoft IIS• Microsoft Active Directory• Microsoft .NET Framework• Microsoft Exchange Server• Microsoft Commerce Server• Microsoft BizTalk Server• Microsoft ISA Server• Citrix Presentation Server*• Blue Lane PatchPoint*• Apache Tomcat

For More Information

search.oracle.com

or

oracle.com

<Insert Picture Here>

Questions?

Database mapping report

File Systems

RAW Devices

Volume Managers

ASM Disk Groups

ASM Disks

RAC Databases

Single Instance

Storage Capacity analysis

Storage

Used

Free

DatabaseBalanced

DatabaseUnder-

Capacity

Over-Capacity

ASM Database

Balanced

StorageUsed

Free

Storage Capacity Analysis

• What other databases am I sharing storage with?

• Analyze • storage allocated

• storage used• storage capacity

available.

• Helps in • planning and

provisioning storage

IBM DS4000

Host and ASM Metrics

• Disk Activity• Average Disk I/O Service Time

(ms)• Disk Block Writes (per second)• Disk Blocks Reads (per

second)• Disk Device Busy (%)• Disk Reads (per second)• Disk Writes (per second)

• Disk Group/ Disk Performance• I/O per second• IO Throughput• Read Response Time• Read Throughput• Reads per second• Response Time• Write Response Time• Write Throughput• Writes per second

Host ASM