IMS Reorganization Expert and Automation Console - IMS UG April 2012 Victoria

1© 2012 IBM Corporation

IMS Reorganization Expert

Reorganize IMS Databasesonly when you need to

IMS Tools – Technical Sales SupportDennis [email protected]


� Why Reorganize?

� Traditional Reorganization Practices

� New Reorganization Needs

� Tools Interaction

� Summary



� Reorganizations are performed for three reasons:

– Maintain Database Integrity

• Assure that all hierarchical connections remain correct and all access paths to all data are available to the end user.

– Maintain Database Availability

• Assure that the database is accessible to users by NOT allowing overrun of dataset space allocation values as size and extents. Allowing for database growth inside of the dataset.

– Maintain Database Performance

• Assure that access paths to the data remain optimum by achieving rapid access to meet Service Level Agreements.



� Take the Database Offline

� Image Copy the Database

� Unload the Database

� Delete – Define the dataset

� Load the Database

� Build Indexes (if needed)

� Build Logicals (if needed)

� Image Copy the Database

� Return the Database online


� Traditional Reorganizations cause loss of database access!!

IMS Region

IMS Database

Backup process


� Traditional Reorganizations are performed for two reasons:

– The database is reported Out of Service.• The database is unavailable due to an integrity error or database

dataset failure. This results in a condition of NO ACCESS to theend user until corrected.

• This condition is ad hoc and likely happens at the least opportune time of processing.

– The database is Scheduled to be reorganized periodically.

• The database is ALWAYS in a state of NO ACCESS during specific and scheduled times. This results in a condition of NOACCESS to the end user until completed.

• This condition uses time and resources regardless of need.

A scheduled offline condition of the database may or may not be needed based on the actual condition of the database and datasetattribute usage. The database may not NEED to be reorganized.



A scheduled reorganization resulting in an offline condition of the database may or may not be needed based on the actual condition of the database and dataset attribute usage.

� Reducing the number of database reorganizations results in a direct savings of CPU, I/O and an increase in database availability.

– A regular schedule of reorganizations is safe but expensive.

– A procedure to identify databases that might need reorganizationcan be intensive, tedious and time consuming for the DBA responsible..



� You could be notified when a database needed reorganization -automatically.

� You could schedule that reorganization at the least possible impactful time to normal processing.

� You could easily monitor individual databases for trends towardsneeding reorganization.

� You could save time, CPU cycles and money by performing fewer database reorganizations...

AND

� You could increase availability of the database to end users.


What if? As a DBA...



– Reorganization Expert

1. Collecting statistics data for database management

※We will call this data the sensor data

2. Defining and managing the reorganization policy for detecting database and dataset exceptions

3. Utilizing the policy for exception notification and reporting

4. Utilizing the policy for conditional reorganization5. Tracking detected exceptions and effectiveness of

reorganization

– IPR Unload, IPR Reload, and IPR DB Scan utilities are also included and are fully compatible with those in IPR



– Automation Director and Autonomics Console

1. Collecting statistics data for database management.

※We will call this data the sensor data.

2. Defining and managing the reorganization policy for detecting database and dataset exceptions.

3. Utilizing the policy for exception notification and reporting.

4. View exceptions and usage trends remotely.5. Identify help information and action recommendations

based on actual exception.



� Statistical point-in-time sensor data.� Stored in IMS Tools Knowledge Base repository.� Historically maintained per user specifications.� Over 60 separate data elements related to space usage,

optimization, and fragmentation provided.− E.g. data set extents, DASD volume usage, data set free space, roots

distribution, RAP usage, CI/CA splits, and IMS free space.

� Two methods of collection:� Standalone database Sensor utilities for full-function and Fast

Path databases.� Integrated with existing IMS Tools.

� Integrated Tools support� High Performance Image Copy, High Performance Pointer

Checker.� Fast Path Analyzer, Fast Path Online Pointer Checker.

Sensors: Collecting the Basic Information



� Policy definitions are used to evaluate specific database states.� Threshold values are compared against sensor data for a given

database or group of databases.� When thresholds are met or exceeded, exceptions occur.� E.G. the state of space utilization at a specific instance in time.

� Works “out of the box”� Ships with predefined policies and threshold values.� Full ISPF interface provided for policy management.

� Customizable to fit your shop.� You can define your own sets of threshold values.� Customize the messages sent when exceptions do occur.� Submit a reorganization job at exception time.

− Can use job scheduler to execute the job later� Specify who receives which messages and how.

− WTO, E-mail, or text

Policies: Using Sensor Data to Help Make Decisions



� A prerequisite for all IMS Tools Solution Packs

� Contains all the common infrastructure components, including the IMS Tools Knowledge Base, for enabling autonomics and next-generation Uis

� Policy Services provides the predefined policies and thresholds

� IMS Tools Knowledge Base repository holds the information to help you make expert decisions� Sensor Data� Policy Services� Reports

� No charge PID� Program number: 5655-V93� IBM Tools Base for z/OS V1.3

IBM Tools Base for z/OS

13 © 2012 IBM Corporation

Smart Reorg utility features at a glance

• All information is stored in and managed by IMS Tools KB repositories• Sysplex-wide access to these repositories is supported by IMS Tools KB Server

IMS Tools KBServer

ISPF ReportSearch/View

ISPF

System z Server

Smart Reorg job

Sensor data records and reports are sent to

repository

A policy is retrieved from repository and is applied

Policy Repository *1

ReportRepository *2

Sensor DataRepository

TSO usersand/orz/OS operator consoles

Notification messages are sent

Sysplex1. Sensor Data

Collection

2. Reorg policy Definition

3. Exception Notification and Reporting

4. Conditional Reorg

5. Tracking exceptions and reorgs

*1: ITKB Input Repository is used as the Policy Repository.*2: ITKB Output Repository is used as the Report Repository.

1

4

5

3

PolicyManagement

2


Benefits of using IMS DB Reorganization Expert

• IMS Database Reorganization Expert provides a smarter reorganization solution

• Benefits of Policy Services and Smart Reorg utility:

– DBAs can centrally control the information that is needed to plan and perform reorganization of IMS databases effectively

– DBA expertise required to perform reorganization can be minimized and knowledge of skilled DBA can become shared

– Unneeded reorgs can be avoided with its reason documented and effectiveness of reorg, if performed, can easily be verified

Reorganization need/effectiveness is evaluated and n otifiedReorganization need/effectiveness is evaluated and n otified

Necessary info/data is always there in well-defined formatNecessary info/data is always there in well-defined format

Decision criteria and actions are documented in polici esDecision criteria and actions are documented in polici es


Summary

• Everything needed for daily IMS database administration is in a Pack!

UnloadLoad

Reorganization

DB Integrity CheckDB Repair

BackupImage Copy

IndexBuild/Recovery

IMS Definition Libraries Management

DB Space Utilization Analysis

Database Repair Facility

Database Repair Facility

IMS Database Reorganization Expert

V4.1Smarter Reorganization

IMS Index BuilderIMS Index BuilderIMS High Performance

Image CopyIMS High Performance

Image Copy

IMS High Performance Prefix Resolution

IMS High Performance Prefix Resolution

IMS Library Integrity Utilities

IMS Library Integrity Utilities

IMS High Performance Load

IMS High Performance Load

IMS High Performance Pointer Checker

IMS High Performance Pointer Checker

IMS High Performance Unload

IMS High Performance Unload

IMS Database Solution Pack for z/OS V1.1IMS Database Solution Pack for z/OS V1.1

IMS Tools Base for z/OS (a free separate PID): ITK B, TOSI, and other common servicesIMS Tools Base for z/OS (a free separate PID): ITK B, TOSI, and other common services


IMS Automation Console

Policies: Using Sensor Data to Help Make Decisions� Threshold values are compared against sensor data for a given

database or group of databases.� When thresholds are met or exceeded, exceptions occur.� E.G. the state of space utilization at a specific instance in time.

Sensors: Collecting the Basic Information� Ships with predefined policies and threshold values.� Full ISPF interface provided for policy management.

� Customizable to fit your shop.� You can define your own sets of threshold values.� Customize the messages sent when exceptions do occur.� Specify who receives which messages and how.

− WTO, E-mail, or text


IMS Automation

� Passive autonomics for IMS databases.

� Automates ongoing database monitoring and maintenance tasks based on a detailed understanding of the current state of your IMS databases.

� ISPF Dialog Interface.

� Provides a scheduling feature that allowing the user to control how frequently sensor data is collected and how frequently policies are evaluated.

� Recommends when databases should be reorganized based on the policy criteria.

� Integration with the Administration Console via internet access.

Autonomics Director


IMS Automation

� Provide a holistic view of your IMS databases from a single, easy-to-use web interface.

� Dynamic, interactive graphs and charts provide you with a visualrepresentation of your sensor data.

� Integration with the Autonomics Director provides a list of policy exceptions and recommended resolutions for all of your monitoreddatabases.

� All IMS Tools reports stored in the IMS Tools Knowledge Base canbe searched, retrieved, and viewed effortlessly from a single point.

� Prepare for the next generation of IMS DBAs.

� Access from anywhere via the Internet using the most popular webbrowsers.

� Includes a robust help system that serves as a learning aid for new IMS DBAs and reminder for the seasoned DBAs.

Administration Console

19 © 2012 IBM Corporation19

Autonomics Director Process Flow

Autonomics Director Master Server

ITKBRepository

Server

Tools Input Repository

AD Repository

Sensor Data

Repository

Policy Repository

DBDLIBs

DBRCRECONs

Policy/SensorEvaluationServices

SchedulerServices

AutoDiscovery

RouterServices

MonitorServices

DB SensorICPC

DB SensorJCL Lib(s)

Internal Reader

Customization Recommendations

USDB1 HDAM Sensor=8 hrs

Eval

=8 hrs

USDB2 DEDB Sensor=12 hrs

Eval

=12 hrs

User Interface Services


IMS Automation

ISPF Dialog Recommendations


IMS Automation



IMS Automation



IMS Automation

Administration Console

� Provide a holistic view of your IMS databases from a single web interface.

� Dynamic, interactive graphs and charts provide you with a visualrepresentation of your sensor data.

� Integration with the Autonomics Director provides a list of policy exceptions and recommended resolutions for all of your monitoreddatabases.

� All IMS Tools reports stored in the IMS Tools Knowledge Base can be searched, retrieved, and viewed effortlessly.

� Prepare for the next generation of IMS DBAs.

� Uses the latest web technologies.� Access from anywhere via the Internet using popular web browsers.� Includes a help system that serves as a learning aid for new IMS

DBAs.


IMS Automation Overview of IMS Resources with Drill-down

Resource status, errors, and recommendations can be aggregated with an ability to drill down

Monitored Resource List


IMS Automation …from Various HP Tools

…from Autonomics Director

…from Sensors

…from Auto Discovery

Holistic View of IMS Resources


IMS Automation

Integrated help educates new and experienced DBAs on database concepts and how to interpret charts

Prepare the next generation of IMS DBAs


IMS Automation

?Eclipse

BrowserToolTool

ToolTool

ToolTool

z/OSISPF

IMS

ToolTool

ToolTool

Terminal Emulator

DistributedAccess

Infrastructure

DistributedAccess

Infrastructure

ApplicationServer

ApplicationServer

HTTP (REST)

TCP/IP

…

TCP/IP

HTTP

(REST)

� Standard SMP/E installation� Light weight ‘mid tier’ application server installed using

simple InstallAnywhere (.exe)


IMS Automation

� Install once, access anywhere via the Internet

� Single, server-based installation

� Access through popular web browsers

� Safety and security features are built in

� Uses SSL and RACF authentication

� Works “out of the box”

� Immediately view your databases using your existing DBRC groups or Autonomics Director monitor list

� Easily customized

� Define your own groups of databases to view

� Consolidated information at your fingertips

� Summary pages provide total counts of warning, severe, and critical exceptions for a database group – drill down to the individual database level from there


IMS Automation

� Value

� Provides a full set of tools for maintaining and managing your IMS full-function and Fast Path databases.

� Includes important High Performance utilities.

� Utilizes Sensors, Policies, Automation, and Modernization.

� Delivers on the IMS Tools vision.


� IBM Tools Base for z/OS V1.3

– IMS Tools Knowledge Base SC19-3397

– IMS Tools Common Services SC19-3996

– Policy Services SC19-3399

� IMS Database Solution Pack V1.2

– IMS Database Reorganization Expert SC19-1137

– IMS Solution Packs Database Sensor SC19-3283

– IMS High Performance Database Tools

� IMS Fast Path Solution Pack V1.2

– IMS High Performance Fast Path Utilities SC19-3287

IMS Reorganization Expert Reference


� IBM Tools Base for z/OS V1.3

– Administration Console SC19-3264

– Autonomics Director SC193265

– Distributed Access Infrastructure SC19-3400

– IMS Tools Knowledge Base SC19-3397

– IMS Tools Common Services SC19-3996

– Policy Services SC19-3399

� IMS Database Solution Pack V1.2

– IMS Solution Packs Database Sensor SC19-3283

– IMS High Performance Database Tools

� IMS Fast Path Solution Pack V1.2

– IMS High Performance Fast Path Utilities SC19-3287

IMS Autonomics Reference

Technology

IMS Reorganization Expert and Automation Console - IMS UG April 2012 Victoria