IMS Tools - Smarter Reorgs

IBM Software Group | Information Management

Silicon Valley Lab, San Jose, CA © 2011 IBM Corporation

IMS Tools – Smarter ReorgsFix the Right Problem and Reorg it and You’re Done

IMS Regional User’s Group Meeting

Janet [email protected]

2

IBM Software Group

© 2011 IBM Corporation

Agenda

� IMS™ database reorganization today

� IMS Database Reorganization Expert overview

� Reorganization Expert features

� Implementation Considerations

� Summary

3

IBM Software Group


© Copyright IBM Corporation 2011. All rights reserve d.U.S. Government Users Restricted Rights - Use, dupli cation or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

THE INFORMATION CONTAINED IN THIS PRESENTATION IS P ROVIDED FOR INFORMATIONAL PURPOSES ONLY. WHILE EFFORTS WERE MADE TO VERIFY THE COMPLETE NESS AND ACCURACY OF THE INFORMATION CONTAINED IN THIS PRESENTATION, IT IS P ROVIDED “AS IS” WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. IN ADDITION, THIS INF ORMATION IS BASED ON IBM’S CURRENT PRODUCT PLANS AND STRATEGY, WHICH ARE SUBJECT TO CH ANGE BY IBM WITHOUT NOTICE. IBM SHALL NOT BE RESPONSIBLE FOR ANY DAMAGES ARISING OU T OF THE USE OF, OR OTHERWISE RELATED TO, THIS PRESENTATION OR ANY OTHER DOCUMENT ATION. NOTHING CONTAINED IN THIS PRESENTATION IS INTENDED TO, NOR SHALL HAVE THE EFF ECT OF, CREATING ANY WARRANTIES OR REPRESENTATIONS FROM IBM (OR ITS SUPPLIERS OR LICEN SORS), OR ALTERING THE TERMS AND CONDITIONS OF ANY AGREEMENT OR LICENSE GOVERNING TH E USE OF IBM PRODUCTS AND/OR SOFTWARE.

IBM, the IBM logo, ibm.com, IMS, and z/OS are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml

Disclaimer

4

IBM Software Group


IMS Database Reorganization Today

Background: motivation for developing this toolBackground: motivation for developing this tool

5

IBM Software Group



Typical reorganization processes and their planning� Free space defrag

– Unload and reload without DBD change

– Regularly scheduled: weekly, biweekly, monthly, etc.

� Database structure change– Performed for better space utilization and performance

– Needs periodic collection and analysis of database statistics

– Needs proactive planning

Free SpaceDefragging

(Compaction)

Various Types ofDB Definition

Changes

Block SizeChange

Repartitioningand/or

Multiple DSGs

6

IBM Software Group



Workload for data management increases as your busi ness grows� Increasing volume of repetitive tasks such as free space defrag

– Processing efficiency is becoming important

� More frequent needs for database logical/physical structure changes– Deep IMS DBA skills are needed for these complex tasks

Plan/Do ActionsPlan/Do ActionsDiagnose DatabasesDiagnose Databases

PointerCheckerReports

% of segment splits

Avg nbr of FSEs

% of max. dataset size

Number of extents

Statistics Values

...

Diagnosis ResultDiagnosis Result

Exception 1

Exception 4

...

Each may be simple, but the total work volume

is getting larger


is getting larger

...

Processing efficiencyis becoming importantProcessing efficiencyis becoming important

How to do itthis time?


When canit be done?When can

it be done?

Deep IMS DBAskills are needed

in planning actions


in planning actions

Exception 2

Exception 3

Check KeyStats Items

IMS DBA

Simple Repetitive Actions(e.g. free space defrag)

Complex Actions(e.g. Structure Change)

7

IBM Software Group


Objective of IMS Database Reorganization Expert

Help customers perform these tasks more efficientlywith decreasing number of skilled DBAs.

Plan/Do ActionsPlan/Do ActionsDiagnose DatabasesDiagnose Databases

PointerCheckerReports

% of segment splits

Avg nbr of FSEs

% of max. dataset size

Number of extents

Statistics Values

...

Diagnosis ResultDiagnosis Result

Exception 1

Exception 4

...


is getting larger


is getting larger

...

Processing efficiencyis becoming importantProcessing efficiencyis becoming important



When canit be done?When can

it be done?


in planning actions


in planning actions

Exception 2

Exception 3

Check KeyStats Items

IMS DBA

Simple Repetitive Actions(e.g. free space defrag)

Complex Actions(e.g. Structure Change)

8

IBM Software Group


IMS Database Reorganization Expert

Helps customers:

1. Document DBA knowledge for regular repetitive tasks2. Automate those tasks using the documented knowledge3. Keep the knowledge and results of operations in one place

9

IBM Software Group


IMS Database Reorganization Expert– 3 objectives

1. Policy-based database space management

� Exceptional states of database space usage are named

� Rules for exception detection are documented in a policy

� Target/method of exception notification are documented in the policy

2. Policy-based automated operation

� The policy is used to detect reorganization need

� Free space reorg. can be done conditionally based on the policy

� Effectiveness of each free space reorg. can be evaluated

3. Central management of information and data

� Policies are kept and managed in a repository

� Statistics data needed for exception detection are kept in a repository

� History of exceptions and reorganizations are kept also in a repository

Document DBA knowledgeDocument DBA knowledge

Automate repetitive tasksAutomate repetitive tasks

Keep info/data in one placeKeep info/data in one place

10

IBM Software Group


IMS Database Reorganization Expert– Follow-on product of IMS Parallel Reorganization

All information and data are managed by IMS Tools K nowledge Base

1. Policy definition

2. Statistics data collection

3. Exception detection

4. Conditional reorganization

5. Exception reporting

Policy Repository

ReportRepository

Sensor DataRepository

231 5

IMS ToolsKnowledge Base

Server

ISPF

ISPF

z/OS®consoles(and/orTSO users)

2

35

A Smart Reorg Utility Job

5 StoreReport

Notify ExceptionsEvaluateData withPolicy

StoreStats

1Define &StorePolicies

Search &ReadReports

XCF

XCF

XCF

4

New Smart Reorg Utility extends Parallel Reorg Driver capability to provide smarter way of reorganization.

Smart Reorg 5 Major Features

11

IBM Software Group


IMS Tools Knowledge Base– Central management of information and data

IMS Tools Knowledge Base

� Infrastructure for centrally managed repositories for IBM IMS Tools

� Provided at no charge as part ofIMS Tools Base

� A prerequisite of IMS DB ReorgExpert

Managed information and data

� It is important in smarter database management to keep and manage relevant information and data inone place


Server

ISPF

Repository Management User Interface

Managed Various Repositories

Enables Sysplex-wide access to repositories from ISPF UI and Tools.

XCF

12

IBM Software Group


IMS Tools Knowledge Base– Information and data for smarter reorganization

Smart Reorg Utility

� Uses and/or generates the following information and data

– Reorganization Policies

– Database Sensor Data(database space statistics)

– Database Diagnosis Reports

ISPF Policy User Interface

� Provided by IMS Tools Base – Policy Services

� Used to define and manage policies

ISPF Report User Interface

� Used to search and viewreports of various IMS Tools


Server

ISPF

Input Repository

OutputRepository


ISPF

Report UIPolicy UI Smart Reorg

ReorgPolicies

SensorData

DiagnosisReports

Batch Job

Retention of sensor data and reports are managed by IMS Tools KB

Policy API Report API Report APIPolicy API

Repository Client API Repository Client API Repository Client API

Sensor API

13

IBM Software Group


Policy-basedDatabase Space Management

Decision criteria and recommended actions are documented in a policy, and policies are kept in a centrally managed repository.

14

IBM Software Group


Policy-based Database Space Management– A policy describes decision criteria

Reorganization policy� Describes

– Criteria for exception detection

– Action for detected exceptions

– Destinations and methods of exception notification

� Can be defined– For a database type

– For an individual database

– For a group of databases

� Can be associated– With one or more Smart Reorg

jobs through utility control statements

Policy Repository


Server

Select and use a reorganization policy

Define &StorePolicies

Policy UI(ISPF)


15

IBM Software Group


Policy-based Database Space Management– Structure of a policy description

Major components of a policy

� Rules that detect exceptions

� Exception-based action list

A Rule

� Has two elements:

– Condition

– Exception

Action List

� Defines an exception-to-action mapping

PolicyRule Set

Action ListAction

Action

Action

Rule

Exception Class

Severity Level

Exception

Message Text

Condition Description

Threshold set

Condition

Condition Exception

An Action List Entry

ExceptionClass +Level

Action

Rule Rule

Rule Rule

Rule Rule

16

IBM Software Group


Policy-based Database Space Management– A rule describes an exception detection criteria

A rule condition is defined as a pair of:� An evaluation condition

– Describes what dataare evaluated and how

� A set of threshold values

– Customizable

DB_PCT_OF_MAX_DS_SIZEThe percentage of allocated bytes (bytes for High Allocated RBA) compared to the maximum size (4 GB or 8 GB).

DB_PCT_BYTES_FREE_SPACEThe percentage of bytes of total free spaces to the total used bytes for the data set.

Sensor Data to Evaluate

Evaluation ConditionEvaluation Condition

Threshold ValuesThreshold Values

Name of Threshold Set

( DB_PCT_OF_MAX_DS_SIZE &1 ) AND ( DB_PCT_BYTES_FREE_ SPACE &2 )

in one of data sets that compose the database

( DB_PCT_OF_MAX_DS_SIZE &1 ) AND ( DB_PCT_BYTES_FREE_SPACE &2 )

in one of data sets that compose the database

17

IBM Software Group


Policy-based Database Space Management– Describing an exceptionException Class

� A specific category of database states being monitored

� Defined by IBM

Exception Severity Level

� The severity of an exception detected by the Rule Condition

� Can be chosen from three levels

Exception Message Text

� The text describing the exception

� Can be modified

An Exception

Exception Class:FRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACES

* Name of the rule that detects this exception:

IBM.FRAGMENTATION.10

Exception Class:FRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACES

* Name of the rule that detects this exception:


An Example of Exception Class

“The fragmentation of free space in %RESOURCE% has increased”

* The symbol %RESOURCE% is replaced by a DBDname or a partition name.

“The fragmentation of free space in %RESOURCE% has increased”


An Example of Exception Message

Class

Severity Level

Message Text

� CRITICAL

� SEVERE

� WARNING

� CRITICAL

� SEVERE

� WARNING

Levels

18

IBM Software Group


Policy-based Database Space Management– Describing an action

Exception-to-Action mapping

� Each rule is associated with an exception class

� The threshold set selected for the rule is associated with a severity level of the exception

� An action is associated with a pair of an exception class and its severity level

ThresholdSet Name

Exception Class+ Severity Level

Action

“HIGH”

“MED”

“LOW”

CRITICAL

SEVERE

WARNING

REORG

MESSAGE

Reorganization (free space defrag through unload and reload without DBD change) is recommended

Alerting the user of the exceptionfor preparation for user actions, orfor immediate user actions

An Example

Policy

Rule Set

Action ListAction

Action

Action

An Action List EntryException

Class+Level

Action

Rule Rule

Rule Rule

Rule Rule

Rule

Condition Exception

Exception Class

Severity Level

Message Text

Formula

Threshold Set

19

IBM Software Group


Policy-based Database Space Management – IBM-provided templatesIBM provides policies and rules

� Provided as a PDS member

� Installed into ITKB Input Repository as a set of policy/rule “templates”

Customization

� The installed policy/rule templates can be copied and customized

Import and export

� The copied/customized templates can be exported

– For importing them into another environment

– For backup IMS Tools KBInput Repository

Policy ServicesTemplate Library

(PDS)

Policy Services UI

Policy/Rule Templates

(installed or customized)

Exportedpackage

Installationpackage

Exportedpackage

Export Import

Install

IMS Tools KBServer

A PDS A PDS

Customize

20

IBM Software Group


Policy-based Automated Operation

Smart Reorg Utility provides capability of policy-based automated exception detection and conditional reorgan ization.

21

IBM Software Group


Policy-based Automated Operation– Using Smart Reorg Utility

Four features provided by Smart Reorg Utility

1. Statistics data collection

2. Exception detection

3. Conditional reorganization

4. Exception reporting

Three modes of execution of Smart Reorg Utility

1. Diagnosis Mode

2. Conditional Reorganization Mode

3. Unconditional Reorganization Mode

22

IBM Software Group


Using Smart Reorg Utility– Statistics Data CollectionSensor data for an IMS full-function database

� A set of values of database statistics data elements at a specific time

� Used to detect exceptions by evaluating them with a reorg. policy

Data elements supported in the first release

� Total of about 60 data elements:

– Database Record Statistics

– Randomizer Statistics

– Volume/Extents Statistics

– Data Set Space Usage Statistics

– IMS Space Utilization Statistics

– HISAM/SHISAM Statistics

Complete list of data elements

� Can be found in Policy Services User’s Guide (SC19-2718)

Per database or HALDB partition

Per HDAM or PHDAM partition

Per data set

23

IBM Software Group


Using Smart Reorg Utility– Statistics Data Collection…DB Sensor

� Is a sensor data collector for IMS full-function databases

� Is integrated in Smart Reorg Utility

� Can collect sensor data from a database or HALDB partition while it is online

– One non-HALDB database or HALDB partition at a time

� Stores collected data in IMS Tools KB Sensor Data Repository

� Is much faster than HASH Check of High Performance Pointer Checker

– DB Sensor bypasses pointer integrity check


Server


DB Sensor Datafor FF Databases


DB SensorDB Sensor

Sensor data retention is configurable, and is managed by IMS Tools KB.

24

IBM Software Group


Using Smart Reorg Utility– 3 modes of execution

Diagnosis Mode

� Sensor data is collected and evaluated by a policy to detect exceptions

� A diagnosis report can be stored in IMS Tools KB Output Repository

� Existence of an exception can be notified in various ways

Conditional Reorganization Mode

� Same as Diagnosis Mode

� But, performs reorganization when it is recommended by the diagnosis

– The reorganized database is diagnosed again to see effectiveness of the reorganization and remaining exceptions

Unconditional Reorganization Mode

� Always performs reorganization regardless of the database status

25

IBM Software Group


Using Smart Reorg Utility– Unconditional Reorganization Mode

Single Step Parallel Execution of Reorganization Ut ility Tasks� Same as Parallel Reorg Driver of IMS Parallel Reorganization 3.2

Smart Reorg Driver (IPR Driver)

Renamed tooriginal name

Renamed tooriginal nameRenamed tooriginal name



Renamed tooriginal nameRenamed to

original name


DIS

PO

LDD

S P

roce

ssin

g

Shadow DBDSShadow DBDS

IndexIndexShadowIndex

IC

Index Builder Task

Image Copy Task(can include Pointer Check)

ICIC

Index Builder’s SORT Address SpaceIndex Builder’s SORT Address SpaceIndex Builder’s Sub Address Spaces

DB is Off-linedN

OT

IFY

.RE

OR

G

DB

DS

Nam

e S

wap

ping

CH

AN

GE

.DB

AU

TH

RE

AD

OF

F

Reload Task

Unload Task

NO

TIF

Y.IC

/UIC

Res

tart

ing

DB

/DBR DB /STA DB

OnlineOnline

Original IndexOriginal IndexOriginal IndexOriginal Index

Original IndexOriginal Index

Original DBDSOriginal DBDSOriginal DBDSOriginal DBDS



Parallel Reorganization Service (used only when reorg needed)

Mak

ing

DB

Offl

ine

26

IBM Software Group


Using Smart Reorg Utility– Conditional Reorganization Mode

Basic Scenario of Conditional Reorganization Mode

� Step 1: Sensor data are collected and stored in the Sensor Data Repository

� Step 2: The sensor data are evaluated with the specified policy

� Step 3: Reorganization is performed if it was recommended in Step 2

– Sensor data of the reorganized database are stored

– New sensor data is evaluated with the same policy again

� Step 4: A Diagnosis Report of the evaluation(s) is stored and the existence of remaining exceptions, if any, can be notified

� Step 5: The Diagnosis Report is reviewed by DBA and necessity of further action (e.g., planning for database tuning) is determined

27

IBM Software Group


Smart Reorg Driver (IPR Driver)

Dia

gnos

is o

f Onl

ine

DB

Using Smart Reorg Utility– Benefits of Conditional Reorganization� A database can be reorganized only when it is really needed� The Diagnosis Report provides an evidence of the necessity of reorganization

and effectiveness of the reorganization


Renamed tooriginal nameRenamed tooriginal name



Renamed tooriginal nameRenamed to

original name


DIS

PO

LDD

S P

roce

ssin

g

Shadow DBDSShadow DBDS

IndexIndexShadowIndex

IC

Index Builder Task

Image Copy Task(can include Pointer Check)

ICIC

Index Builder’s SORT Address SpaceIndex Builder’s SORT Address SpaceIndex Builder’s Sub Address Spaces

DB is Off-linedN

OT

IFY

.RE

OR

G

DB

DS

Nam

e S

wap

ping

CH

AN

GE

.DB

AU

TH

RE

AD

OF

F

Reload Task

Unload Task

NO

TIF

Y.IC

/UIC

Res

tart

ing

DB

/DBR DB /STA DB

OnlineOnline

Original IndexOriginal IndexOriginal IndexOriginal Index

Original IndexOriginal Index

Original DBDSOriginal DBDSOriginal DBDSOriginal DBDS



Parallel Reorganization Service (used only when reorg needed)

Mak

ing

DB

Offl

ine

Sensor data are collected during

Reorg Reload

Sensor data are collected during

Reorg Reload

Con

ditio

nal R

eorg

Pos

t Pro

cess

ing

Reorganization needis checked

Reorganization needis checked

z/OS consoles(and/or TSO users)

Detected or remaining exceptions are notified(based on the policy)

28

IBM Software Group


Using Smart Reorg Utility– Exception detection in Diagnosis Mode

Basic Scenario of Diagnosis Mode� Step 1 & 2: Same as those in Conditional Reorganization Mode� Step 3: A Diagnosis Report of the evaluation is stored in the Output Repository

and existence of an exception can be notified� Step 4: The Diagnosis Report is reviewed by DBA and actions are determined.

Or, the notification is used to control succeeding batch jobs or jobsteps.

Statistics Data Collection

Exception Detection

Exception Reporting

Input Repository

OutputRepository



Server

z/OS consoles(and/or TSO users)

1

23

A Smart Reorg Utility Jobstep

3 StoreReport

Notify Exceptions

EvaluateData withPolicy

StoreStats

DBA reads Diagnosis Reportsand determines actionsXCF

XCF

29

IBM Software Group


Using Smart Reorg Utility – Various ways of notifying exceptions

Method 1: Notification by a WTO message

� You can add z/OS consoles as the notification targets

– Including E-MCS consoles

� This could be used for message-based automation

Method 2: Notification by Smart Reorg jobstep return code

� You can change the return code when a critical exception is detected

� This could be used to control the execution of succeeding job steps

Method 3: Notification to TSO users

� You can add TSO user IDs as the notification targets

� Notification messages will be sent by using the TSO SEND command

30

IBM Software Group


Notification Lists� Exception notification is made from

each Smart Reorg job

� Notification is based on the Notification Lists specified in the policy used

� A Notification List can be defind for a group of consoles and/or TSO user IDs

� Notification Lists are stored in the ITKB Input Repository and can be referred to from policies by their names

� Notification Lists can be created, exported, and imported by using the Policy Services UI

PolicyRule Set

Rule Rule

Rule Rule

Rule Rule

Action ListAction

Action

Action

Notification Lists

A Smart Reorg JobCONSOLE1

TSOUSER1SEND

SEND

SEND

WTO

CONSOLE1TSOUSER1TSOUSER2

TSOUSER2

TSOUSER3

TSOUSER2TSOUSER3

An Policy EvaluationSummary Message

Selected

LISTA

LISTB

LISTA

LISTB

31

IBM Software Group


Using Smart Reorg Utility – Exception reporting by Diagnosis Report

Information provided by Diagnosis Report

� Summary of Policy Evaluation

– Policy that was applied to the database

– Reorganization need

– Result of policy evaluation

– Result of policy evaluation after reorganization

• if reorganization was performed

– An evaluation summary message

� Sensor data values before and after reorganization

– And their differences

32

IBM Software Group


IMS DB IMS DB IMS DB IMS DB ReorgReorgReorgReorg Expert Expert Expert Expert ---- V4R1 Database Diagnosis Report Page: 2V4R1 Database Diagnosis Report Page: 2V4R1 Database Diagnosis Report Page: 2V4R1 Database Diagnosis Report Page: 25655-S35 Date: 09/14/2010 Time: 12.05.14

Summary of Policy EvaluationSummary of Policy EvaluationSummary of Policy EvaluationSummary of Policy Evaluation (DBD: BKDB ) -----------------------------------------------------------------Name of Policy Applied............ SYS.DBDTYPE.HIDAM Policy Locale..................... Global Reorganization Need............... Yes

Exceptions before ReorganizationExceptions before ReorganizationExceptions before ReorganizationExceptions before Reorganization--------------------------------------------------------------------------------The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small

Class: DATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITY Level: CRITICALCRITICALCRITICALCRITICALRule: G:IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10 Threshold Set: HIGHHIGHHIGHHIGH

The size of a data set in BKDB, which still has a certain amountThe size of a data set in BKDB, which still has a certain amountThe size of a data set in BKDB, which still has a certain amountThe size of a data set in BKDB, which still has a certain amount of free space, of free space, of free space, of free space, has increasedhas increasedhas increasedhas increased

Class: GROWING_DBDS_WITH_FREE_SPACESGROWING_DBDS_WITH_FREE_SPACESGROWING_DBDS_WITH_FREE_SPACESGROWING_DBDS_WITH_FREE_SPACES Level: CRITICALCRITICALCRITICALCRITICAL -> REORGREORGREORGREORGRule: G:IBM.DBDS_GROWTH.20IBM.DBDS_GROWTH.20IBM.DBDS_GROWTH.20IBM.DBDS_GROWTH.20 Threshold Set: HIGHHIGHHIGHHIGH

The fragmentation of free space in BKDB has increased The fragmentation of free space in BKDB has increased The fragmentation of free space in BKDB has increased The fragmentation of free space in BKDB has increased Class: FRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACES Level: CRITICALCRITICALCRITICALCRITICAL -> REORGREORGREORGREORGRule: G:IBM.FRAGMENTATION.10IBM.FRAGMENTATION.10IBM.FRAGMENTATION.10IBM.FRAGMENTATION.10 Threshold Set: HIGHHIGHHIGHHIGH

A data set of BKDB has many pointers that point to other bocks oA data set of BKDB has many pointers that point to other bocks oA data set of BKDB has many pointers that point to other bocks oA data set of BKDB has many pointers that point to other bocks or r r r CIsCIsCIsCIsClass: EXCESSIVE_SEGMENT_SCATTERINGEXCESSIVE_SEGMENT_SCATTERINGEXCESSIVE_SEGMENT_SCATTERINGEXCESSIVE_SEGMENT_SCATTERING Level: SEVERESEVERESEVERESEVERERule: G:IBM.SEGM_SPREAD.10IBM.SEGM_SPREAD.10IBM.SEGM_SPREAD.10IBM.SEGM_SPREAD.10 Threshold Set: MEDMEDMEDMED

--------------------------------------------------------------------------------

Exceptions after ReorganizationExceptions after ReorganizationExceptions after ReorganizationExceptions after Reorganization--------------------------------------------------------------------------------BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL

The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small Class: DATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITY Level: WARNINGWARNINGWARNINGWARNINGRule: G:IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10 Threshold Set: LOWLOWLOWLOW

--------------------------------------------------------------------------------

Summary of Policy Evaluation and Action:Summary of Policy Evaluation and Action:Summary of Policy Evaluation and Action:Summary of Policy Evaluation and Action:--------------------------------------------------------------------------------BBE2901I BKDB BBE2901I BKDB BBE2901I BKDB BBE2901I BKDB IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING EXCEPTIONS REMAIN.EXCEPTIONS REMAIN.EXCEPTIONS REMAIN.EXCEPTIONS REMAIN.--------------------------------------------------------------------------------


Summary of Policy EvaluationSummary of Policy EvaluationSummary of Policy EvaluationSummary of Policy Evaluation (DBD: BKDB ) -----------------------------------------------------------------Name of Policy Applied............ SYS.DBDTYPE.HIDAM Policy Locale..................... Global Reorganization Need............... Yes

Exceptions before ReorganizationExceptions before ReorganizationExceptions before ReorganizationExceptions before Reorganization--------------------------------------------------------------------------------The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small

Class: DATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITY Level: CRITICALCRITICALCRITICALCRITICALRule: G:IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10 Threshold Set: HIGHHIGHHIGHHIGH

The size of a data set in BKDB, which still has a certain amountThe size of a data set in BKDB, which still has a certain amountThe size of a data set in BKDB, which still has a certain amountThe size of a data set in BKDB, which still has a certain amount of free space, of free space, of free space, of free space, has increasedhas increasedhas increasedhas increased

Class: GROWING_DBDS_WITH_FREE_SPACESGROWING_DBDS_WITH_FREE_SPACESGROWING_DBDS_WITH_FREE_SPACESGROWING_DBDS_WITH_FREE_SPACES Level: CRITICALCRITICALCRITICALCRITICAL -> REORGREORGREORGREORGRule: G:IBM.DBDS_GROWTH.20IBM.DBDS_GROWTH.20IBM.DBDS_GROWTH.20IBM.DBDS_GROWTH.20 Threshold Set: HIGHHIGHHIGHHIGH

The fragmentation of free space in BKDB has increased The fragmentation of free space in BKDB has increased The fragmentation of free space in BKDB has increased The fragmentation of free space in BKDB has increased Class: FRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACESFRAGMENTED_FREE_SPACES Level: CRITICALCRITICALCRITICALCRITICAL -> REORGREORGREORGREORGRule: G:IBM.FRAGMENTATION.10IBM.FRAGMENTATION.10IBM.FRAGMENTATION.10IBM.FRAGMENTATION.10 Threshold Set: HIGHHIGHHIGHHIGH

A data set of BKDB has many pointers that point to other bocks oA data set of BKDB has many pointers that point to other bocks oA data set of BKDB has many pointers that point to other bocks oA data set of BKDB has many pointers that point to other bocks or r r r CIsCIsCIsCIsClass: EXCESSIVE_SEGMENT_SCATTERINGEXCESSIVE_SEGMENT_SCATTERINGEXCESSIVE_SEGMENT_SCATTERINGEXCESSIVE_SEGMENT_SCATTERING Level: SEVERESEVERESEVERESEVERERule: G:IBM.SEGM_SPREAD.10IBM.SEGM_SPREAD.10IBM.SEGM_SPREAD.10IBM.SEGM_SPREAD.10 Threshold Set: MEDMEDMEDMED

--------------------------------------------------------------------------------

Exceptions after ReorganizationExceptions after ReorganizationExceptions after ReorganizationExceptions after Reorganization--------------------------------------------------------------------------------BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL

The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small The number of available extents for a data set of BKDB is small Class: DATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITYDATA_SET_EXTENTS_AVAILABILITY Level: WARNINGWARNINGWARNINGWARNINGRule: G:IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10IBM.DBDS_EXTENTS.10 Threshold Set: LOWLOWLOWLOW

--------------------------------------------------------------------------------

Summary of Policy Evaluation and Action:Summary of Policy Evaluation and Action:Summary of Policy Evaluation and Action:Summary of Policy Evaluation and Action:--------------------------------------------------------------------------------BBE2901I BKDB BBE2901I BKDB BBE2901I BKDB BBE2901I BKDB IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING IN RECONID=RECON207 HAS BEEN REORGANIZED, BUT SOME WARNING EXCEPTIONS REMAIN.EXCEPTIONS REMAIN.EXCEPTIONS REMAIN.EXCEPTIONS REMAIN.--------------------------------------------------------------------------------

Policy Evaluation Summary Message

Policy used for this job

Reorganization was recommended

33

IBM Software Group


IMS DB IMS DB IMS DB IMS DB ReorgReorgReorgReorg Expert Expert Expert Expert ---- V4R1 Database Diagnosis Report Page: 5V4R1 Database Diagnosis Report Page: 5V4R1 Database Diagnosis Report Page: 5V4R1 Database Diagnosis Report Page: 5

5655-S35 Date: 09/14/2010 Time: 12.05.14

Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)

--------------------------------------------------------------------------------

===================================

Data Set Space Usage StatisticsData Set Space Usage StatisticsData Set Space Usage StatisticsData Set Space Usage Statistics

===================================

Note: The mark * in column P means that the data element is used in the policy.

Data Element Name P Before Reorg After Reorg Difference

------------------------ - ---------------- ---------------- ------------------

DB_BLOCK_SIZE 4,096 4,096 0

DB_NUM_DBDS_BLOCKS 999,179 673,780 -325,399

DB_MAX_DS_SIZE 4G 4G 0G

DB_PCT_OF_MAX_DS_SIZE * DB_PCT_OF_MAX_DS_SIZE * DB_PCT_OF_MAX_DS_SIZE * DB_PCT_OF_MAX_DS_SIZE * 96%96%96%96% 65% 65% 65% 65% ----31313131

DB_RBA_HIGH_ALLOC 4,128,768,000 2,801,664,000 -1,327,104,000

DB_RBA_HIGH_USED 4,092,641,280 2,759,806,976 -1,332,834,304

IMS DB IMS DB IMS DB IMS DB ReorgReorgReorgReorg Expert Expert Expert Expert ---- V4R1 Database Diagnosis Report Page: 5V4R1 Database Diagnosis Report Page: 5V4R1 Database Diagnosis Report Page: 5V4R1 Database Diagnosis Report Page: 5

5655-S35 Date: 09/14/2010 Time: 12.05.14

Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)

--------------------------------------------------------------------------------

===================================

Data Set Space Usage StatisticsData Set Space Usage StatisticsData Set Space Usage StatisticsData Set Space Usage Statistics

===================================


Data Element Name P Before Reorg After Reorg Difference

------------------------ - ---------------- ---------------- ------------------

DB_BLOCK_SIZE 4,096 4,096 0

DB_NUM_DBDS_BLOCKS 999,179 673,780 -325,399

DB_MAX_DS_SIZE 4G 4G 0G

DB_PCT_OF_MAX_DS_SIZE * DB_PCT_OF_MAX_DS_SIZE * DB_PCT_OF_MAX_DS_SIZE * DB_PCT_OF_MAX_DS_SIZE * 96%96%96%96% 65% 65% 65% 65% ----31313131

DB_RBA_HIGH_ALLOC 4,128,768,000 2,801,664,000 -1,327,104,000

DB_RBA_HIGH_USED 4,092,641,280 2,759,806,976 -1,332,834,304

34

IBM Software Group



Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)--------------------------------------------------------------------------------

==================================== IMS Space Utilization StatisticsIMS Space Utilization StatisticsIMS Space Utilization StatisticsIMS Space Utilization Statistics

====================================


Data Element Name P Before Reorg After Reorg Difference------------------------ - ---------------- ---------------- ------------------DB_BYTES_SEG 2,465,800,000 2,465,800,000 0DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 ----1,327,587,0021,327,587,0021,327,587,0021,327,587,002DB_BYTES_UNIDENTIFIED * 110 0 -110DB_PCT_BYTES_FREE_SPACE * 39% 10% DB_PCT_BYTES_FREE_SPACE * 39% 10% DB_PCT_BYTES_FREE_SPACE * 39% 10% DB_PCT_BYTES_FREE_SPACE * 39% 10% ----29292929DB_PCT_BYTES_SEG * 60% 89% DB_PCT_BYTES_SEG * 60% 89% DB_PCT_BYTES_SEG * 60% 89% DB_PCT_BYTES_SEG * 60% 89% +29+29+29+29DB_PCT_UNUSED_BYTES * 1% 1% 0DB_NUM_SEG 85,620,000 85,620,000 0DB_NUM_VLSEG 8,560,000 8,560,000 0DB_NUM_VLSEG_SPLIT * 0 0 0DB_PCT_NUM_VLSEG_SPLIT * 0% 0% 0DB_NUM_UNIDENTIFIED * 51 0 -51DB_AVG_NUM_UNIDENTIFIED * 0 0 0DB_NUM_FSE * 23,728,638 673,759 -23,054,879DB_AVG_NUM_FSE * DB_AVG_NUM_FSE * DB_AVG_NUM_FSE * DB_AVG_NUM_FSE * 23.75 23.75 23.75 23.75 1.00 1.00 1.00 1.00 ----22.7522.7522.7522.75DB_NUM_FSE_MIN * 23,558,660 673,759 -22,884,901DB_NUM_FSE_MAX * 718,662 673,759 -44,903DB_AVG_NUM_NOREUSE_FSE * .17 0 -.17DB_NUM_PTR 85,070,408 84,946,241 -124,167DB_NUM_PTR_DIFF_BLK * 32,424,879 663,666 -31,761,213DB_PCT_NUM_PTR_DIFF_BLK * DB_PCT_NUM_PTR_DIFF_BLK * DB_PCT_NUM_PTR_DIFF_BLK * DB_PCT_NUM_PTR_DIFF_BLK * 38%38%38%38% 1% 1% 1% 1% ----37373737


Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)Data Set Statistics (DBD: BKDB , DSG: 01)--------------------------------------------------------------------------------

==================================== IMS Space Utilization StatisticsIMS Space Utilization StatisticsIMS Space Utilization StatisticsIMS Space Utilization Statistics

====================================


Data Element Name P Before Reorg After Reorg Difference------------------------ - ---------------- ---------------- ------------------DB_BYTES_SEG 2,465,800,000 2,465,800,000 0DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 DB_BYTES_FREE_SPACE 1,610,723,680 283,136,678 ----1,327,587,0021,327,587,0021,327,587,0021,327,587,002DB_BYTES_UNIDENTIFIED * 110 0 -110DB_PCT_BYTES_FREE_SPACE * 39% 10% DB_PCT_BYTES_FREE_SPACE * 39% 10% DB_PCT_BYTES_FREE_SPACE * 39% 10% DB_PCT_BYTES_FREE_SPACE * 39% 10% ----29292929DB_PCT_BYTES_SEG * 60% 89% DB_PCT_BYTES_SEG * 60% 89% DB_PCT_BYTES_SEG * 60% 89% DB_PCT_BYTES_SEG * 60% 89% +29+29+29+29DB_PCT_UNUSED_BYTES * 1% 1% 0DB_NUM_SEG 85,620,000 85,620,000 0DB_NUM_VLSEG 8,560,000 8,560,000 0DB_NUM_VLSEG_SPLIT * 0 0 0DB_PCT_NUM_VLSEG_SPLIT * 0% 0% 0DB_NUM_UNIDENTIFIED * 51 0 -51DB_AVG_NUM_UNIDENTIFIED * 0 0 0DB_NUM_FSE * 23,728,638 673,759 -23,054,879DB_AVG_NUM_FSE * DB_AVG_NUM_FSE * DB_AVG_NUM_FSE * DB_AVG_NUM_FSE * 23.75 23.75 23.75 23.75 1.00 1.00 1.00 1.00 ----22.7522.7522.7522.75DB_NUM_FSE_MIN * 23,558,660 673,759 -22,884,901DB_NUM_FSE_MAX * 718,662 673,759 -44,903DB_AVG_NUM_NOREUSE_FSE * .17 0 -.17DB_NUM_PTR 85,070,408 84,946,241 -124,167DB_NUM_PTR_DIFF_BLK * 32,424,879 663,666 -31,761,213DB_PCT_NUM_PTR_DIFF_BLK * DB_PCT_NUM_PTR_DIFF_BLK * DB_PCT_NUM_PTR_DIFF_BLK * DB_PCT_NUM_PTR_DIFF_BLK * 38%38%38%38% 1% 1% 1% 1% ----37373737

35

IBM Software Group


Using Smart Reorg Utility– A Simple Sample JCL

Three types of policy selection� By database type

– This is the default.

– IBM-provided SYS.DBDTYPE.typepolicies is selected

� By database name

– This is intended to be used to specify a database specific policy

� By policy name

– This is intended to be used to specify a same policy for a group of databases

//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=USER.PGMLIB// DD DISP=SHR,DSN=USER.PGMLIB// DD DISP=SHR,DSN=USER.PGMLIB// DD DISP=SHR,DSN=USER.PGMLIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//HPSIN DD *//HPSIN DD *//HPSIN DD *//HPSIN DD *(REORG)(REORG)(REORG)(REORG)

CONDREORG=YESCONDREORG=YESCONDREORG=YESCONDREORG=YESITKBSRVR=FPQSVR00ITKBSRVR=FPQSVR00ITKBSRVR=FPQSVR00ITKBSRVR=FPQSVR00SPACEALLOC=YESSPACEALLOC=YESSPACEALLOC=YESSPACEALLOC=YESNAMESWAP=YESNAMESWAP=YESNAMESWAP=YESNAMESWAP=YES

(CONDREORG)(CONDREORG)(CONDREORG)(CONDREORG)POLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPE

/*/*/*/*

//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y'//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB//STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=USER.PGMLIB// DD DISP=SHR,DSN=USER.PGMLIB// DD DISP=SHR,DSN=USER.PGMLIB// DD DISP=SHR,DSN=USER.PGMLIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//IMS DD DISP=SHR,DSN=IMS.DBDLIB//HPSIN DD *//HPSIN DD *//HPSIN DD *//HPSIN DD *(REORG)(REORG)(REORG)(REORG)

CONDREORG=YESCONDREORG=YESCONDREORG=YESCONDREORG=YESITKBSRVR=FPQSVR00ITKBSRVR=FPQSVR00ITKBSRVR=FPQSVR00ITKBSRVR=FPQSVR00SPACEALLOC=YESSPACEALLOC=YESSPACEALLOC=YESSPACEALLOC=YESNAMESWAP=YESNAMESWAP=YESNAMESWAP=YESNAMESWAP=YES

(CONDREORG)(CONDREORG)(CONDREORG)(CONDREORG)POLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPE

/*/*/*/*

POLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPEPOLICYBY=DBTYPE

POLICYBY=DBDNAMEPOLICYBY=DBDNAMEPOLICYBY=DBDNAMEPOLICYBY=DBDNAMEPOLICYBY=DBDNAMEPOLICYBY=DBDNAMEPOLICYBY=DBDNAMEPOLICYBY=DBDNAME

POLICYBY=NAMEPOLICYBY=NAMEPOLICYBY=NAMEPOLICYBY=NAMEPOLICYNM=MY.POLICY.GROUP1POLICYNM=MY.POLICY.GROUP1POLICYNM=MY.POLICY.GROUP1POLICYNM=MY.POLICY.GROUP1

POLICYBY=NAMEPOLICYBY=NAMEPOLICYBY=NAMEPOLICYBY=NAMEPOLICYNM=MY.POLICY.GROUP1POLICYNM=MY.POLICY.GROUP1POLICYNM=MY.POLICY.GROUP1POLICYNM=MY.POLICY.GROUP1

By database type

By database name

By policy name

Policy to be selectedSYS.DBDTYPE.SYS.DBDTYPE.SYS.DBDTYPE.SYS.DBDTYPE.typetypetypetype

SYS.DBDNAME.SYS.DBDNAME.SYS.DBDNAME.SYS.DBDNAME.dbdnamedbdnamedbdnamedbdname

MY.POLICY.GROUP1MY.POLICY.GROUP1MY.POLICY.GROUP1MY.POLICY.GROUP1

(type = HDAM, HIDAM, PHDAM, PHIDAM, HISAM, or SHISAM)

Specifies XCF Group Name for ITKB Server to connect

Specifies Conditional Reorg Mode

Specifies how a policy is to be selected

,,,,DYAGONLYDYAGONLYDYAGONLYDYAGONLY

Specifies Diagnosis Mode

36

IBM Software Group


Policies

Policies deliver the intelligence to an intelligent reorg

37

IBM Software Group


IMS Database Reorganization Expert– 3 objectives

1. Policy-based database space management

� Exceptional states of database space usage are named

� Rules for exception detection are documented in a policy

� Target/method of exception notification are documented in the policy

2. Policy-based automated operation

� The policy is used to detect reorganization need

� Free space reorg. can be done conditionally based on the policy

� Effectiveness of each free space reorg. can be evaluated

3. Central management of information and data

� Policies are kept and managed in a repository

� Statistics data needed for exception detection are kept in a repository

� History of exceptions and reorganizations are kept also in a repository

Document DBA knowledgeDocument DBA knowledge

Automate repetitive tasksAutomate repetitive tasks

Keep info/data in one placeKeep info/data in one place

38

IBM Software Group


Summary of information and data for Smart Reorg

Evaluates the data with the policy and notify the result

Searches and reads the selected policy

Policy ServicesRun-time

Define, read, and store policies

Policy Services UI

Stores policy evaluation result as a report

Collects, stores, and reads data for policy evaluation

Requests policy evaluation with Policy Services

Smart Reorg Utility

Searches and reads reports to track exceptions

Report UI

Diagnosis ReportsDB Sensor DataReorg PoliciesInformation / Data

OutputOutputSensor DataSensor DataInputInputITKB RepositoryITKB Repository

39

IBM Software Group


Policy Services overview

� Policy Services provides an ISPF user interface for defining and managing policies for IMS databases

•Only full-function databases are supported in the first release

� Smart Reorg utility uses Policy Services

–to evaluate the threshold sets specified in the policy definition for a state observed for a given database, and

–to take action or actions that are specified in the policy definition

Smart Reorg jobof

Reorg Expert

Policy ServicesISPF User Interface

Read Sensor Data

Store Sensor Data

Use Policy

Setup policiesand

store them in an ITKB repository

Ask Policy Evaluation

40

IBM Software Group


Major components of a policy definition

1. One or more conditionexpressions (rules)

– used to evaluate sensor data

2. A resulting exception when a condition threshold has been reached or exceeded

3. List of actions– An action is selected for each

exception (instance) detected by evaluation of sensor data against a rule condition in the policy

Policy

Rule Set

Rule Rule

Rule Rule

Rule Rule

Action ListAction

Action

Action

Condition Exception

Rule

41

IBM Software Group


Components of a rule

� Rule condition– Conditional expression (formula )

• The formula that compares stored data element values with the limits specified for this data (threshold values)

– Threshold sets• A threshold set is a set of threshold

values that specify the limits for the specific database states being governed by this rule

� Threshold exception– Exception class

– Exception (severity) level

– Exception message text

Policy

Rule Set

Rule Rule

Rule Rule

Rule Rule

Action List

Action

Action

Action

Condition Exception

Rule

Class

Level

Exception

Message Text

Expression

Threshold set

Condition

Threshold set

Threshold set

42

IBM Software Group


Data elements and rule condition description

DB_AVG_DBREC_LENGTHThe average length of database records.

DB_NUM_VLSEG_SPLITThe number of split segment occurrences in the data set.

DB_PCT_NUM_VLSEG_SPLITThe percentage of the split variable-segment occurrences compared to the total number of variable-segment occurrences in the data set.

DB_PCT_OF_MAX_DS_SIZEThe percentage of allocated bytes (bytes for High Allocated RBA) compared to the maximum size (4 GB or 8 GB).

DB_PCT_BYTES_FREE_SPACEThe percentage of bytes of total free spaces to the total used bytes for the data set.

Examples of data elements

A named set of threshold values for the threshold variables that are referred to in the evaluation formula description above is called a threshold set

A Sample Rule

43

IBM Software Group


Attributes of an exception

� Exception class– Represents the specific database

event category being monitored� Exception severity level

– Is a category representing the severity of the detected exception

– There are fixed three levels:• WARNING• SEVERE• CRITICAL

� Exception message– Is the text that can be used by the

resulting policy action to describe the database event that crossed a rule threshold set

– Users can modify the message text

Class

Level

Exception

Message Text

� WARNING

� SEVERE

� CRITICAL

� WARNING

� SEVERE

� CRITICAL

Exception Class:

FRAGMENTED_FREE_SPACES

Name of the rule that detects the this exception:


Exception Class:

FRAGMENTED_FREE_SPACES

Name of the rule that detects the this exception:


An Example of Exception Class

“The fragmentation of free space in %RESOURCE%has increased”


“The fragmentation of free space in %RESOURCE%has increased”


An Example of Exception Message

44

IBM Software Group


Action selection

� An action is the result of a rule condition being reached or exceeded during a policy evaluation

� A rule threshold set has been mapped to a severity level for the exception class associated with the rule

� In turn, the severity level is mapped to an action

Note: In IBM-provided REORG policies, severity-level-to-action mappings are fixed for each exception class and are not customizable

Policy

Rule Set

Rule Rule

Rule Rule

Rule Rule

Action List

Action

Action

Action

An Action List Entry

ExceptionClassand

Level

MESSAGEor

REORG

ThresholdSet


Action

MYHIGHMYHIGHMYHIGHMYHIGH

HIGHHIGHHIGHHIGH

MEDMEDMEDMED

LOWLOWLOWLOW

MYLOWMYLOWMYLOWMYLOW

CRITICALCRITICALCRITICALCRITICAL

SEVERESEVERESEVERESEVERE

WARNINGWARNINGWARNINGWARNING

REORGREORGREORGREORG

MESSAGEMESSAGEMESSAGEMESSAGE

An Example of threshold/exception/action mappings

Note: Threshold values in each threshold set, system-provided or user-defined, can be customizable.

45

IBM Software Group


A sample IBM-provided policy

Part of threshold/exception/action mappings

The “locale” means where this policy is defined. BSNGLOBL means that it is defined globally independent of a specific RECON environment.

This column indicates the locale of a rule that is referred to in the policy.G: GlobalR: RECON environment to which the policy belongs

46

IBM Software Group


Selecting a set of rules for a policy

� You can unselect pre-selected rules and select new rules to customize your version of this policy

The “O” status indicates the rules that were part of the original policy template.

Rule locale

Action command “V” opens the panel on the next page

V

47

IBM Software Group


View/Update Rule

IBM-provided threshold sets

Exception message

List of database types to which this rule can be applied

Shows the content of the selected threshold set

Update threshold values specified in the selected threshold set

Add your own threshold set

View the rule condition formula (description) for this rule

48

IBM Software Group


Update a threshold set

Some attributes of data elements that are used as threshold variables (&1, &2, …) are displayed

Data type

Valid range of the threshold value

Short description of the data element (threshold variable)

49

IBM Software Group


Checking rule condition formula

The threshold set “LOW” is selected this time

Threshold values specified for this threshold set

Description of rule condition

50

IBM Software Group


Associating actions with rule threshold sets

� For each rule in the list on this panel, you can– select/unselect threshold sets you want to use for this policy, and

– associate actions with those selected threshold sets

Action command “S” opens the panel on the next page

S

51

IBM Software Group


Associating actions with rule threshold sets (cont.)

� This panel shows the mapping that follows:

ThresholdSet


Action

HIGH

MED

LOW

CRITICAL

SEVERE

WARNING

REORG

MESSAGE

52

IBM Software Group


IBM-provided policies (policy templates) in V4R1

IBM basic policy for full-function databases

IBM basic policy for HD databases

IBM basic policy for SHISAM databases

IBM basic policy for HISAM databases

IBM basic policy for PHIDAM databases

IBM basic policy for PHDAM databases

IBM basic policy for HIDAM databases

IBM basic policy for HDAM databases

Description

The policy name must be specified explicitly in the Smart Reorg job

NoSYS.DBDTYPE.FFDBIBM.DBDTYPE.FFDB

The policy name must be specified explicitly in the Smart Reorg job

NoSYS.DBDTYPE.HDDBIBM.DBDTYPE.HDDB

YesSYS.DBDTYPE.HDAMIBM.DBDTYPE.HDAM

YesSYS.DBDTYPE.SHISAMIBM.DBDTYPE.SHISAM

YesSYS.DBDTYPE.HISAMIBM.DBDTYPE.HISAM

YesSYS.DBDTYPE.PHIDAMIBM.DBDTYPE.PHIDAM

YesSYS.DBDTYPE.PHDAMIBM.DBDTYPE.PHDAM

YesSYS.DBDTYPE.HIDAMIBM.DBDTYPE.HIDAM

Smart ReorgAutomated Policy Selection by DB type

RemarkPolicy Name for Run-Time UsePolicy Name in Installation Package

* Description of the content of each policy, including rules selected for the policy, can be found in the Policy Services User’s Guide.* Description of each IBM-provided rule can also be found in the User’s Guide.

53

IBM Software Group


IBM-provided rules (rule templates) in V4R1

HISAM/SHISAM Statistics

IMS Space Utilization Statistics

Data Set Space Usage Statistics

Vol./Extents Statistics

Randomizing Statistics

Database Record Statistics

Related category of sensor data used in rule condition formula

NOHIGH POSSIBILITYXXXXIBM.VL_SEGM_SPLIT.10EXCESSIVE_VL_SPLIT_SEGMENTS

NONOXXXXXXIBM.SEGM_COUNT.10EXCESSIVE_SEGMENT_OCCURRENCES

YESCAN BEXXXXIBM.SEGM_SPREAD.10EXCESSIVE_SEGMENT_SCATTERING

HIGH POSSIBILITY

HIGH POSSIBILITY

HIGH POSSIBILITY

HIGH POSSIBILITY

CAN BE

LESS POSSIBILITY

HIGH POSSIBILITY

CAN BE

CAN BE

NO

LESS POSSIBILITY

CAN BE

CAN BE

CAN BE

NO

NO

NO

NO

The exception may be removed or lowered by Unload/Reload?

NO

NO

NO

NO

NO

YES

NO

NO

YES

YES

NO

YES

NO

YES

NO

NO

YES

NO

DB tuning guideline is provided in Reorg Expert User’s Guide?

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

PHDAM

X

X

X

X

X

X

X

X

X

HIDAM

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

X

HDAM

X

X

X

X

X

X

X

X

X

HISAM

X

X

X

X

X

X

X

X

X

PHIDAM

X

X

X

X

X

X

X

X

SHISAM

IBM.HISAM_SEG_DEL.10EXCESSIVE_HISAM_DELETE_SEGM

IBM.CICA_SPLITS.10EXCESSIVE_CI_OR_CA_SPLITS

IBM.FRAGMENTATION.10FRAGMENTED_FREE_SPACES

IBM.SLACK_BYTES.10EXCESSIVE_SLACK_BYTES

IBM.FREE_SPACES.10FREE_SPACE_AVAILABILITY

IBM.DBDS_GROWTH.30GROWING_DBDS_WITH_DATA_FULL

IBM.DBDS_GROWTH.20GROWING_DBDS_WITH_FREE_SPACES

IBM.DBDS_GROWTH.10DATA_SET_SIZE_GROWTH

IBM.DBDS_EXTENTS.10DATA_SET_EXTENTS_AVAILABILITY

IBM.RANDOMIZING.10IMBALANCED_RANDOMIZING

IBM.RAA_DENSITY.10DATA_VOLUME_IN_HDAM_RAA

IBM.ROOT_OVERFLOW.10EXCESSIVE_HDAM_ROOTS_OVERFLOW

IBM.HDAM_OVERFLOW.10EXCESSIVE_HDAM_OVERFLOW

IBM.ROOTS_NOTHOME.10EXCESSIVE_HDAM_ROOTS_NOT_HOME

IBM.RAP_SYNONYMS.10EXCESSIVE_RAP_SYNONYMS

IBM.UNUSED_RAPS.10EXCESSIVE_UNUSED_RAPS

IBM.AVG_DBREC_LEN.10AVERAGE_DB_RECORD_LENGTH

IBM.NUM_DBRECORDS.10NUMBER_OF_DB_RECORDS

Name of rule template that defines the condition check formula that detects the exception

Exception class (or name of exception)

Note 1: are used in IBM-provided policies Note 2: , if in CRITICAL level, triggers REORG in IBM policiesEach exception in this colorRules/exceptions in this color

54

IBM Software Group


What is your current philosophy?

� Regular scheduled reorganizations?

– Based on heavy analysis many years ago

� No reorgs – or rarely run reorgs

– Need justification for outage

� Run Pointer Checker

– Analyze reports or use reorg exception report

– Schedule required reorgs

55

IBM Software Group


Where are we going from here?

56

IBM Software Group


Feedback from the recent IMS Tools CAC

� “Would rather have automation take care of monitoring the databases.”

� The amount of work continues to grow but not the number of skilled DBAs. Automation will help.“

� “Having the repository will replace tedious tasks for generating many reports and maintaining in-house written procedures.”

� "reduce the amount of time spent on monitoring database environment."

� “Front end improvements would attract younger technicians and benefit all. The ability to have both GUI and mainframe normal access would be good.”

� “Must be able to access information quickly and easily in an easy-to-read format.

� “Simplify user interface, especially the initial setup/configuration, share this info between tools so each tool does not require its own unique setup.”

57

IBM Software Group


For more information on IMS Tools products

� Visit following web pages:– IMS Database Reorganization Expert for z/OS

ibm.com /software/data/db2imstools/imstools/ims-reorganization-expert/

– IMS Database Solution Pack for z/OSibm.com /software/data/db2imstools/imstools/ims-database-solution-pack/

– IMS Tools Base for z/OS (IMS Tools KB, Policy Servi ces, etc.)ibm.com /software/data/db2imstools/imstools/ims-base-solution-pack/

� Visit also:– IBM IMS Tools Portal

ibm.com /software/data/db2imstools/products/ims-tools.html

58

IBM Software Group


IBM Contacts for IMS Tools:

IMS Tools Development Team:

� Janet LeBlanc – IMS Tools Strategist– [email protected]

� Pat Smith – IMS Tools Business Executive– [email protected]

Client Technical Specialists for IMS Tools

� Raquel Carvallo– [email protected]

� Dennis Eichelberger– [email protected]

� Rick Engel – [email protected]

� Emmanuel (Willie) Llarena– [email protected]

59

IBM Software Group


Any Question?

Technology

IMS Tools - Smarter Reorgs