63
© 2010 IBM Corporation On the road to a Smarter IMS Janet LeBlanc Silicon Valley Lab [email protected] Janet LeBlanc IMS Tools Strategist [email protected]

IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

  • Upload
    ibm-ims

  • View
    344

  • Download
    7

Embed Size (px)

Citation preview

Page 1: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

© 2010 IBM Corporation

On the road to a Smarter IMS

Janet LeBlancSilicon Valley [email protected]

Janet LeBlancIMS Tools [email protected]

Page 2: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

2 © 2013 IBM Corporation

IMS Tools Solution Packs

IMS Database Solution Pack

� Autonomics

� IBM Administration Console

� Online Reorg Facility

� DB Reorg Expert

� HP Unload

� HP Load

� HP Prefix Resolution

� Index Builder

� HP Image Copy

� HP Pointer Checker

� IMS DB Repair Facility

� Library Integrity Utilities

� HALDB Toolkit

IMS Fast Path Solution Pack

� Autonomics

� IMS Administration Console

� HP FP Utilities

� FP Advanced Utilities

� FP Online Utilities

� IMS DB Repair Facility

� IMS HP Image Copy

� IMS Library Integrity Utilities

IMS Recovery Solution Pack

� IMS Administration Console

� DB Recovery Facility

� HP Change Accumulation

� HP Image Copy

� DRF Extended Functions

IMS Performance Solution Pack

� IMS Administration Console

� IMS Connect Extensions

� IMS Performance Analyzer

� IMS Problem Investigator

IMS Database Solution Pack

� Autonomics

� IBM Administration Console

� Online Reorg Facility

� DB Reorg Expert

� HP Unload

� HP Load

� HP Prefix Resolution

� Index Builder

� HP Image Copy

� HP Pointer Checker

� IMS DB Repair Facility

� Library Integrity Utilities

� HALDB Toolkit

IMS Fast Path Solution Pack

� Autonomics

� IMS Administration Console

� HP FP Utilities

� FP Advanced Utilities

� FP Online Utilities

� IMS DB Repair Facility

� IMS HP Image Copy

� IMS Library Integrity Utilities

IMS Recovery Solution Pack

� IMS Administration Console

� DB Recovery Facility

� HP Change Accumulation

� HP Image Copy

� DRF Extended Functions

IMS Performance Solution Pack

� IMS Administration Console

� IMS Connect Extensions

� IMS Performance Analyzer

� IMS Problem Investigator

Page 3: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

3 © 2013 IBM Corporation

Our Vision – Putting information to work for you

Rich, web-based user interface

Recommending and taking corrective actions

Gather database statistics at regular intervals

User-defined policies and thresholds

Policies Sensors

ModernizationAutomation

Page 4: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

4 © 2013 IBM Corporation

Database space monitoringIts common purpose is to prevent these situations

• Free space shortage

o Caused by running-out of data set extents or free space on volumes and resulting in service outage

• Inefficient use of database space

o Caused by free space fragmentation, which can eventually result in free space shortage

• Performance degradation

o Caused by free space fragmentation, long synonym chains, a large percentage of overflow segments, etc. and sometimes can result in “batch job overrun”

Page 5: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

5 © 2013 IBM Corporation

Database space monitoringWhat activities are needed?

• Collect space statistics data

o % of max data set size, …

• Analyze the data

o Is a threshold reached? …

• Notice exceptional states

o Fragmentation, space shortage, …

• Decide actions

o Free-space reorg, DBD/randomizer change, (re-)partitioning…

• Prepare for action(s)

o Schedule a free space reorg, plan tuning for actions, …

• Take action(s)

o Do the structure change, (re-)partitioning, …

Collect

Analyze

Notice Decide

Act

Prepare

Page 6: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

6 © 2013 IBM Corporation

Challenges in the current IT environmentEspecially in IMS database space management

• Decrease in

o Skilled IMS DBAs

o Maintenance window time

• Increase in

o Number of databases

o Data volume

• Increasing business pressures

o “Do more with less.”

• Flat or less IT cost

• Less people

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Page 7: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

7 © 2013 IBM Corporation

We recommend simplification and automationfor the efficiency of the process

• Simplify each step

o Data collection

o Data analysis

o Exception notification

o Action determination

o Action preparation

o Action taking

• Automate repetitive tasks

o Starting from data collection through action decision

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Page 8: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

8 © 2013 IBM Corporation

IBM IMS Tools… can simplify and automate the process

• IMS Database Solution Pack database sensor feature can simplify the ‘Collect’ step

• Autonomics Director (IBM Tools Base) and Policy Services can simplify and automate the ‘Analyze’, ‘Notice’, and ‘Decide’ steps

• Administration Console (IBM Tools Base) can simplify access to space monitoring information needed for the ‘Prepare’ step

• IMS Database Solution Pack also provides reorganization tools that can make execution of space maintenance ‘Actions’ simpler and accelerate the performance

Collect

Analyze

Notice Decide

Act

Prepare

IMS Database Solution Pack

IBM Tools Base

+

Page 9: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

9 © 2013 IBM Corporation

You can do more with less people and time… by using the IBM IMS Tools Solution

• Space statistics can be collected as byproducts of your Pointer Checker and/or Image Copy jobs

• Data analysis, exception notification, and action recommendation can be made automatically based on exception detection/notification policies

• Space statistics, detected exceptions, and recommended actions can be accessed through a comprehensive graphical web interface

• Space maintenance actions can be simplified and accelerated

Collect

Analyze

Notice Decide

Act

Prepare

IMS Database Solution Pack

IBM Tools Base

+

Page 10: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

10 © 2013 IBM Corporation

Automating monitoring process

Page 11: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

11 © 2013 IBM Corporation

Autonomics Director and Policy ServicesInfrastructure for automation

• Autonomics Director server

o Periodically evaluates space statistics data collected by IMS DB Solution Pack utilities, and detect and notifies exceptions if any

• AD server configuration:

o Database monitor list

o Data evaluation schedule

o Data collection schedule

o Exception detection rules

o Exception notification targets and policies

Automation Infrastructure

IMS ToolsKnowledge Base

Server

Repositories

Policy ServicesPolicy Evaluation &

Exception Notification

AutonomicsDirector

Server

IMS DB Solution Packutilities can collect andstores space statistics

IMS DB Solution Packutilities can collect andstores space statistics

IMS DB Solution Packutilities can collect andstores space statistics

Page 12: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

12 © 2013 IBM Corporation

Data CollectionDatabase Sensor capability in utilities

• You can collect database space status as “sensor data”

• Sensor data can be collected during

o Pointer Checker run

o Image Copy run

• Sensor data are stored In ITKB Sensor Data Repository

• Stand-alone DB Sensor can collect sensor data of one or more online full-function databases and OLR-cursor-inactive HALDB partitions

IMS Database Solution PackHigh Performance Pointer Checker

High Performance Image CopyStand-alone Database Sensor

Collect

Analyze

Notice Decide

Act

Prepare

IBM Tools BaseIMS Tools Knowledge Base (ITKB)Policy Services Sensor Data Store

Page 13: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

13 © 2013 IBM Corporation

Data AnalysisYou don’t need to look at / parse a large number of reports

• AD invokes “policy evaluation”

o New sensor data are notified to Autonomics Director

o Then, AD invokes data analysis process based on the evaluation schedule and the policy pre-configured for each database that is registered in the Monitor List

• Policy evaluation

o A process of applying threshold-detection rules and exception-notification policy to the collected sensor data

• Each rule detects an exceptional state of a database or a partition

Collect

Analyze

Notice Decide

Act

Prepare

IBM Tools BaseAutonomics Director (AD)

Policy Services Policy EvaluationIMS Tools Knowledge Base (ITKB)

o Policy can be selected or defined for each database type, for an individual database, or for a group of databases.

Page 14: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

14 © 2013 IBM Corporation

Exception NotificationYou’ll be notified of exceptions

• Action Recommendation

o A policy associates exceptions with an action recommendation (e.g., REORG)

• Notification List

o A policy can have a list of destinations of exception notification

• Exception Notification

o The action recommendation is sent to the destinations listed in the Notification List in the form of WTO, an e-mail, a short message, or a TSO message

Collect

Analyze

Notice Decide

Act

Prepare

IBM Tools BaseAutonomics Director (AD)

Policy Services Exception NotificationIMS Tools Knowledge Base (ITKB)

o An exception consists of:

•An exception name

•A severity

•A short message

Page 15: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

15 © 2013 IBM Corporation

Simplifying accessto monitoring information

Page 16: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

16 © 2013 IBM Corporation

Action DeterminationTypical questions that need to be answered

• Which databases need attention now?

• Why they need attention?

• What actions are recommended?

• How those databases have gotten to the current state?

• How are free spaces and DASD volumes used?

o What did HP Pointer Checker report?

• What the average database record length and is the current block/CI size optimal for it?

o What did HP Unload report?

Collect

Analyze

Notice Decide

Act

Prepare

• Summary of latest status

• Trend of space status changes

• Database utilities reportsfor “drill-down” research

Information needed

Page 17: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

17 © 2013 IBM Corporation

Administration ConsoleProvides a holistic view of data and information

IBM OneUI Theme History ofutility reports

Detected exceptions and action recommendation

Search and group

databases

Online help for space

monitoring

Charts of various space statistics data

items

• Admin. Console also provides a table of the number of exceptions and highest severities for each user-defined group of databases and partitions.

• A typical use case scenario and various screen shots are available on Information Center.

Page 18: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

18 © 2013 IBM Corporation

DBD Visualization – “DBD Map Viewer”New in IMS Database Solution Pack, Version 2.1

• An Admin. Console add-on

o Can be installed by using IBM Installation Manager

• It provides six views for a DBD:

o DBD map

o DBD source

o DBD XML

o Segment properties

o Data sets

o Outline

Page 19: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

19 © 2013 IBM Corporation

DBD Visualization – “DBD Map Viewer”

DBD Map View

DBD Source View

DBD XML View

Segment Properties View

Data Sets View

Outline View

Page 20: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

20 © 2013 IBM Corporation

Simplifying space management tasks

Page 21: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

21 © 2013 IBM Corporation

Space management actionsThree main action types

• Free space reorganization

o Offline reorganization

o Online reorganization

• Definition change reorganization

o Space allocation change

o DBD/randomizer change

o Partitioning/re-partitioning

• Tuning for definition changes

o Planned to prepare for an immediate or futuredefinition/structure change

Collect

Analyze

Notice Decide

Act

Prepare

Collect

Analyze

Notice Decide

Act

Prepare

Page 22: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

22 © 2013 IBM Corporation

Offline free space reorganization solutionHigh Performance reorganization utilities

• IMS Database Solution Pack provides following utilities

o IMS High Performance Unload

o IMS High Performance Load

o IMS Index Builder

o IMS High Performance Prefix Resolution

o Smart Reorg utility

• An integrated reorganization utility that runs utility functions above and post-reorganization Image Copy and Pointer Checker in a single job step

//REORG EXEC PGM=HPSGMAIN,PARM='DBD=dbdname,DBRC=Y'

//STEPLIB DD DISP=SHR,DSN=IMSTOOLS.LOADLIB

// DD DISP=SHR,DSN=IMS.SDFSRESL

//IMS DD DISP=SHR,DSN=IMS.DBDLIB

//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB

//HPSIN DD *

(REORG)

DBSHARE=YES

IMSCMD=YES,TOSI

TOSIXCFGRP=REORG

SPACEALLOC=YES

INDEXBLD=YES

IC=YES

NAMESWAP=YES

DISPOLDDS=NEWSHADOW

STARTDB=YES

(UNLOAD)

...

(RELOAD)

...

(INDEXBLD)

...

/*

//ICEIN DD *

GLOBAL VIC=Y,

VICDSN=&DDN..UC1,

ICHLQ=TESTDS,

DSN=&ICHLQ..&DDN..IC1,

UNIT=SYSALLDA,

SPACE=(CYL,10,10)

/*

An example JCL statements for Smart Reorg (for a database that has no logical relationship)

Page 23: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

23 © 2013 IBM Corporation

Online free space reorganization solutionIMS Online Reorganization Facility (ORF) for z/OS

• IMS Database Solution Pack ORF provides online reorg. solution for full-function databases and HALDBs

Time

UPDATE UPDATEDatabase Status

UPDATE UPDATE

Read-Only or Offline

UPDATEDatabase Status

DB Update Capture Log Database Update Capture

COPY UNLOAD APPLYTKO

RELOADIMAGECOPY

UPDATE

Unload, Reload, Index Build,

Image Copy, Pointer Check

in a single job stepNSProcessing Phase

Processing Phase

Legend (for both ORF and Smart Reorg)

DB Data Set

before Reorg

Shadow

Data Set

Reorganized

DB Data Set

Post-Reorg

Image Copy

Update and

re-register

logs

Smart ReorgSmart Reorg

ORFORF

Name Swap (NS)

Page 24: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

24 © 2013 IBM Corporation

Tuning by partitioning/re-partitioningIMS HALDB Toolkit helps you

• The Toolkit provides HALDB maintenance, modeling, and analysis functions, including

o Splitting a partition

o Consolidating partitions

o Adding an empty partition to the end of a database

o Merging HALDBs

• The Toolkit can help reduce the time and minimize the skills that are required to perform HALDB maintenance tasks

PART31PART21 PART41PART11

DBDS4DBDS3DBDS2DBDS1

001-099 100-199 200-299 300-399

001-099 100-199 200-299 300-X’FFFFFF’

PART3PART2 PART4PART1

001-099 100-199 200-299 300-X’FFFFFF’

Key Ranges:

RECONPartition

Defiinition

DBD1 DBD2 DBD3 DBD4

DBDH1 DBDH2 DBDH3 DBDH4

DBDHRECONPartition

Definition

Key Ranges:

Key Ranges:

PART3PART2 PART4PART1

001-099 100-199 200-259 300-X’FFFFF’

DBDHRECONPartition

Definition

Key Ranges:

Convert user-partitioned full-function databases to single-partition HALDBs.

Merge a set of single-partition HALDBs to a single HALDB with multiple partitions.

Maintain partitions(partition split, etc.)

PART31

260-299

Page 25: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

25 © 2013 IBM Corporation

� New in Autonomics: – Active Autonomics

– New User GROUP management– Group Reorganization Management

Rich, web-based user interface

Recommending and taking corrective actions

Gather database statistics at regular intervals

User-defined policies and thresholds

Policies Sensors

ModernizationAutomation

Collect

Analyze

Notice Decide

Act

Prepare

Page 26: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

26 © 2013 IBM Corporation

Active Autonomics

Plan restart capability

Determines what ran successfullyOnly reruns/runs what failed or is yet to

run

User NotificationsEmail, Text Job plan and results viewable via AD

Tracks jobstream thru completion

Submission of Reorganization JobstreamsManages job distribution across sysplex Controls for parallelism

DB Maintenance WindowsUser controlled DB maintenance windows

Automatic ReorganizationDetermined by Sensor and Policy Evaluation Supported by IMS DB Reorg Expert

Page 27: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

27 © 2013 IBM Corporation

User Defined Groups

� Easy to create– Select from any DBs/partitions/areas in system DBDLIBs– Select from any DBRC or other user group– Name masking support: PAY*

� Contains– List of DB’s in group– Consolidated group attributes and options for various tools and

functions– Reorganization, Back-up and Recovery, etc.

� Automatic membership checking/warning for logical relationships

� Useful for – Adding DBs to the monitor list– Viewing recommendation list– Scheduling on demand

� Basis for Group Managed Reorganization

Page 28: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

28 © 2013 IBM Corporation

Group Managed Reorganization

Pre-GMR

• /DBR and DBRC authorization changes

•Allocate common/work files

•Pre-reorganization utility

Reorganization

•Runs IMS Reorg Expert for DBs that need reorg

•Optional DB scan for logically related DBs that don’t need reorg

•Consistent feed for prefix resolution/prefix update

•One job per DB/partition/area

•DBs reorganized in parallel or serially or combination

Post-Reorg

• Invoked after reorg phase

•One or more jobs run serially or parallel as identified by user

•Prefix Resolution, Prefix Update

Post GMR

• Invoked after post-reorg phase

•One or more jobs run serially or parallel as identified by user

•Dataset cleanup, Image Copies

Page 29: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

29 © 2013 IBM Corporation

IMS Database Solution Pack for z/OS, 2.1

IMS Database Solution Pack combines the following tools intoa single offering:

• IMS Database Reorganization Expert for z/OS

• IMS Online Reorganization Facility for z/OS*

• IMS High Availability Large Database (HALDB) Toolkit for z/OS*

• IMS High Performance Unload for z/OS

• IMS High Performance Load for z/OS

• IMS High Performance Prefix Resolution for z/OS

• IMS Index Builder for z/OS

• IMS High Performance Image Copy for z/OS

• IMS High Performance Pointer Checker for z/OS

• IMS Library Integrity Utilities for z/OS**

• Database Repair Facility

• Database Sensor * Added in Version 2.1

** Provides DBD Map Viewer server capability

Page 30: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

30 © 2013 IBM Corporation

• DEDB space management activity is composed of the following tasks:

o Monitoring space utilization

o Tuning areas and randomizer

o Reorganizing free space or restructuring areas

DEDB space management

Page 31: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

31 © 2013 IBM Corporation

Background and challenge of space monitoring

• DEDB space utilization must be monitoring on a regular basis for the following reasons:

o To avoid application failures that might be caused by out-of-space conditions

o To determine whether reorganization is required

o To determine the optimal timing for database expansion

• To maintain hundreds and thousands of DEDB areas, DBA needs deep IMS skill and experiences for database space analysis , and it takes a lot of time to check a large number of reports that IMS tools generates

Page 32: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

32 © 2013 IBM Corporation

Space monitoring solution

• DEDB area analysis and pointer validation

o Collect raw space statistics (called sensor data)

o Report detailed space usage statistics

o Ensure that your database pointers are error free

o Help you detect and correct database errors quickly

o Provide both online and offline utilities

• IMS Tools Knowledge Base

o The reports that are generated by the FPA functions, FPO tools, and IMS HPIC can be stored in a repository

o You can search historical copies of those reports by database name, date and time, or other search criteria

o Threshold criteria for detecting database exceptions and recommendations can also be defined and stored in a repository

• Autonomics Director and Administration Console

o Simplify DEDB space monitoring tasks

Page 33: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

33 © 2013 IBM Corporation

Activating DB Sensor function in FPSP Utilities

• DB Sensor function is supported in following utilitieso FP Advance Tool (ANALYZE, UNLOAD, RELOAD, CHANGE, and REORG)

o FP Online Tool (ANALYZE (Online PC), REORG (Online Expert Reorg))

o HP Image Copy

• DB Sensor is activated just by adding three control statement optionso SENSOR=YES (required)

o ITKBSRVR=your_itkb_xcf_group_name (required)

o ADXCFGRP=autonomic_director_xcf_group_name (optional)

//FPA EXEC PGM=HFPMAIN0

//STEPLIB DD DISP=SHR,DSN=HPFP.SHFPLMD0

// DD DISP=SHR,DSN=ITB.SHKTLOAD

// DD DISP=SHR,DSN=IMSVS.SDFSRESL

// DD DISP=SHR,DSN=IMSVS.PGMLIB

//IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB

//IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB

//HFPSRPT DD SYSOUT=*

//HFPSYSIN DD *

GLOBAL

DBRC=YES,

ITKBSRVR=FPQSRV01,

ADXCFGRP=IAVADM00

ANALYZE

DBD=DEDBJN22,IAREA=(DB22AR0,DB22AR1),

PTRCHKLVL=FULL,SDEPCHKLVL=FULL,

SENSOR=YES

REPORT

/*

For details and more JCL samples, see “DEDB monitoring and

tuning guide” in the User’s Guide.

//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//STEPLIB DD DISP=SHR,DSN=HPFP.SHFPLMD0

// DD DISP=SHR,DSN=ITB.SHKTLOAD

// DD DISP=SHR,DSN=IMSVS.SDFSRESL

// DD DISP=SHR,DSN=IMSVS.PGMLIB

//FPXIN DD *//FPXIN DD *//FPXIN DD *//FPXIN DD *GLOBAL

DBRC=YES,

ITKBSRVR=FPQSRV01,

ADXCFGRP=IAVADM00

ANALYZE AREA=(DB22AR0,DB22AR1),

FULLSTEP=YES,

TYPRUN=RPT,

SENSOR=YES

/*/*/*/*

A JCL Example for FPA ANALYZEA JCL Example for FPA ANALYZE A JCL Example for OPCA JCL Example for OPC

Page 34: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

34 © 2013 IBM Corporation

Online free space monitoring acceleration

• Support light-weight monitoring besides full monitoring

o OPC with TYPRUN=FS now can store both the sensor data and reports on free space statistics in a single job step

• Elapsed time of OPC with FULLSTEP=YES is significantly reduced by

o Processing multiple areas concurrently

o Eliminating I/Os for intermediate data sets

IMS

OPC

Free spacereport

area

A subsetof sensor

data

Light-weight monitoring of free spaces (new)

Full monitoring of space utilization

• TYPRUN=FS• SENSOR=YES• FULLSTEP=YES

IMS

OPC

Full analysisreport

area

Full setof sensor

data

• TYPRUN=RPT• SENSOR=YES• FULLSTEP=YES

No SORT

SORTsSORTsSORTs

* Note: Consumption of IMS online DB buffer resource is same as that for TYPRUN=RPT.

Page 35: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

35 © 2013 IBM Corporation

Stand-alone DB Sensor

• Process one DEDB in a job step

• Be used to collect and store sensor data for multiple areas

• Process both offline and online areas

• Report sensor data values in a report

• Does NOT produce Area Analysis Reports

// DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD

//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD //IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPSYSIN DD *//HFPSYSIN DD *//HFPSYSIN DD *//HFPSYSIN DD *

GLOBAL DBRC=YES, GLOBAL DBRC=YES, GLOBAL DBRC=YES, GLOBAL DBRC=YES, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01

DATABASE DATABASE DATABASE DATABASE DBD=DEDBJN23, DBD=DEDBJN23, DBD=DEDBJN23, DBD=DEDBJN23, IAREA=*ALL IAREA=*ALL IAREA=*ALL IAREA=*ALL

/*/*/*/*

A JCL Example for Stand-alone DB SensorA JCL Example for Stand-alone DB Sensor

• FPA, FPO, and HPIC with SENSOR=YES can also produce this report.

IMS HPFP UTILITIES IMS HPFP UTILITIES IMS HPFP UTILITIES IMS HPFP UTILITIES ---- DB SENSORDB SENSORDB SENSORDB SENSOR5655565556555655----WWWW11114444 VVVV1111RRRR3333

DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

========================================================================================================================================================================================AREA DEFINITIONAREA DEFINITIONAREA DEFINITIONAREA DEFINITION

========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478

========================================================================================================================================================================================FREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICS

========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%

========================================================================================================================================================================================OVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICS

========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%............

Sensor Data Statistics ReportSensor Data Statistics Report

Page 36: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

36 © 2013 IBM Corporation

Automated exception detection for sensor data

• Autonomics Director provides:

o Automatic and on-demand analysis of the state of your databases against user-defined threshold criteria

o Generation of user-recommended actions for subject databases and database groups

• Exception detection rules are almost same as those supported by thresholds for DEDB Pointer Checker and FPA ANALYZE function and OPC

o Free space availability

o Overflow status

o Randomizing Synonyms

o DB Record Length (Avg. & Max)

o Physical I/O

Page 37: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

37 © 2013 IBM Corporation

Administration Console work flow for DEDB area space monitoring

Check the itemized diagnosis result for the resource.

Look at FP Solution Pack utility reports to see detailed analysis of the space usage of the subject area.

Read the help for each of the detected exceptions.

Check the summary of latest DEDB area space diagnosis done by Autonomics Director.

11

22

33

44

Summary Table for a DEDB

Exceptions Widget

Help Widget

Reports Widget

Main dashboardfor a DEDB areaMain dashboardfor a DEDB area

Sensor WidgetLook at the trend of specific sensor data values

55

Page 38: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

38 © 2013 IBM Corporation

Background of database tuning

• When an exceptional state of an area is detected by space monitoring

o Tuning these areas to obtain the optimal database definition parameters, then reorganize or restructure them based on the tuning results, might resolve the exception

• Tuning a database often involves significant and time-consuming database administration tasks

o DBDLIB and ACBLIB need to be generated for each iterative if DBD structure change is required

o Unloading and reloading the area to determine if the changes are effective is time-consuming

Page 39: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

39 © 2013 IBM Corporation

Database tuning solution

• Adjust the DBD parameters or/and the randomizing routine to suit the current characteristics of the database records in the area

• Goal of tuning is to achieve the following results:

o Shorter synonym chains with fewer unused RAPso Higher percentage of segments in RAA BASEo Fewer physical I/Os to access a root segment and a complete

database record

• The following database specifications can be changed and evaluated:

o Randomizing moduleo UOW parameter valueso ROOT parameter valueso Number of database areaso CI sizes

Page 40: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

40 © 2013 IBM Corporation

FPA TUNE function

• Simulate changes of the DBD parameters and the randomizing routine without loading the segments to allow user to select the physical database attributes that satisfy the performance and space utilization requirements

o Provide JCL ease of use

o Allow user to specify new DBD parameters and new randomizing routine with keywords, instead of new ACBLIB

o Tune multiple areas in parallel

o Provide a set of complete reports to verify effects of changes

Page 41: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

41 © 2013 IBM Corporation

Database tuning simplification

FPSP V1.2 FPSP V1.3

DBAs generate DBDLIB for the new DBD definition if DBD structure change is required.

Not necessary

DBAs generate ACBLIB for the new DBD definition if DBD structure change is required.

Not necessary

DBAs run FPB DEDB Tuning Aid (DEDBTA) using the above new ACBLIB and/or the new randomizer and threshold in 6 job steps.

DBAs run FPA Tune function with no AREA scan mode specifying the candidate of the new DBD definition and threshold to the keywords and/or the new randomizer in 1 job step.

DBAs need to compare some reports of before/after the tuning to confirm the effectiveness of the tuning.

DBAs can confirm the effectiveness of the tuning based on the threshold values in the area tuning summary report.

• Database tuning function facilitates multiple iterations of the database tuning process, thereby allowing you to select physical database attributes that meet your requirements

o Even if the tuning attribute is determined once (without iteration), the steps are reduced significantly

o It is unnecessary to build DBDLIB and ACBLIB for each iteration

o Complete reports are provided to verify effects of changes

Page 42: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

42 © 2013 IBM Corporation

Command set of FPA TUNE function

• TUNE command

o Specify general information for tuning, such as DBD name, area name, dataset mask, and so on

• SIMULATE subcommand

o Provide resources for tuning, such as new randomizing routine name, and so on

• AREADEF subcommand

o Define the new area parameters for tuning, such as CISIZE, UOW, ROOT, and so on

//HFP//HFP//HFP//HFPTUNETUNETUNETUNE EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0

//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=HPFHPFHPFHPF.SHFPLMD0.SHFPLMD0.SHFPLMD0.SHFPLMD0

// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL

//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB

//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=HFPHFPHFPHFP.DB30AR0.ADS1 .DB30AR0.ADS1 .DB30AR0.ADS1 .DB30AR0.ADS1

//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*

//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*

//HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD *

GLOBAL GLOBAL GLOBAL GLOBAL

SCAN=NO, SCAN=NO, SCAN=NO, SCAN=NO,

DBRC=NO DBRC=NO DBRC=NO DBRC=NO

TUNETUNETUNETUNE

DBD=DEDBJN30, DBD=DEDBJN30, DBD=DEDBJN30, DBD=DEDBJN30,

IAREA=DB30AR0IAREA=DB30AR0IAREA=DB30AR0IAREA=DB30AR0,,,,

AREASCAN=YESAREASCAN=YESAREASCAN=YESAREASCAN=YES

SIMULATE SIMULATE SIMULATE SIMULATE

OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0

AREADEF AREADEF AREADEF AREADEF

OAREA=DB30AR0, OAREA=DB30AR0, OAREA=DB30AR0, OAREA=DB30AR0,

UOW=(28,8) UOW=(28,8) UOW=(28,8) UOW=(28,8)

THRESHOLD THRESHOLD THRESHOLD THRESHOLD

DOVFFS_PCT=30, DOVFFS_PCT=30, DOVFFS_PCT=30, DOVFFS_PCT=30,

IOVFFS_PCT=50 IOVFFS_PCT=50 IOVFFS_PCT=50 IOVFFS_PCT=50

/* /* /* /*

areaTAR file

FPA TUNE

iteration

area

FPA TUNE

FPA TUNE

iteration

AREASCAN=YES &No TAR files specified

AREASCAN=NO &TAR files specified

AREASCAN=YES &TAR files specified

tuning reports

tuning reports

Sample JCL for mode 2

Mode 1: Create TAR files at first, then iterate tuning process

using the existing TAR files

Mode 2: Iterate tuning process using the intermediate TAR

files that are deleted at the end of each iteration

Page 43: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

43 © 2013 IBM Corporation

OPC/OER TAR files generation

• Generate the TAR files, which can be used as the input data for FPA TUNE function

o Enable DEDB areas to be tuned without taking the areas offline

o Specify TARECGEN=YES for

• ANALYZE statement of OPC

• or PTRCHK statement of OER

o Specify TAR file and AREASCAN=NO for

• TUNE command of FPA

//OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA

//STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0

// DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL

// DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB

//SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY

//SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=*

//FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=*

//FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=*

//DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY

//FPXIN DD * //FPXIN DD * //FPXIN DD * //FPXIN DD *

ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1

MFILE=FPXMFILE MFILE=FPXMFILE MFILE=FPXMFILE MFILE=FPXMFILE

RFILE=FPXRPTS RFILE=FPXRPTS RFILE=FPXRPTS RFILE=FPXRPTS

TYPRUN=RPT TYPRUN=RPT TYPRUN=RPT TYPRUN=RPT

FULLSTEP=YES FULLSTEP=YES FULLSTEP=YES FULLSTEP=YES

TARECGEN=YES TARECGEN=YES TARECGEN=YES TARECGEN=YES

TARDSNMASK=‘TARDSNMASK=‘TARDSNMASK=‘TARDSNMASK=‘HFPHFPHFPHFP.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'

/*/*/*/*

//HFP//HFP//HFP//HFPTUNETUNETUNETUNE EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0

//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS133330.SHFPLMD00.SHFPLMD00.SHFPLMD00.SHFPLMD0

// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL

//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB

////////TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=HFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TAR

//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*

//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*

//HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD *

GLOBAL DBRC=NO, GLOBAL DBRC=NO, GLOBAL DBRC=NO, GLOBAL DBRC=NO,

SCAN=NO SCAN=NO SCAN=NO SCAN=NO

TUNETUNETUNETUNE

IAREA=DBIAREA=DBIAREA=DBIAREA=DB23AR123AR123AR123AR1, , , ,

DBD=DEDBJNDBD=DEDBJNDBD=DEDBJNDBD=DEDBJN23,23,23,23,

AREASCAN=NOAREASCAN=NOAREASCAN=NOAREASCAN=NO

SIMULATE SIMULATE SIMULATE SIMULATE

OAREA=DBOAREA=DBOAREA=DBOAREA=DB23AR123AR123AR123AR1, , , ,

AREADEFAREADEFAREADEFAREADEF

OAREA=DBOAREA=DBOAREA=DBOAREA=DB23232323AR1, AR1, AR1, AR1,

CISIZE=4096 CISIZE=4096 CISIZE=4096 CISIZE=4096

/* /* /* /*

IMS

OPC

areaTAR file

FPA TUNE

iteration

AREASCAN=NO &TAR files specified

tuning reports

Page 44: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

44 © 2013 IBM Corporation

Area Tuning Summary Report

IMS HPFP UTILITIES - FPA TUNE "Area Tuning Summary Report" PAGE: 1

5655-W14 V1R3 2013-09-13 16:22:48

DBD NAME: DEDBJN30

SIMULATION MODE: RESTRUCTURE (AREADEF subcommands are specified)

CURRENT RESOURCES:

- ACBLIB DDNAME: IMSACB

- RANDMIZER : DBFHDC44

SIMULATED RESOURCES:

- ACBLIB DSNAME: IMS.ACBLIB

- RANDMIZER : DBFHDC44

Threshold Exceptions:

Exceptions from current areas

-------------------------------------------------------------------------------------------------------------------

The percentage of free space in DOVF fell below a threshold in area DB30AR0.

The percentage of free space in IOVF fell below a threshold in area DB30AR0.

-------------------------------------------------------------------------------------------------------------------

Exceptions from simulated areas

-------------------------------------------------------------------------------------------------------------------

*** No exception was detected ***

-------------------------------------------------------------------------------------------------------------------

Area Statistics:

*: Shows the point of threshold exception.

AREA NAME: DB30AR0

------------------------------------------------------------------------------------------------

Keyword Threshold Value Current Value Simulated Value Difference

------------------------ ---------------- ---------------- ---------------- ------------------

DOVFFS_PCT 30% 26%* 57% +31

IOVFFS_PCT 50% 47%* 98% +51

Database Definition and Database Record Distribution:

Upper row for each area shows the definition and number of database records of current areas

Lower row for each area shows the definition and number of database records of simulated areas

* shows the difference

TOTAL CI'S SDEP START

AREA AREA CI-SIZE UOW= ROOT= --------------------------------------- ------------------ NUMBER OF

NAME NO. BASE DOVF IOVF TOTAL BLOCK# RBA(HEX) DB RECORDS

-------- ----- ------- ------------- ------------- --------- --------- --------- --------- --------- -------- -----------

DB30AR0 1 2,048 (24,4) (6500,500) 120,000 24,000 11,900 155,900 - - 109,900

DB30AR0 1 2,048 (28,8)* (6500,500) 120,000 48,000 13,883 181,883 - - 109,900

-------- ----- ------- ------------- ------------- --------- --------- --------- --------- --------- -------- -----------

List the threshold exceptions that are detected in the current areas and the simulated areas

List the threshold value for each factor that is evaluated (supplied through the THRESHOLD subcommand keywords)

List the database definitions and the number of database recordsin the current areas and the simulated areas

Page 45: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

45 © 2013 IBM Corporation

Other reports generated by FPA TUNE function

• Provide two sets of the comprehensive analysis reports to evaluate the effects of tuning

o The reports beginning with TUNED in the title contain information that obtained from the simulated areas

o The reports without beginning with TUNED in the title information that obtained from the current areas

o The following reports are generated:

• (TUNED) DEDB Area Analysis report

• (TUNED) Process Summary of Analysis report

• (TUNED) Segment Length Distribution report

• (TUNED) UOW report

• (TUNED) UOW Exception report

• (TUNED) Largest Database Records report

• (TUNED) Consolidated Largest Database Records report

Page 46: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

46 © 2013 IBM Corporation

More information in area analysis report

• Solution

o Add new report header lines that indicate:

• Input data set name• Input data set type (and the timestamp for image copy)

o Add SDEP information in the following reports:

• SDEP LB/LE information in Freespace Analysis report• Number of occurrences in Segment Placement Analysis report

o Optionally add segment prefix length information in the DB Record Profile Analysis report

o Optionally add Segment Length Distribution report

• Customer benefit

o Sure identification of the source of statistics data

o Comprehensive reporting of SDEP space usage information

o Better estimation of space use by each segment type

o Quick identification of segment length

Page 47: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

47 © 2013 IBM Corporation

47

More information in area analysis report (cont.)

Sample 1: New report header lines

Input: A batch image copy data set

Input: Area data set

Input: A concurrent image copy data set

Page 48: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

48 © 2013 IBM Corporation

48

More information in area analysis report (cont.)

Sample 2: SDEP information

SDEP LB/LE information

Number of SDEP segment occurrences

Page 49: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

49 © 2013 IBM Corporation

49

More information in area analysis report (cont.)

Sample 3: Segment prefix length information

These information are reported when SEGLSTAT=DETAILED is specified.(The default is SEGLSTAT=COMPACT.)

Page 50: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

50 © 2013 IBM Corporation

50

More information in area analysis report (cont.)

Sample 4: Segment Length Distribution report

This report is generated when SEGLDIST=YES is specified.(The default is SEGLDIST=NO.)

Page 51: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

51 © 2013 IBM Corporation

Database-level Largest DB Records Report

• Consolidate and sort the statistics data for large database records and create a single report across entire database

o Provide a second parameter for the LARGEREC_COUNT keyword to allow user to specify the number of reporting entries

o Consolidated Largest Database Records Report

• Be helpful for quick identification of large database records in a database that has a large number of areas

Largest Database Records Report for each area

Merge and sort rawinformation internallywithin FPA/FPO

“Consolidated LargestDatabase Records Report”

area1

area2

area3

area4

area5 …

arean

Page 52: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

52 © 2013 IBM Corporation

52

Consolidated Largest Database Records report

IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: 1111

5655565556555655----W14 V1R2 2012W14 V1R2 2012W14 V1R2 2012W14 V1R2 2012----09090909----14 17:014 17:014 17:014 17:07:417:417:417:41

DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30

TOTAL AREA#: 19TOTAL AREA#: 19TOTAL AREA#: 19TOTAL AREA#: 19

AREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DBAREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DBAREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DBAREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DB230230230230014014014014

DB230015 DB230016 DB230017 DB230018 DB230019DB230015 DB230016 DB230017 DB230018 DB230019DB230015 DB230016 DB230017 DB230018 DB230019DB230015 DB230016 DB230017 DB230018 DB230019

RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)

-------------------------------------------- ---------------------------------------- -------------------------------- -------------------- -------------------------------- -------------------- -------------------------------- ------------------------------------------------------------------------------------------------------------------------------------ ****----------------------------------------------------------------****

4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 ****

4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 ****

4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 ****

4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 ****

4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 ****

4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 ****

3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 ****

3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 ****

3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 ****

3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 ****

3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 ****

3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 ****

3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 ****

3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 ****

3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 ****

. . . . . . . . .. . . . . . . . .. . . . . . . . .. . . . . . . . .

. . . . . . . . .. . . . . . . . .. . . . . . . . .. . . . . . . . .

. . . . . . . . .. . . . . . . . .. . . . . . . . .. . . . . . . . .

A Sample Report

Page 53: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

53 © 2013 IBM Corporation

Make space management simpler and easier

Page 54: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

54 © 2013 IBM Corporation

Background and challenge of space management

• When an exceptional state of an area is detected by space monitoring, reorganize free space or extend the size of areas based on the tuning results

o If the database record profile and the number of database records in the area are relatively unchanged, reorganizing free space might resolve the exception

o If the available free space fall below the thresholds, extending the size of the DEDB areas might resolve the exception

• In operating environments that cannot be stopped, unload/reload cannot be used to increase free space in areas, and ineffective reorganization causes unnecessary impact upon online performance

Page 55: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

55 © 2013 IBM Corporation

Space management solution

• DEDB area expansion

o Dynamically extend the IOVF portion and the SDEP portion of DEDB area without take it offline

o Support volume management in SMS environment

• DEDB area reorganization

o Extend the capability of High-Speed DEDB Direct Reorganization utility (DBFUHDR0)

o Evaluate UOWs in DEDB areas, rank the UOWs, and reorganize only highly ranked UOWs to reduce the volume of database update logs

o Collect statistics and generate area analysis reports of the reorganized area

o Take image copies of the reorganized area

Page 56: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

56 © 2013 IBM Corporation

Online area expansion

• Increase IOVF and/or SDEP parts size while allowing online access to the area that is being extended

o Use DEDB create utility (DBFUMRI0)

o Process a single area in one step

• Two expansion types

IMS

OAE

avail

IOVF

avail

IOVF

ADS1 ADS1111

copy back

Rename(TOSI)

Original expansion

IMS

OAE

unavail

avail

IOVF

ADS2

avail

unavail

Shadow expansion

IOVF

ADS1

IOVF

ADS1

IOVF

ADS2

IOVF

ADS2

Page 57: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

57 © 2013 IBM Corporation

Simpler parameter specification

• The extended size for SDEP portion can be specified with a specific number or by a percentage of CIs within the total number of CIs defined in the SDEP portion

o SDEP_CI=xx or xx%

• The extended size for IOVF portion can be specified with a specific number or by a percentage of UOWs within the total number of UOWs defined in the IOVF portion

o IOVF_UOW=xx or xx%

• These specifications allow OAE to be executed multiple times without JCL modification

Page 58: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

58 © 2013 IBM Corporation

Volume management support

• Provide a keyword VOLCNT to allow user to specify the maximum number of volumes for the extended area data set

o OAE uses volume where space is available

o The VOLCNT keyword is supported only for SMS environment

• Make OAE execution a success although some volumes are out of space

Page 59: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

59 © 2013 IBM Corporation

Online free space reorganization

• Save online system resource and eliminates unnecessary reorganizations by identifying only those databases that need to be reorganized based on user-defined criteria

DDEP

DDEP

DDEP

DDEP

ROOT

ROOT

ROOT

DDEP DDEPROOT

ROOTROOT

Base Base

DOVF

DDEPROOT

DDEPROOT

DDEP

DDEP

UOW IOVF

DDEP DDEP

IOVFUOW

IMS

OER

DOVF

Page 60: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

60 © 2013 IBM Corporation

Free space reorganization acceleration

• Minimize the impact on other critical applications accessing the area, and maximize the effect of reorganization

o Reorganize only the subset of the most fragmented UOWs

o Provide a keyword REORGLIM to allow user to specify an allowable maximum number of UOWs to be reorganized

• Internally invoke OPC after reorganization to produce reports to verify the effects of reorganization, to take image copy of the reorganized areas

Page 61: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

61 © 2013 IBM Corporation

Big picture of Fast Path Solution Pack and Tools Base

IMS ToolsKnowledge

BaseRepository

Server

Repository

Analyze & DB Sensor functions

Autonomics Director Server

Autonomics

Director

(+ Policy Services)

IBM Tools Base V1.4

IMS FP Solution Pack V1.3

z/OS Env.

• Policy-based DEDB Area Diagnosis

• Store sensor data

(and reports)• Notify sensor data

Distributed Access

Infrastructure

TSO

Administration

Console Open Env.

• Notify

exceptions

Reorganize functions

• Reorganize free space

Tune functions• Tune database

• Extend database

11

22

33

44

Extend function

Restructure functions55

• Change database attributes

• Analyze and collect sensor data

Page 62: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

62 © 2013 IBM Corporation

DEDB utility solutions

Solution Function FPA (offline) FPB (offline) FPO (online)

Reorganizing Unload UNLOAD DEDB Unload Online Data Extract (ODE)

Reload RELOAD DEDB Reload

Change CHANGE

Reorganize REORG Online Expert Reorganization (OER)

Extend Online Area Extender (OAE)

Build FP Secondary Index

INDEXBLD

Analyzing Integrity verification and analysis

ANALYZE-DEDB AREAs-Secondary Index DBs

DEDB Pointer Checker- DEDB AREAs

Online Pointer Checker (OPC)-DEDB AREAs

Print DMAC information

DMACPRT Online DMAC Print (ODM)

Extracting Extract segments EXTRACT Unload/Reload user exit routines

Online Data Extract (ODE)

Tuning Tuning Aid TUNE DEDB Tuning Aid

Other Initialize DEDB areas

INITIALIZE

Page 63: IBM IMS Tools Smarter IMS - IMS UG Phoenix 12-2013

63 © 2013 IBM Corporation

Summary

� IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs

� IBM is dedicated to the continued success and support of IMS and the mainframe. We’re invested for the long term, right beside you.

� We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers around autonomic computing

63