Upload
ibm-ims
View
344
Download
7
Embed Size (px)
Citation preview
© 2010 IBM Corporation
On the road to a Smarter IMS
Janet LeBlancSilicon Valley [email protected]
Janet LeBlancIMS Tools [email protected]
2 © 2013 IBM Corporation
IMS Tools Solution Packs
IMS Database Solution Pack
� Autonomics
� IBM Administration Console
� Online Reorg Facility
� DB Reorg Expert
� HP Unload
� HP Load
� HP Prefix Resolution
� Index Builder
� HP Image Copy
� HP Pointer Checker
� IMS DB Repair Facility
� Library Integrity Utilities
� HALDB Toolkit
IMS Fast Path Solution Pack
� Autonomics
� IMS Administration Console
� HP FP Utilities
� FP Advanced Utilities
� FP Online Utilities
� IMS DB Repair Facility
� IMS HP Image Copy
� IMS Library Integrity Utilities
IMS Recovery Solution Pack
� IMS Administration Console
� DB Recovery Facility
� HP Change Accumulation
� HP Image Copy
� DRF Extended Functions
IMS Performance Solution Pack
� IMS Administration Console
� IMS Connect Extensions
� IMS Performance Analyzer
� IMS Problem Investigator
IMS Database Solution Pack
� Autonomics
� IBM Administration Console
� Online Reorg Facility
� DB Reorg Expert
� HP Unload
� HP Load
� HP Prefix Resolution
� Index Builder
� HP Image Copy
� HP Pointer Checker
� IMS DB Repair Facility
� Library Integrity Utilities
� HALDB Toolkit
IMS Fast Path Solution Pack
� Autonomics
� IMS Administration Console
� HP FP Utilities
� FP Advanced Utilities
� FP Online Utilities
� IMS DB Repair Facility
� IMS HP Image Copy
� IMS Library Integrity Utilities
IMS Recovery Solution Pack
� IMS Administration Console
� DB Recovery Facility
� HP Change Accumulation
� HP Image Copy
� DRF Extended Functions
IMS Performance Solution Pack
� IMS Administration Console
� IMS Connect Extensions
� IMS Performance Analyzer
� IMS Problem Investigator
3 © 2013 IBM Corporation
Our Vision – Putting information to work for you
Rich, web-based user interface
Recommending and taking corrective actions
Gather database statistics at regular intervals
User-defined policies and thresholds
Policies Sensors
ModernizationAutomation
4 © 2013 IBM Corporation
Database space monitoringIts common purpose is to prevent these situations
• Free space shortage
o Caused by running-out of data set extents or free space on volumes and resulting in service outage
• Inefficient use of database space
o Caused by free space fragmentation, which can eventually result in free space shortage
• Performance degradation
o Caused by free space fragmentation, long synonym chains, a large percentage of overflow segments, etc. and sometimes can result in “batch job overrun”
5 © 2013 IBM Corporation
Database space monitoringWhat activities are needed?
• Collect space statistics data
o % of max data set size, …
• Analyze the data
o Is a threshold reached? …
• Notice exceptional states
o Fragmentation, space shortage, …
• Decide actions
o Free-space reorg, DBD/randomizer change, (re-)partitioning…
• Prepare for action(s)
o Schedule a free space reorg, plan tuning for actions, …
• Take action(s)
o Do the structure change, (re-)partitioning, …
Collect
Analyze
Notice Decide
Act
Prepare
6 © 2013 IBM Corporation
Challenges in the current IT environmentEspecially in IMS database space management
• Decrease in
o Skilled IMS DBAs
o Maintenance window time
• Increase in
o Number of databases
o Data volume
• Increasing business pressures
o “Do more with less.”
• Flat or less IT cost
• Less people
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
7 © 2013 IBM Corporation
We recommend simplification and automationfor the efficiency of the process
• Simplify each step
o Data collection
o Data analysis
o Exception notification
o Action determination
o Action preparation
o Action taking
• Automate repetitive tasks
o Starting from data collection through action decision
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
8 © 2013 IBM Corporation
IBM IMS Tools… can simplify and automate the process
• IMS Database Solution Pack database sensor feature can simplify the ‘Collect’ step
• Autonomics Director (IBM Tools Base) and Policy Services can simplify and automate the ‘Analyze’, ‘Notice’, and ‘Decide’ steps
• Administration Console (IBM Tools Base) can simplify access to space monitoring information needed for the ‘Prepare’ step
• IMS Database Solution Pack also provides reorganization tools that can make execution of space maintenance ‘Actions’ simpler and accelerate the performance
Collect
Analyze
Notice Decide
Act
Prepare
IMS Database Solution Pack
IBM Tools Base
+
9 © 2013 IBM Corporation
You can do more with less people and time… by using the IBM IMS Tools Solution
• Space statistics can be collected as byproducts of your Pointer Checker and/or Image Copy jobs
• Data analysis, exception notification, and action recommendation can be made automatically based on exception detection/notification policies
• Space statistics, detected exceptions, and recommended actions can be accessed through a comprehensive graphical web interface
• Space maintenance actions can be simplified and accelerated
Collect
Analyze
Notice Decide
Act
Prepare
IMS Database Solution Pack
IBM Tools Base
+
10 © 2013 IBM Corporation
Automating monitoring process
11 © 2013 IBM Corporation
Autonomics Director and Policy ServicesInfrastructure for automation
• Autonomics Director server
o Periodically evaluates space statistics data collected by IMS DB Solution Pack utilities, and detect and notifies exceptions if any
• AD server configuration:
o Database monitor list
o Data evaluation schedule
o Data collection schedule
o Exception detection rules
o Exception notification targets and policies
Automation Infrastructure
IMS ToolsKnowledge Base
Server
Repositories
Policy ServicesPolicy Evaluation &
Exception Notification
AutonomicsDirector
Server
IMS DB Solution Packutilities can collect andstores space statistics
IMS DB Solution Packutilities can collect andstores space statistics
IMS DB Solution Packutilities can collect andstores space statistics
12 © 2013 IBM Corporation
Data CollectionDatabase Sensor capability in utilities
• You can collect database space status as “sensor data”
• Sensor data can be collected during
o Pointer Checker run
o Image Copy run
• Sensor data are stored In ITKB Sensor Data Repository
• Stand-alone DB Sensor can collect sensor data of one or more online full-function databases and OLR-cursor-inactive HALDB partitions
IMS Database Solution PackHigh Performance Pointer Checker
High Performance Image CopyStand-alone Database Sensor
Collect
Analyze
Notice Decide
Act
Prepare
IBM Tools BaseIMS Tools Knowledge Base (ITKB)Policy Services Sensor Data Store
13 © 2013 IBM Corporation
Data AnalysisYou don’t need to look at / parse a large number of reports
• AD invokes “policy evaluation”
o New sensor data are notified to Autonomics Director
o Then, AD invokes data analysis process based on the evaluation schedule and the policy pre-configured for each database that is registered in the Monitor List
• Policy evaluation
o A process of applying threshold-detection rules and exception-notification policy to the collected sensor data
• Each rule detects an exceptional state of a database or a partition
Collect
Analyze
Notice Decide
Act
Prepare
IBM Tools BaseAutonomics Director (AD)
Policy Services Policy EvaluationIMS Tools Knowledge Base (ITKB)
o Policy can be selected or defined for each database type, for an individual database, or for a group of databases.
14 © 2013 IBM Corporation
Exception NotificationYou’ll be notified of exceptions
• Action Recommendation
o A policy associates exceptions with an action recommendation (e.g., REORG)
• Notification List
o A policy can have a list of destinations of exception notification
• Exception Notification
o The action recommendation is sent to the destinations listed in the Notification List in the form of WTO, an e-mail, a short message, or a TSO message
Collect
Analyze
Notice Decide
Act
Prepare
IBM Tools BaseAutonomics Director (AD)
Policy Services Exception NotificationIMS Tools Knowledge Base (ITKB)
o An exception consists of:
•An exception name
•A severity
•A short message
15 © 2013 IBM Corporation
Simplifying accessto monitoring information
16 © 2013 IBM Corporation
Action DeterminationTypical questions that need to be answered
• Which databases need attention now?
• Why they need attention?
• What actions are recommended?
• How those databases have gotten to the current state?
• How are free spaces and DASD volumes used?
o What did HP Pointer Checker report?
• What the average database record length and is the current block/CI size optimal for it?
o What did HP Unload report?
Collect
Analyze
Notice Decide
Act
Prepare
• Summary of latest status
• Trend of space status changes
• Database utilities reportsfor “drill-down” research
Information needed
17 © 2013 IBM Corporation
Administration ConsoleProvides a holistic view of data and information
IBM OneUI Theme History ofutility reports
Detected exceptions and action recommendation
Search and group
databases
Online help for space
monitoring
Charts of various space statistics data
items
• Admin. Console also provides a table of the number of exceptions and highest severities for each user-defined group of databases and partitions.
• A typical use case scenario and various screen shots are available on Information Center.
18 © 2013 IBM Corporation
DBD Visualization – “DBD Map Viewer”New in IMS Database Solution Pack, Version 2.1
• An Admin. Console add-on
o Can be installed by using IBM Installation Manager
• It provides six views for a DBD:
o DBD map
o DBD source
o DBD XML
o Segment properties
o Data sets
o Outline
19 © 2013 IBM Corporation
DBD Visualization – “DBD Map Viewer”
DBD Map View
DBD Source View
DBD XML View
Segment Properties View
Data Sets View
Outline View
20 © 2013 IBM Corporation
Simplifying space management tasks
21 © 2013 IBM Corporation
Space management actionsThree main action types
• Free space reorganization
o Offline reorganization
o Online reorganization
• Definition change reorganization
o Space allocation change
o DBD/randomizer change
o Partitioning/re-partitioning
• Tuning for definition changes
o Planned to prepare for an immediate or futuredefinition/structure change
Collect
Analyze
Notice Decide
Act
Prepare
Collect
Analyze
Notice Decide
Act
Prepare
22 © 2013 IBM Corporation
Offline free space reorganization solutionHigh Performance reorganization utilities
• IMS Database Solution Pack provides following utilities
o IMS High Performance Unload
o IMS High Performance Load
o IMS Index Builder
o IMS High Performance Prefix Resolution
o Smart Reorg utility
• An integrated reorganization utility that runs utility functions above and post-reorganization Image Copy and Pointer Checker in a single job step
//REORG EXEC PGM=HPSGMAIN,PARM='DBD=dbdname,DBRC=Y'
//STEPLIB DD DISP=SHR,DSN=IMSTOOLS.LOADLIB
// DD DISP=SHR,DSN=IMS.SDFSRESL
//IMS DD DISP=SHR,DSN=IMS.DBDLIB
//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB
//HPSIN DD *
(REORG)
DBSHARE=YES
IMSCMD=YES,TOSI
TOSIXCFGRP=REORG
SPACEALLOC=YES
INDEXBLD=YES
IC=YES
NAMESWAP=YES
DISPOLDDS=NEWSHADOW
STARTDB=YES
(UNLOAD)
...
(RELOAD)
...
(INDEXBLD)
...
/*
//ICEIN DD *
GLOBAL VIC=Y,
VICDSN=&DDN..UC1,
ICHLQ=TESTDS,
DSN=&ICHLQ..&DDN..IC1,
UNIT=SYSALLDA,
SPACE=(CYL,10,10)
/*
An example JCL statements for Smart Reorg (for a database that has no logical relationship)
23 © 2013 IBM Corporation
Online free space reorganization solutionIMS Online Reorganization Facility (ORF) for z/OS
• IMS Database Solution Pack ORF provides online reorg. solution for full-function databases and HALDBs
Time
UPDATE UPDATEDatabase Status
UPDATE UPDATE
Read-Only or Offline
UPDATEDatabase Status
DB Update Capture Log Database Update Capture
COPY UNLOAD APPLYTKO
RELOADIMAGECOPY
UPDATE
Unload, Reload, Index Build,
Image Copy, Pointer Check
in a single job stepNSProcessing Phase
Processing Phase
Legend (for both ORF and Smart Reorg)
DB Data Set
before Reorg
Shadow
Data Set
Reorganized
DB Data Set
Post-Reorg
Image Copy
Update and
re-register
logs
Smart ReorgSmart Reorg
ORFORF
Name Swap (NS)
24 © 2013 IBM Corporation
Tuning by partitioning/re-partitioningIMS HALDB Toolkit helps you
• The Toolkit provides HALDB maintenance, modeling, and analysis functions, including
o Splitting a partition
o Consolidating partitions
o Adding an empty partition to the end of a database
o Merging HALDBs
• The Toolkit can help reduce the time and minimize the skills that are required to perform HALDB maintenance tasks
PART31PART21 PART41PART11
DBDS4DBDS3DBDS2DBDS1
001-099 100-199 200-299 300-399
001-099 100-199 200-299 300-X’FFFFFF’
PART3PART2 PART4PART1
001-099 100-199 200-299 300-X’FFFFFF’
Key Ranges:
RECONPartition
Defiinition
DBD1 DBD2 DBD3 DBD4
DBDH1 DBDH2 DBDH3 DBDH4
DBDHRECONPartition
Definition
Key Ranges:
Key Ranges:
PART3PART2 PART4PART1
001-099 100-199 200-259 300-X’FFFFF’
DBDHRECONPartition
Definition
Key Ranges:
Convert user-partitioned full-function databases to single-partition HALDBs.
Merge a set of single-partition HALDBs to a single HALDB with multiple partitions.
Maintain partitions(partition split, etc.)
PART31
260-299
25 © 2013 IBM Corporation
� New in Autonomics: – Active Autonomics
– New User GROUP management– Group Reorganization Management
Rich, web-based user interface
Recommending and taking corrective actions
Gather database statistics at regular intervals
User-defined policies and thresholds
Policies Sensors
ModernizationAutomation
Collect
Analyze
Notice Decide
Act
Prepare
26 © 2013 IBM Corporation
Active Autonomics
Plan restart capability
Determines what ran successfullyOnly reruns/runs what failed or is yet to
run
User NotificationsEmail, Text Job plan and results viewable via AD
Tracks jobstream thru completion
Submission of Reorganization JobstreamsManages job distribution across sysplex Controls for parallelism
DB Maintenance WindowsUser controlled DB maintenance windows
Automatic ReorganizationDetermined by Sensor and Policy Evaluation Supported by IMS DB Reorg Expert
27 © 2013 IBM Corporation
User Defined Groups
� Easy to create– Select from any DBs/partitions/areas in system DBDLIBs– Select from any DBRC or other user group– Name masking support: PAY*
� Contains– List of DB’s in group– Consolidated group attributes and options for various tools and
functions– Reorganization, Back-up and Recovery, etc.
� Automatic membership checking/warning for logical relationships
� Useful for – Adding DBs to the monitor list– Viewing recommendation list– Scheduling on demand
� Basis for Group Managed Reorganization
28 © 2013 IBM Corporation
Group Managed Reorganization
Pre-GMR
• /DBR and DBRC authorization changes
•Allocate common/work files
•Pre-reorganization utility
Reorganization
•Runs IMS Reorg Expert for DBs that need reorg
•Optional DB scan for logically related DBs that don’t need reorg
•Consistent feed for prefix resolution/prefix update
•One job per DB/partition/area
•DBs reorganized in parallel or serially or combination
Post-Reorg
• Invoked after reorg phase
•One or more jobs run serially or parallel as identified by user
•Prefix Resolution, Prefix Update
Post GMR
• Invoked after post-reorg phase
•One or more jobs run serially or parallel as identified by user
•Dataset cleanup, Image Copies
29 © 2013 IBM Corporation
IMS Database Solution Pack for z/OS, 2.1
IMS Database Solution Pack combines the following tools intoa single offering:
• IMS Database Reorganization Expert for z/OS
• IMS Online Reorganization Facility for z/OS*
• IMS High Availability Large Database (HALDB) Toolkit for z/OS*
• IMS High Performance Unload for z/OS
• IMS High Performance Load for z/OS
• IMS High Performance Prefix Resolution for z/OS
• IMS Index Builder for z/OS
• IMS High Performance Image Copy for z/OS
• IMS High Performance Pointer Checker for z/OS
• IMS Library Integrity Utilities for z/OS**
• Database Repair Facility
• Database Sensor * Added in Version 2.1
** Provides DBD Map Viewer server capability
30 © 2013 IBM Corporation
• DEDB space management activity is composed of the following tasks:
o Monitoring space utilization
o Tuning areas and randomizer
o Reorganizing free space or restructuring areas
DEDB space management
31 © 2013 IBM Corporation
Background and challenge of space monitoring
• DEDB space utilization must be monitoring on a regular basis for the following reasons:
o To avoid application failures that might be caused by out-of-space conditions
o To determine whether reorganization is required
o To determine the optimal timing for database expansion
• To maintain hundreds and thousands of DEDB areas, DBA needs deep IMS skill and experiences for database space analysis , and it takes a lot of time to check a large number of reports that IMS tools generates
32 © 2013 IBM Corporation
Space monitoring solution
• DEDB area analysis and pointer validation
o Collect raw space statistics (called sensor data)
o Report detailed space usage statistics
o Ensure that your database pointers are error free
o Help you detect and correct database errors quickly
o Provide both online and offline utilities
• IMS Tools Knowledge Base
o The reports that are generated by the FPA functions, FPO tools, and IMS HPIC can be stored in a repository
o You can search historical copies of those reports by database name, date and time, or other search criteria
o Threshold criteria for detecting database exceptions and recommendations can also be defined and stored in a repository
• Autonomics Director and Administration Console
o Simplify DEDB space monitoring tasks
33 © 2013 IBM Corporation
Activating DB Sensor function in FPSP Utilities
• DB Sensor function is supported in following utilitieso FP Advance Tool (ANALYZE, UNLOAD, RELOAD, CHANGE, and REORG)
o FP Online Tool (ANALYZE (Online PC), REORG (Online Expert Reorg))
o HP Image Copy
• DB Sensor is activated just by adding three control statement optionso SENSOR=YES (required)
o ITKBSRVR=your_itkb_xcf_group_name (required)
o ADXCFGRP=autonomic_director_xcf_group_name (optional)
//FPA EXEC PGM=HFPMAIN0
//STEPLIB DD DISP=SHR,DSN=HPFP.SHFPLMD0
// DD DISP=SHR,DSN=ITB.SHKTLOAD
// DD DISP=SHR,DSN=IMSVS.SDFSRESL
// DD DISP=SHR,DSN=IMSVS.PGMLIB
//IMSACB DD DISP=SHR,DSN=IMSVS.ACBLIB
//IMSDALIB DD DISP=SHR,DSN=IMSVS.MDALIB
//HFPSRPT DD SYSOUT=*
//HFPSYSIN DD *
GLOBAL
DBRC=YES,
ITKBSRVR=FPQSRV01,
ADXCFGRP=IAVADM00
ANALYZE
DBD=DEDBJN22,IAREA=(DB22AR0,DB22AR1),
PTRCHKLVL=FULL,SDEPCHKLVL=FULL,
SENSOR=YES
REPORT
/*
For details and more JCL samples, see “DEDB monitoring and
tuning guide” in the User’s Guide.
//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//OPC EXEC FPUTIL,DBD=DEDBJN22,IMSID=IMS1//STEPLIB DD DISP=SHR,DSN=HPFP.SHFPLMD0
// DD DISP=SHR,DSN=ITB.SHKTLOAD
// DD DISP=SHR,DSN=IMSVS.SDFSRESL
// DD DISP=SHR,DSN=IMSVS.PGMLIB
//FPXIN DD *//FPXIN DD *//FPXIN DD *//FPXIN DD *GLOBAL
DBRC=YES,
ITKBSRVR=FPQSRV01,
ADXCFGRP=IAVADM00
ANALYZE AREA=(DB22AR0,DB22AR1),
FULLSTEP=YES,
TYPRUN=RPT,
SENSOR=YES
/*/*/*/*
A JCL Example for FPA ANALYZEA JCL Example for FPA ANALYZE A JCL Example for OPCA JCL Example for OPC
34 © 2013 IBM Corporation
Online free space monitoring acceleration
• Support light-weight monitoring besides full monitoring
o OPC with TYPRUN=FS now can store both the sensor data and reports on free space statistics in a single job step
• Elapsed time of OPC with FULLSTEP=YES is significantly reduced by
o Processing multiple areas concurrently
o Eliminating I/Os for intermediate data sets
IMS
OPC
Free spacereport
area
A subsetof sensor
data
Light-weight monitoring of free spaces (new)
Full monitoring of space utilization
• TYPRUN=FS• SENSOR=YES• FULLSTEP=YES
IMS
OPC
Full analysisreport
area
Full setof sensor
data
• TYPRUN=RPT• SENSOR=YES• FULLSTEP=YES
No SORT
SORTsSORTsSORTs
* Note: Consumption of IMS online DB buffer resource is same as that for TYPRUN=RPT.
35 © 2013 IBM Corporation
Stand-alone DB Sensor
• Process one DEDB in a job step
• Be used to collect and store sensor data for multiple areas
• Process both offline and online areas
• Report sensor data values in a report
• Does NOT produce Area Analysis Reports
// DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD
//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//HFP EXEC PGM=HFPSENSR//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0//STEPLIB DD DISP=SHR,DSN=FPSP.SHFPLMD0// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD // DD DISP=SHR,DSN=ITB.SHKTLOAD //IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB1//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPSPRT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPSYSIN DD *//HFPSYSIN DD *//HFPSYSIN DD *//HFPSYSIN DD *
GLOBAL DBRC=YES, GLOBAL DBRC=YES, GLOBAL DBRC=YES, GLOBAL DBRC=YES, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ITKBSRVR=FPQSRV01, ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01 ADXCFGRP=ADSRV01
DATABASE DATABASE DATABASE DATABASE DBD=DEDBJN23, DBD=DEDBJN23, DBD=DEDBJN23, DBD=DEDBJN23, IAREA=*ALL IAREA=*ALL IAREA=*ALL IAREA=*ALL
/*/*/*/*
A JCL Example for Stand-alone DB SensorA JCL Example for Stand-alone DB Sensor
• FPA, FPO, and HPIC with SENSOR=YES can also produce this report.
IMS HPFP UTILITIES IMS HPFP UTILITIES IMS HPFP UTILITIES IMS HPFP UTILITIES ---- DB SENSORDB SENSORDB SENSORDB SENSOR5655565556555655----WWWW11114444 VVVV1111RRRR3333
DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1DBD NAME: DEDBJN24, AREA NAME: DB24AR0 , AREA NUMBER: 1------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
========================================================================================================================================================================================AREA DEFINITIONAREA DEFINITIONAREA DEFINITIONAREA DEFINITION
========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_CISIZE 1,024DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW1 20DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_UOW2 4DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT1 6,800DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_ROOT2 425DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478DB_AREADEF_NUM_SDEP_CIS 12,478
========================================================================================================================================================================================FREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICSFREE SPACE PERCENTAGE STATISTICS
========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_RAA 23%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_DOVF 75%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_IOVF 97%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%DB_PCT_BYTES_FS_SDEP 100%
========================================================================================================================================================================================OVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICSOVERFLOW USAGE STATISTICS
========================================================================================================================================================================================Data Element Name ValueData Element Name ValueData Element Name ValueData Element Name Value------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_PCT_NUM_UOW_USE_DOVF 98%DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_AVG_NUM_DOVFCI_BY_UOW 1.50DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_MAX_NUM_DOVFCI_BY_UOW 4DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_PCT_NUM_UOW_USE_IOVF 2%DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_NUM_UOW_USE_IOVF 110DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_AVG_NUM_IOVFCI_BY_UOW 2.20DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MAX_NUM_IOVFCI_BY_UOW 11DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_MIN_NUM_IOVFCI_BY_UOW 1DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_IOVFCI_USED 3%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%DB_PCT_NUM_RAPCI_OVFL 24%............
Sensor Data Statistics ReportSensor Data Statistics Report
36 © 2013 IBM Corporation
Automated exception detection for sensor data
• Autonomics Director provides:
o Automatic and on-demand analysis of the state of your databases against user-defined threshold criteria
o Generation of user-recommended actions for subject databases and database groups
• Exception detection rules are almost same as those supported by thresholds for DEDB Pointer Checker and FPA ANALYZE function and OPC
o Free space availability
o Overflow status
o Randomizing Synonyms
o DB Record Length (Avg. & Max)
o Physical I/O
37 © 2013 IBM Corporation
Administration Console work flow for DEDB area space monitoring
Check the itemized diagnosis result for the resource.
Look at FP Solution Pack utility reports to see detailed analysis of the space usage of the subject area.
Read the help for each of the detected exceptions.
Check the summary of latest DEDB area space diagnosis done by Autonomics Director.
11
22
33
44
Summary Table for a DEDB
Exceptions Widget
Help Widget
Reports Widget
Main dashboardfor a DEDB areaMain dashboardfor a DEDB area
Sensor WidgetLook at the trend of specific sensor data values
55
38 © 2013 IBM Corporation
Background of database tuning
• When an exceptional state of an area is detected by space monitoring
o Tuning these areas to obtain the optimal database definition parameters, then reorganize or restructure them based on the tuning results, might resolve the exception
• Tuning a database often involves significant and time-consuming database administration tasks
o DBDLIB and ACBLIB need to be generated for each iterative if DBD structure change is required
o Unloading and reloading the area to determine if the changes are effective is time-consuming
39 © 2013 IBM Corporation
Database tuning solution
• Adjust the DBD parameters or/and the randomizing routine to suit the current characteristics of the database records in the area
• Goal of tuning is to achieve the following results:
o Shorter synonym chains with fewer unused RAPso Higher percentage of segments in RAA BASEo Fewer physical I/Os to access a root segment and a complete
database record
• The following database specifications can be changed and evaluated:
o Randomizing moduleo UOW parameter valueso ROOT parameter valueso Number of database areaso CI sizes
40 © 2013 IBM Corporation
FPA TUNE function
• Simulate changes of the DBD parameters and the randomizing routine without loading the segments to allow user to select the physical database attributes that satisfy the performance and space utilization requirements
o Provide JCL ease of use
o Allow user to specify new DBD parameters and new randomizing routine with keywords, instead of new ACBLIB
o Tune multiple areas in parallel
o Provide a set of complete reports to verify effects of changes
41 © 2013 IBM Corporation
Database tuning simplification
FPSP V1.2 FPSP V1.3
DBAs generate DBDLIB for the new DBD definition if DBD structure change is required.
Not necessary
DBAs generate ACBLIB for the new DBD definition if DBD structure change is required.
Not necessary
DBAs run FPB DEDB Tuning Aid (DEDBTA) using the above new ACBLIB and/or the new randomizer and threshold in 6 job steps.
DBAs run FPA Tune function with no AREA scan mode specifying the candidate of the new DBD definition and threshold to the keywords and/or the new randomizer in 1 job step.
DBAs need to compare some reports of before/after the tuning to confirm the effectiveness of the tuning.
DBAs can confirm the effectiveness of the tuning based on the threshold values in the area tuning summary report.
• Database tuning function facilitates multiple iterations of the database tuning process, thereby allowing you to select physical database attributes that meet your requirements
o Even if the tuning attribute is determined once (without iteration), the steps are reduced significantly
o It is unnecessary to build DBDLIB and ACBLIB for each iteration
o Complete reports are provided to verify effects of changes
42 © 2013 IBM Corporation
Command set of FPA TUNE function
• TUNE command
o Specify general information for tuning, such as DBD name, area name, dataset mask, and so on
• SIMULATE subcommand
o Provide resources for tuning, such as new randomizing routine name, and so on
• AREADEF subcommand
o Define the new area parameters for tuning, such as CISIZE, UOW, ROOT, and so on
//HFP//HFP//HFP//HFPTUNETUNETUNETUNE EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0
//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=//STEPLIB DD DISP=SHR,DSN=HPFHPFHPFHPF.SHFPLMD0.SHFPLMD0.SHFPLMD0.SHFPLMD0
// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL
//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB
//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=//DB30AR0 DD DISP=SHR,DSN=HFPHFPHFPHFP.DB30AR0.ADS1 .DB30AR0.ADS1 .DB30AR0.ADS1 .DB30AR0.ADS1
//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*
//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*
//HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD *
GLOBAL GLOBAL GLOBAL GLOBAL
SCAN=NO, SCAN=NO, SCAN=NO, SCAN=NO,
DBRC=NO DBRC=NO DBRC=NO DBRC=NO
TUNETUNETUNETUNE
DBD=DEDBJN30, DBD=DEDBJN30, DBD=DEDBJN30, DBD=DEDBJN30,
IAREA=DB30AR0IAREA=DB30AR0IAREA=DB30AR0IAREA=DB30AR0,,,,
AREASCAN=YESAREASCAN=YESAREASCAN=YESAREASCAN=YES
SIMULATE SIMULATE SIMULATE SIMULATE
OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0 OAREA=DB30AR0
AREADEF AREADEF AREADEF AREADEF
OAREA=DB30AR0, OAREA=DB30AR0, OAREA=DB30AR0, OAREA=DB30AR0,
UOW=(28,8) UOW=(28,8) UOW=(28,8) UOW=(28,8)
THRESHOLD THRESHOLD THRESHOLD THRESHOLD
DOVFFS_PCT=30, DOVFFS_PCT=30, DOVFFS_PCT=30, DOVFFS_PCT=30,
IOVFFS_PCT=50 IOVFFS_PCT=50 IOVFFS_PCT=50 IOVFFS_PCT=50
/* /* /* /*
areaTAR file
FPA TUNE
iteration
area
FPA TUNE
FPA TUNE
iteration
AREASCAN=YES &No TAR files specified
AREASCAN=NO &TAR files specified
AREASCAN=YES &TAR files specified
tuning reports
tuning reports
Sample JCL for mode 2
Mode 1: Create TAR files at first, then iterate tuning process
using the existing TAR files
Mode 2: Iterate tuning process using the intermediate TAR
files that are deleted at the end of each iteration
43 © 2013 IBM Corporation
OPC/OER TAR files generation
• Generate the TAR files, which can be used as the input data for FPA TUNE function
o Enable DEDB areas to be tuned without taking the areas offline
o Specify TARECGEN=YES for
• ANALYZE statement of OPC
• or PTRCHK statement of OER
o Specify TAR file and AREASCAN=NO for
• TUNE command of FPA
//OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA //OPC EXEC FPUTIL,DBD=DEDBJN23,IMSID=FPCA
//STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0 //STEPLIB DD DISP=SHR,DSN=EASY01.FPS130.COMMON.SHFPLMD0
// DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL // DD DISP=SHR,DSN=IMS12A.SDFSRESL
// DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB // DD DISP=SHR,DSN=IMS12A.PGMLIB
//SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY //SYSUDUMP DD DUMMY
//SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=* //SYSPRINT DD SYSOUT=*
//FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=* //FPXMFILE DD SYSOUT=*
//FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=* //FPXRPTS DD SYSOUT=*
//DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY //DFSUDUMP DD DUMMY
//FPXIN DD * //FPXIN DD * //FPXIN DD * //FPXIN DD *
ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1 ANALYZE AREA=DB23AR1
MFILE=FPXMFILE MFILE=FPXMFILE MFILE=FPXMFILE MFILE=FPXMFILE
RFILE=FPXRPTS RFILE=FPXRPTS RFILE=FPXRPTS RFILE=FPXRPTS
TYPRUN=RPT TYPRUN=RPT TYPRUN=RPT TYPRUN=RPT
FULLSTEP=YES FULLSTEP=YES FULLSTEP=YES FULLSTEP=YES
TARECGEN=YES TARECGEN=YES TARECGEN=YES TARECGEN=YES
TARDSNMASK=‘TARDSNMASK=‘TARDSNMASK=‘TARDSNMASK=‘HFPHFPHFPHFP.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'.IMS12.&AREA.TAR'
/*/*/*/*
//HFP//HFP//HFP//HFPTUNETUNETUNETUNE EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0EXEC PGM=HFPMAIN0
//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS1//STEPLIB DD DISP=SHR,DSN=FPS133330.SHFPLMD00.SHFPLMD00.SHFPLMD00.SHFPLMD0
// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL// DD DISP=SHR,DSN=IMS.SDFSRESL
//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB//IMSACB DD DISP=SHR,DSN=IMS.ACBLIB
////////TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=TAR00001 DD DISP=SHR,DSN=HFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TARHFP.IMS12.DB23AR1.TAR
//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*//HFPRPTS DD SYSOUT=*
//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*//HFPPRINT DD SYSOUT=*
//HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD * //HFPSYSIN DD *
GLOBAL DBRC=NO, GLOBAL DBRC=NO, GLOBAL DBRC=NO, GLOBAL DBRC=NO,
SCAN=NO SCAN=NO SCAN=NO SCAN=NO
TUNETUNETUNETUNE
IAREA=DBIAREA=DBIAREA=DBIAREA=DB23AR123AR123AR123AR1, , , ,
DBD=DEDBJNDBD=DEDBJNDBD=DEDBJNDBD=DEDBJN23,23,23,23,
AREASCAN=NOAREASCAN=NOAREASCAN=NOAREASCAN=NO
SIMULATE SIMULATE SIMULATE SIMULATE
OAREA=DBOAREA=DBOAREA=DBOAREA=DB23AR123AR123AR123AR1, , , ,
AREADEFAREADEFAREADEFAREADEF
OAREA=DBOAREA=DBOAREA=DBOAREA=DB23232323AR1, AR1, AR1, AR1,
CISIZE=4096 CISIZE=4096 CISIZE=4096 CISIZE=4096
/* /* /* /*
IMS
OPC
areaTAR file
FPA TUNE
iteration
AREASCAN=NO &TAR files specified
tuning reports
44 © 2013 IBM Corporation
Area Tuning Summary Report
IMS HPFP UTILITIES - FPA TUNE "Area Tuning Summary Report" PAGE: 1
5655-W14 V1R3 2013-09-13 16:22:48
DBD NAME: DEDBJN30
SIMULATION MODE: RESTRUCTURE (AREADEF subcommands are specified)
CURRENT RESOURCES:
- ACBLIB DDNAME: IMSACB
- RANDMIZER : DBFHDC44
SIMULATED RESOURCES:
- ACBLIB DSNAME: IMS.ACBLIB
- RANDMIZER : DBFHDC44
Threshold Exceptions:
Exceptions from current areas
-------------------------------------------------------------------------------------------------------------------
The percentage of free space in DOVF fell below a threshold in area DB30AR0.
The percentage of free space in IOVF fell below a threshold in area DB30AR0.
-------------------------------------------------------------------------------------------------------------------
Exceptions from simulated areas
-------------------------------------------------------------------------------------------------------------------
*** No exception was detected ***
-------------------------------------------------------------------------------------------------------------------
Area Statistics:
*: Shows the point of threshold exception.
AREA NAME: DB30AR0
------------------------------------------------------------------------------------------------
Keyword Threshold Value Current Value Simulated Value Difference
------------------------ ---------------- ---------------- ---------------- ------------------
DOVFFS_PCT 30% 26%* 57% +31
IOVFFS_PCT 50% 47%* 98% +51
Database Definition and Database Record Distribution:
Upper row for each area shows the definition and number of database records of current areas
Lower row for each area shows the definition and number of database records of simulated areas
* shows the difference
TOTAL CI'S SDEP START
AREA AREA CI-SIZE UOW= ROOT= --------------------------------------- ------------------ NUMBER OF
NAME NO. BASE DOVF IOVF TOTAL BLOCK# RBA(HEX) DB RECORDS
-------- ----- ------- ------------- ------------- --------- --------- --------- --------- --------- -------- -----------
DB30AR0 1 2,048 (24,4) (6500,500) 120,000 24,000 11,900 155,900 - - 109,900
DB30AR0 1 2,048 (28,8)* (6500,500) 120,000 48,000 13,883 181,883 - - 109,900
-------- ----- ------- ------------- ------------- --------- --------- --------- --------- --------- -------- -----------
List the threshold exceptions that are detected in the current areas and the simulated areas
List the threshold value for each factor that is evaluated (supplied through the THRESHOLD subcommand keywords)
List the database definitions and the number of database recordsin the current areas and the simulated areas
45 © 2013 IBM Corporation
Other reports generated by FPA TUNE function
• Provide two sets of the comprehensive analysis reports to evaluate the effects of tuning
o The reports beginning with TUNED in the title contain information that obtained from the simulated areas
o The reports without beginning with TUNED in the title information that obtained from the current areas
o The following reports are generated:
• (TUNED) DEDB Area Analysis report
• (TUNED) Process Summary of Analysis report
• (TUNED) Segment Length Distribution report
• (TUNED) UOW report
• (TUNED) UOW Exception report
• (TUNED) Largest Database Records report
• (TUNED) Consolidated Largest Database Records report
46 © 2013 IBM Corporation
More information in area analysis report
• Solution
o Add new report header lines that indicate:
• Input data set name• Input data set type (and the timestamp for image copy)
o Add SDEP information in the following reports:
• SDEP LB/LE information in Freespace Analysis report• Number of occurrences in Segment Placement Analysis report
o Optionally add segment prefix length information in the DB Record Profile Analysis report
o Optionally add Segment Length Distribution report
• Customer benefit
o Sure identification of the source of statistics data
o Comprehensive reporting of SDEP space usage information
o Better estimation of space use by each segment type
o Quick identification of segment length
47 © 2013 IBM Corporation
47
More information in area analysis report (cont.)
Sample 1: New report header lines
Input: A batch image copy data set
Input: Area data set
Input: A concurrent image copy data set
48 © 2013 IBM Corporation
48
More information in area analysis report (cont.)
Sample 2: SDEP information
SDEP LB/LE information
Number of SDEP segment occurrences
49 © 2013 IBM Corporation
49
More information in area analysis report (cont.)
Sample 3: Segment prefix length information
These information are reported when SEGLSTAT=DETAILED is specified.(The default is SEGLSTAT=COMPACT.)
50 © 2013 IBM Corporation
50
More information in area analysis report (cont.)
Sample 4: Segment Length Distribution report
This report is generated when SEGLDIST=YES is specified.(The default is SEGLDIST=NO.)
51 © 2013 IBM Corporation
Database-level Largest DB Records Report
• Consolidate and sort the statistics data for large database records and create a single report across entire database
o Provide a second parameter for the LARGEREC_COUNT keyword to allow user to specify the number of reporting entries
o Consolidated Largest Database Records Report
• Be helpful for quick identification of large database records in a database that has a large number of areas
Largest Database Records Report for each area
Merge and sort rawinformation internallywithin FPA/FPO
“Consolidated LargestDatabase Records Report”
area1
area2
area3
area4
area5 …
arean
52 © 2013 IBM Corporation
52
Consolidated Largest Database Records report
IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: IMS HPFP UTILITIES "CONSOLIDATED LARGEST DATABASE RECORDS REPORT" PAGE: 1111
5655565556555655----W14 V1R2 2012W14 V1R2 2012W14 V1R2 2012W14 V1R2 2012----09090909----14 17:014 17:014 17:014 17:07:417:417:417:41
DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30DBDNAME: DEDB0003 KEY LENGTH: 10 RECORD COUNT: 30
TOTAL AREA#: 19TOTAL AREA#: 19TOTAL AREA#: 19TOTAL AREA#: 19
AREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DBAREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DBAREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DBAREA: DB23AR1 DB23AR2 DB23AR3 DB23AR4 DB23AR5 DB230006 DB230007 DB230008 DB230009 DB230010 DB230011 DB230012 DB230013 DB230230230230014014014014
DB230015 DB230016 DB230017 DB230018 DB230019DB230015 DB230016 DB230017 DB230018 DB230019DB230015 DB230016 DB230017 DB230018 DB230019DB230015 DB230016 DB230017 DB230018 DB230019
RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)RECORD SIZE # OF SEG'S AREANAME AREA# ROOT RBA RAP# RAP RBA ROOT SEGMENT SEQUENCE FIELD (HEX) (CHARACTER)
-------------------------------------------- ---------------------------------------- -------------------------------- -------------------- -------------------------------- -------------------- -------------------------------- ------------------------------------------------------------------------------------------------------------------------------------ ****----------------------------------------------------------------****
4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 4,012 24 DB23AR1 1 00070808 9 00004400 F1F0F0F0 F0F0F0F1 F0F1 *1000000101 ****
4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 4,012 13 DB23AR1 1 00015408 48 00014800 F1F0F0F0 F0F0F0F4 F9F1 *1000000491 ****
4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 4,012 24 DB23AR4 4 00008744 9 00008000 F4F0F0F0 F0F0F0F1 F0F1 *4000000101 ****
4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 4,012 13 DB23AR4 4 0002FBA6 48 0002F800 F4F0F0F0 F0F0F0F4 F9F1 *4000000491 ****
4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 4,012 24 DB23AR5 5 00070808 9 00004400 F5F0F0F0 F0F0F0F1 F0F1 *5000000101 ****
4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 4,012 13 DB23AR5 5 00015408 48 00014800 F5F0F0F0 F0F0F0F4 F9F1 *5000000491 ****
3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 3,760 14 DB23AR1 1 00023AC4 84 00023800 F1F0F0F0 F0F0F0F8 F5F1 *1000000851 ****
3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 3,760 11 DB23AR1 1 000276C4 93 00027400 F1F0F0F0 F0F0F0F9 F4F1 *1000000941 ****
3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 3,760 14 DB23AR4 4 000532C4 84 00053000 F4F0F0F0 F0F0F0F8 F5F1 *4000000851 ****
3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 3,760 11 DB23AR4 4 0005CAC4 93 0005C800 F4F0F0F0 F0F0F0F9 F4F1 *4000000941 ****
3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 3,760 14 DB23AR5 5 00023AC4 84 00023800 F5F0F0F0 F0F0F0F8 F5F1 *5000000851 ****
3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 3,760 11 DB23AR5 5 000276C4 93 00027400 F5F0F0F0 F0F0F0F9 F4F1 *5000000941 ****
3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 3,510 19 DB23AR1 1 0000A008 21 00009400 F1F0F0F0 F0F0F0F2 F2F1 *1000000221 ****
3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 3,510 15 DB23AR1 1 0000DC08 30 0000D000 F1F0F0F0 F0F0F0F3 F1F1 *1000000311 ****
3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 3,510 19 DB23AR4 4 00015BA6 21 00015800 F4F0F0F0 F0F0F0F2 F2F1 *4000000221 ****
. . . . . . . . .. . . . . . . . .. . . . . . . . .. . . . . . . . .
. . . . . . . . .. . . . . . . . .. . . . . . . . .. . . . . . . . .
. . . . . . . . .. . . . . . . . .. . . . . . . . .. . . . . . . . .
A Sample Report
53 © 2013 IBM Corporation
Make space management simpler and easier
54 © 2013 IBM Corporation
Background and challenge of space management
• When an exceptional state of an area is detected by space monitoring, reorganize free space or extend the size of areas based on the tuning results
o If the database record profile and the number of database records in the area are relatively unchanged, reorganizing free space might resolve the exception
o If the available free space fall below the thresholds, extending the size of the DEDB areas might resolve the exception
• In operating environments that cannot be stopped, unload/reload cannot be used to increase free space in areas, and ineffective reorganization causes unnecessary impact upon online performance
55 © 2013 IBM Corporation
Space management solution
• DEDB area expansion
o Dynamically extend the IOVF portion and the SDEP portion of DEDB area without take it offline
o Support volume management in SMS environment
• DEDB area reorganization
o Extend the capability of High-Speed DEDB Direct Reorganization utility (DBFUHDR0)
o Evaluate UOWs in DEDB areas, rank the UOWs, and reorganize only highly ranked UOWs to reduce the volume of database update logs
o Collect statistics and generate area analysis reports of the reorganized area
o Take image copies of the reorganized area
56 © 2013 IBM Corporation
Online area expansion
• Increase IOVF and/or SDEP parts size while allowing online access to the area that is being extended
o Use DEDB create utility (DBFUMRI0)
o Process a single area in one step
• Two expansion types
IMS
OAE
avail
IOVF
avail
IOVF
ADS1 ADS1111
copy back
Rename(TOSI)
Original expansion
IMS
OAE
unavail
avail
IOVF
ADS2
avail
unavail
Shadow expansion
IOVF
ADS1
IOVF
ADS1
IOVF
ADS2
IOVF
ADS2
57 © 2013 IBM Corporation
Simpler parameter specification
• The extended size for SDEP portion can be specified with a specific number or by a percentage of CIs within the total number of CIs defined in the SDEP portion
o SDEP_CI=xx or xx%
• The extended size for IOVF portion can be specified with a specific number or by a percentage of UOWs within the total number of UOWs defined in the IOVF portion
o IOVF_UOW=xx or xx%
• These specifications allow OAE to be executed multiple times without JCL modification
58 © 2013 IBM Corporation
Volume management support
• Provide a keyword VOLCNT to allow user to specify the maximum number of volumes for the extended area data set
o OAE uses volume where space is available
o The VOLCNT keyword is supported only for SMS environment
• Make OAE execution a success although some volumes are out of space
59 © 2013 IBM Corporation
Online free space reorganization
• Save online system resource and eliminates unnecessary reorganizations by identifying only those databases that need to be reorganized based on user-defined criteria
DDEP
DDEP
DDEP
DDEP
ROOT
ROOT
ROOT
DDEP DDEPROOT
ROOTROOT
Base Base
DOVF
DDEPROOT
DDEPROOT
DDEP
DDEP
UOW IOVF
DDEP DDEP
IOVFUOW
IMS
OER
DOVF
60 © 2013 IBM Corporation
Free space reorganization acceleration
• Minimize the impact on other critical applications accessing the area, and maximize the effect of reorganization
o Reorganize only the subset of the most fragmented UOWs
o Provide a keyword REORGLIM to allow user to specify an allowable maximum number of UOWs to be reorganized
• Internally invoke OPC after reorganization to produce reports to verify the effects of reorganization, to take image copy of the reorganized areas
61 © 2013 IBM Corporation
Big picture of Fast Path Solution Pack and Tools Base
IMS ToolsKnowledge
BaseRepository
Server
Repository
Analyze & DB Sensor functions
Autonomics Director Server
Autonomics
Director
(+ Policy Services)
IBM Tools Base V1.4
IMS FP Solution Pack V1.3
z/OS Env.
• Policy-based DEDB Area Diagnosis
• Store sensor data
(and reports)• Notify sensor data
Distributed Access
Infrastructure
TSO
Administration
Console Open Env.
• Notify
exceptions
Reorganize functions
• Reorganize free space
Tune functions• Tune database
• Extend database
11
22
33
44
Extend function
Restructure functions55
• Change database attributes
• Analyze and collect sensor data
62 © 2013 IBM Corporation
DEDB utility solutions
Solution Function FPA (offline) FPB (offline) FPO (online)
Reorganizing Unload UNLOAD DEDB Unload Online Data Extract (ODE)
Reload RELOAD DEDB Reload
Change CHANGE
Reorganize REORG Online Expert Reorganization (OER)
Extend Online Area Extender (OAE)
Build FP Secondary Index
INDEXBLD
Analyzing Integrity verification and analysis
ANALYZE-DEDB AREAs-Secondary Index DBs
DEDB Pointer Checker- DEDB AREAs
Online Pointer Checker (OPC)-DEDB AREAs
Print DMAC information
DMACPRT Online DMAC Print (ODM)
Extracting Extract segments EXTRACT Unload/Reload user exit routines
Online Data Extract (ODE)
Tuning Tuning Aid TUNE DEDB Tuning Aid
Other Initialize DEDB areas
INITIALIZE
63 © 2013 IBM Corporation
Summary
� IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs
� IBM is dedicated to the continued success and support of IMS and the mainframe. We’re invested for the long term, right beside you.
� We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers around autonomic computing
63