1© 2012 IBM Corporation
IMS Reorganization Expert
Reorganize IMS Databasesonly when you need to
IMS Tools – Technical Sales SupportDennis [email protected]
2© 2012 IBM Corporation
� Why Reorganize?
� Traditional Reorganization Practices
� New Reorganization Needs
� Tools Interaction
� Summary
IMS Reorganization Expert
3© 2012 IBM Corporation
� Reorganizations are performed for three reasons:
– Maintain Database Integrity
• Assure that all hierarchical connections remain correct and all access paths to all data are available to the end user.
– Maintain Database Availability
• Assure that the database is accessible to users by NOT allowing overrun of dataset space allocation values as size and extents. Allowing for database growth inside of the dataset.
– Maintain Database Performance
• Assure that access paths to the data remain optimum by achieving rapid access to meet Service Level Agreements.
IMS Reorganization Expert
4© 2012 IBM Corporation
� Take the Database Offline
� Image Copy the Database
� Unload the Database
� Delete – Define the dataset
� Load the Database
� Build Indexes (if needed)
� Build Logicals (if needed)
� Image Copy the Database
� Return the Database online
IMS Reorganization Expert
� Traditional Reorganizations cause loss of database access!!
IMS Region
IMS Database
Backup process
5© 2012 IBM Corporation
� Traditional Reorganizations are performed for two reasons:
– The database is reported Out of Service.• The database is unavailable due to an integrity error or database
dataset failure. This results in a condition of NO ACCESS to theend user until corrected.
• This condition is ad hoc and likely happens at the least opportune time of processing.
– The database is Scheduled to be reorganized periodically.
• The database is ALWAYS in a state of NO ACCESS during specific and scheduled times. This results in a condition of NOACCESS to the end user until completed.
• This condition uses time and resources regardless of need.
A scheduled offline condition of the database may or may not be needed based on the actual condition of the database and datasetattribute usage. The database may not NEED to be reorganized.
IMS Reorganization Expert
6© 2012 IBM Corporation
A scheduled reorganization resulting in an offline condition of the database may or may not be needed based on the actual condition of the database and dataset attribute usage.
� Reducing the number of database reorganizations results in a direct savings of CPU, I/O and an increase in database availability.
– A regular schedule of reorganizations is safe but expensive.
– A procedure to identify databases that might need reorganizationcan be intensive, tedious and time consuming for the DBA responsible..
IMS Reorganization Expert
7© 2012 IBM Corporation
� You could be notified when a database needed reorganization -automatically.
� You could schedule that reorganization at the least possible impactful time to normal processing.
� You could easily monitor individual databases for trends towardsneeding reorganization.
� You could save time, CPU cycles and money by performing fewer database reorganizations...
AND
� You could increase availability of the database to end users.
IMS Reorganization Expert
What if? As a DBA...
8© 2012 IBM Corporation
IMS Reorganization Expert
– Reorganization Expert
1. Collecting statistics data for database management
※We will call this data the sensor data
2. Defining and managing the reorganization policy for detecting database and dataset exceptions
3. Utilizing the policy for exception notification and reporting
4. Utilizing the policy for conditional reorganization5. Tracking detected exceptions and effectiveness of
reorganization
– IPR Unload, IPR Reload, and IPR DB Scan utilities are also included and are fully compatible with those in IPR
9© 2012 IBM Corporation
IMS Reorganization Expert
– Automation Director and Autonomics Console
1. Collecting statistics data for database management.
※We will call this data the sensor data.
2. Defining and managing the reorganization policy for detecting database and dataset exceptions.
3. Utilizing the policy for exception notification and reporting.
4. View exceptions and usage trends remotely.5. Identify help information and action recommendations
based on actual exception.
10© 2012 IBM Corporation
IMS Reorganization Expert
� Statistical point-in-time sensor data.� Stored in IMS Tools Knowledge Base repository.� Historically maintained per user specifications.� Over 60 separate data elements related to space usage,
optimization, and fragmentation provided.− E.g. data set extents, DASD volume usage, data set free space, roots
distribution, RAP usage, CI/CA splits, and IMS free space.
� Two methods of collection:� Standalone database Sensor utilities for full-function and Fast
Path databases.� Integrated with existing IMS Tools.
� Integrated Tools support� High Performance Image Copy, High Performance Pointer
Checker.� Fast Path Analyzer, Fast Path Online Pointer Checker.
Sensors: Collecting the Basic Information
11© 2012 IBM Corporation
IMS Reorganization Expert
� Policy definitions are used to evaluate specific database states.� Threshold values are compared against sensor data for a given
database or group of databases.� When thresholds are met or exceeded, exceptions occur.� E.G. the state of space utilization at a specific instance in time.
� Works “out of the box”� Ships with predefined policies and threshold values.� Full ISPF interface provided for policy management.
� Customizable to fit your shop.� You can define your own sets of threshold values.� Customize the messages sent when exceptions do occur.� Submit a reorganization job at exception time.
− Can use job scheduler to execute the job later� Specify who receives which messages and how.
− WTO, E-mail, or text
Policies: Using Sensor Data to Help Make Decisions
12© 2012 IBM Corporation
IMS Reorganization Expert
� A prerequisite for all IMS Tools Solution Packs
� Contains all the common infrastructure components, including the IMS Tools Knowledge Base, for enabling autonomics and next-generation Uis
� Policy Services provides the predefined policies and thresholds
� IMS Tools Knowledge Base repository holds the information to help you make expert decisions� Sensor Data� Policy Services� Reports
� No charge PID� Program number: 5655-V93� IBM Tools Base for z/OS V1.3
IBM Tools Base for z/OS
13 © 2012 IBM Corporation
Smart Reorg utility features at a glance
• All information is stored in and managed by IMS Tools KB repositories• Sysplex-wide access to these repositories is supported by IMS Tools KB Server
IMS Tools KBServer
ISPF ReportSearch/View
ISPF
System z Server
Smart Reorg job
Sensor data records and reports are sent to
repository
A policy is retrieved from repository and is applied
Policy Repository *1
ReportRepository *2
Sensor DataRepository
TSO usersand/orz/OS operator consoles
Notification messages are sent
Sysplex1. Sensor Data
Collection
2. Reorg policy Definition
3. Exception Notification and Reporting
4. Conditional Reorg
5. Tracking exceptions and reorgs
*1: ITKB Input Repository is used as the Policy Repository.*2: ITKB Output Repository is used as the Report Repository.
1
4
5
3
PolicyManagement
2
14 © 2012 IBM Corporation
Benefits of using IMS DB Reorganization Expert
• IMS Database Reorganization Expert provides a smarter reorganization solution
• Benefits of Policy Services and Smart Reorg utility:
– DBAs can centrally control the information that is needed to plan and perform reorganization of IMS databases effectively
– DBA expertise required to perform reorganization can be minimized and knowledge of skilled DBA can become shared
– Unneeded reorgs can be avoided with its reason documented and effectiveness of reorg, if performed, can easily be verified
Reorganization need/effectiveness is evaluated and n otifiedReorganization need/effectiveness is evaluated and n otified
Necessary info/data is always there in well-defined formatNecessary info/data is always there in well-defined format
Decision criteria and actions are documented in polici esDecision criteria and actions are documented in polici es
15 © 2012 IBM Corporation
Summary
• Everything needed for daily IMS database administration is in a Pack!
UnloadLoad
Reorganization
DB Integrity CheckDB Repair
BackupImage Copy
IndexBuild/Recovery
IMS Definition Libraries Management
DB Space Utilization Analysis
Database Repair Facility
Database Repair Facility
IMS Database Reorganization Expert
V4.1Smarter Reorganization
IMS Index BuilderIMS Index BuilderIMS High Performance
Image CopyIMS High Performance
Image Copy
IMS High Performance Prefix Resolution
IMS High Performance Prefix Resolution
IMS Library Integrity Utilities
IMS Library Integrity Utilities
IMS High Performance Load
IMS High Performance Load
IMS High Performance Pointer Checker
IMS High Performance Pointer Checker
IMS High Performance Unload
IMS High Performance Unload
IMS Database Solution Pack for z/OS V1.1IMS Database Solution Pack for z/OS V1.1
IMS Tools Base for z/OS (a free separate PID): ITK B, TOSI, and other common servicesIMS Tools Base for z/OS (a free separate PID): ITK B, TOSI, and other common services
16© 2012 IBM Corporation
IMS Automation Console
Policies: Using Sensor Data to Help Make Decisions� Threshold values are compared against sensor data for a given
database or group of databases.� When thresholds are met or exceeded, exceptions occur.� E.G. the state of space utilization at a specific instance in time.
Sensors: Collecting the Basic Information� Ships with predefined policies and threshold values.� Full ISPF interface provided for policy management.
� Customizable to fit your shop.� You can define your own sets of threshold values.� Customize the messages sent when exceptions do occur.� Specify who receives which messages and how.
− WTO, E-mail, or text
17© 2012 IBM Corporation
IMS Automation
� Passive autonomics for IMS databases.
� Automates ongoing database monitoring and maintenance tasks based on a detailed understanding of the current state of your IMS databases.
� ISPF Dialog Interface.
� Provides a scheduling feature that allowing the user to control how frequently sensor data is collected and how frequently policies are evaluated.
� Recommends when databases should be reorganized based on the policy criteria.
� Integration with the Administration Console via internet access.
Autonomics Director
18© 2012 IBM Corporation
IMS Automation
� Provide a holistic view of your IMS databases from a single, easy-to-use web interface.
� Dynamic, interactive graphs and charts provide you with a visualrepresentation of your sensor data.
� Integration with the Autonomics Director provides a list of policy exceptions and recommended resolutions for all of your monitoreddatabases.
� All IMS Tools reports stored in the IMS Tools Knowledge Base canbe searched, retrieved, and viewed effortlessly from a single point.
� Prepare for the next generation of IMS DBAs.
� Access from anywhere via the Internet using the most popular webbrowsers.
� Includes a robust help system that serves as a learning aid for new IMS DBAs and reminder for the seasoned DBAs.
Administration Console
19 © 2012 IBM Corporation19
Autonomics Director Process Flow
Autonomics Director Master Server
ITKBRepository
Server
Tools Input Repository
AD Repository
Sensor Data
Repository
Policy Repository
DBDLIBs
DBRCRECONs
Policy/SensorEvaluationServices
SchedulerServices
AutoDiscovery
RouterServices
MonitorServices
DB SensorICPC
DB SensorJCL Lib(s)
Internal Reader
Customization Recommendations
USDB1 HDAM Sensor=8 hrs
Eval
=8 hrs
USDB2 DEDB Sensor=12 hrs
Eval
=12 hrs
User Interface Services
20© 2012 IBM Corporation
IMS Automation
ISPF Dialog Recommendations
21© 2012 IBM Corporation
IMS Automation
ISPF Dialog Recommendations
22© 2012 IBM Corporation
IMS Automation
ISPF Dialog Recommendations
23© 2012 IBM Corporation
IMS Automation
Administration Console
� Provide a holistic view of your IMS databases from a single web interface.
� Dynamic, interactive graphs and charts provide you with a visualrepresentation of your sensor data.
� Integration with the Autonomics Director provides a list of policy exceptions and recommended resolutions for all of your monitoreddatabases.
� All IMS Tools reports stored in the IMS Tools Knowledge Base can be searched, retrieved, and viewed effortlessly.
� Prepare for the next generation of IMS DBAs.
� Uses the latest web technologies.� Access from anywhere via the Internet using popular web browsers.� Includes a help system that serves as a learning aid for new IMS
DBAs.
24© 2012 IBM Corporation
IMS Automation Overview of IMS Resources with Drill-down
Resource status, errors, and recommendations can be aggregated with an ability to drill down
Monitored Resource List
25© 2012 IBM Corporation
IMS Automation …from Various HP Tools
…from Autonomics Director
…from Sensors
…from Auto Discovery
Holistic View of IMS Resources
26© 2012 IBM Corporation
IMS Automation
Integrated help educates new and experienced DBAs on database concepts and how to interpret charts
Prepare the next generation of IMS DBAs
27© 2012 IBM Corporation
IMS Automation
?Eclipse
BrowserToolTool
ToolTool
ToolTool
z/OSISPF
IMS
ToolTool
ToolTool
Terminal Emulator
DistributedAccess
Infrastructure
DistributedAccess
Infrastructure
ApplicationServer
ApplicationServer
HTTP (REST)
TCP/IP
…
TCP/IP
HTTP
(REST)
� Standard SMP/E installation� Light weight ‘mid tier’ application server installed using
simple InstallAnywhere (.exe)
28© 2012 IBM Corporation
IMS Automation
� Install once, access anywhere via the Internet
� Single, server-based installation
� Access through popular web browsers
� Safety and security features are built in
� Uses SSL and RACF authentication
� Works “out of the box”
� Immediately view your databases using your existing DBRC groups or Autonomics Director monitor list
� Easily customized
� Define your own groups of databases to view
� Consolidated information at your fingertips
� Summary pages provide total counts of warning, severe, and critical exceptions for a database group – drill down to the individual database level from there
29© 2012 IBM Corporation
IMS Automation
� Value
� Provides a full set of tools for maintaining and managing your IMS full-function and Fast Path databases.
� Includes important High Performance utilities.
� Utilizes Sensors, Policies, Automation, and Modernization.
� Delivers on the IMS Tools vision.
30© 2012 IBM Corporation
� IBM Tools Base for z/OS V1.3
– IMS Tools Knowledge Base SC19-3397
– IMS Tools Common Services SC19-3996
– Policy Services SC19-3399
� IMS Database Solution Pack V1.2
– IMS Database Reorganization Expert SC19-1137
– IMS Solution Packs Database Sensor SC19-3283
– IMS High Performance Database Tools
� IMS Fast Path Solution Pack V1.2
– IMS High Performance Fast Path Utilities SC19-3287
IMS Reorganization Expert Reference
31© 2012 IBM Corporation
� IBM Tools Base for z/OS V1.3
– Administration Console SC19-3264
– Autonomics Director SC193265
– Distributed Access Infrastructure SC19-3400
– IMS Tools Knowledge Base SC19-3397
– IMS Tools Common Services SC19-3996
– Policy Services SC19-3399
� IMS Database Solution Pack V1.2
– IMS Solution Packs Database Sensor SC19-3283
– IMS High Performance Database Tools
� IMS Fast Path Solution Pack V1.2
– IMS High Performance Fast Path Utilities SC19-3287
IMS Autonomics Reference