IMS Sysplex Manager Functional Overview - IMS UG August 2012 Sao Paulo

IMS Tools

IMS Sysplex Manager Functional Overview

Andy NguyenIBM – IMS Tools Development - adn@us.ibm.com

IMS Tools

Agenda

• Product Highlights

• Data Sharing Management

– SQ transaction affinity routing

– SQ buffer overflow protection

– CSL RM structure management

• Other Product Functions

IMS Tools

IMS Sysplex Manager Highlights– Real-time management of the IMS Sysplex Environment

� Single system image thru local and aggregate view of data

� Simplified User Interface (TSO/ISPF)

� Structured displays of IMS resources and CF structures

� Global Type-1 command, OM Type-2 and IMS SPOC

� Basic z/OS performance information and SVC dump capture

� Statistics for CSL (OM, RM and SCI), IRLM and CQS

� Dashboard with key system indicators and threshold monitoring

� Intercept System exceptions and generate Console alerts

� Browse, delete and recover messages on Shared Queues

� Delete RM resource structure entries

� Assign affinity for transactions in Shared Queues environment

� Protect against buffer overflow in Shared Queues environment

– Support IMS DB/TM, DBCTL, and DCCTL for IMS v9 and later

IMS Tools

MVS1MVS4MVS3MVS2

CQS1 CQS2

SCI1 RM1 OM1 SCI2 RM2 OM2

IMS Sysplex Manager Sample Configuration

IMSSM DC

IMSSM UIS

IMS1 IMS2

IMS Connect IMS Connect

FDR1 FDR2

IMS Tools

IMS Data Sharing

• Shared Queues

– SQ transaction affinity routing

– SQ buffer overflow protection

• Shared Resources

– CSL RM structure management

IMS Tools

Shared Queue Transaction Affinity Routing

IMS Tools

Shared Message Queues Transaction Affinity

• IMS Shared Message Queues provides

– Enhanced scalability, throughput, and response time

– Enhanced availability through redundancy

• IMS Shared Message Queues creates

– Additional components to manage (CQS, structures, logstreams…)

– Additional operational complexity

– Possible false scheduling

– Possible resource contention

IMS Tools

Transaction Affinity Highlights

• Finer control of transaction scheduling

• Non-invasive to existing definition and operation

– No omission of transaction definitions in sysgen

– No stopping of transactions

– No re-classing of dependent regions

– No operational impact for loss of a system

• User defined affinity to route transaction messages

– Any IMS in the shared queues group

– Any subset of IMS systems

– Equal or weighted distribution

IMS Tools

Transaction Affinity Implementation

• User affinity definitions created in IMS Proclib

• Definitions “copied” to CQS list structure

– IMS initialization

– Shared by all IMS systems

– Persistent across IMS restarts

– Synchronized affinity definitions across Sysplex

• Seamless operations

– Local informs/registration issued for transactions with affinity

– Backup IMS system destination for planned and unplanned outages

– Option to reject transaction if destination IMS systems not available

• SPE (PK68900/UK45873) enables tweaking affinity definitions

dynamically

IMS Tools

Transaction Affinity Implementation

Sample Proclib Definitions

OPTIONS(STRUCTURE(GJESMAFN),STATUS(ENABLED), PGMREJECT(ABEND(U3303)),NETREJECT(2175))

SYSTEM(TARG(IMSGRP01),IMS(IMS1),STATUS(ENABLED)) SYSTEM(TARG(IMSGRP02),IMS(IMS2),STATUS(ENABLED)) SYSTEM(TARG(IMSGRP03),IMS(IMS3),STATUS(DISABLED)) SYSTEM(TARG(IMSGRP1A),IMS(IMS1,IMSA,IMS1),STATUS(ENABLED))

AFFINITY(TYPE(TRANSACT),TARG(IMSGRP1A,IMSGRP02),DISP(REJECT), DEST(NAME(APOL12)),STATUS(ENABLED))

AFFINITY(TYPE(TRANSACT),TARG(IMSGRP02,IMSGRP01),DISP(REJECT), DEST(NAME(JAVC%NV*)),STATUS(ENABLED))

AFFINITY(TYPE(TRANSACT),TARG(IMSGRP1A),DISP(QUEUE), DEST(NAME(TRAN%%C,TRANAB*)),STATUS(DISABLED))

AFFINITY(TYPE(TRANSACT),TARG(IMSGRP01), DEST(NAME(%%F3,%%F4)))

AFFINITY(TYPE(TRANSACT),TARG(IMSGRP1A),DEST(CLASS(1,2,3)))

IMS Tools

Reducing False Scheduling Overhead

Example

• Three systems in group IMSA, IMSB, and IMSC

• Transaction TRAN1 causes false scheduling

• Balanced affinity definition

– Arriving TRAN1 messages rotated to each

SYSTEM(TARG(SYSTEM1),IMS(IMSA,IMSB,IMSC))

AFFINITY(DEST(TRAN1),TARG(SYSTEM1))

• Weighted affinity definition

– 50% of TRAN1 messages routed to IMSA

SYSTEM(TARG(SYSTEM1),IMS(IMSA,IMSA,IMSB,IMSC))

AFFINITY(DEST(TRAN1),TARG(SYSTEM1))

IMS Tools

Reducing Database Lock Contention

Example

• Three systems in data sharing group IMSA, IMSB, and IMSC

• Transaction TRAN2 causes contention

• Affinity definition

– Arriving TRAN2 messages limited rotation to subset

– IMSC only used if IMSA and IMSB are unavailable

SYSTEM(TARG(SYS1),IMS(IMSA,IMSB))

SYSTEM(TARG(SYS2),IMS(IMSC))

AFFINITY(DEST(TRAN2),TARG(SYS1,SYS2))

IMS Tools

Affinity Routing Statistics – System View

IMS Tools

Affinity Routing Statistics – Update System

IMS Tools

Affinity Routing Statistics – Add System

IMS Tools

Affinity Routing Statistics – Destination View

IMS Tools

Affinity Routing Statistics – Destination View

IMS Tools

Affinity Routing Statistics – Update Destination

IMS Tools

Affinity Routing Statistics – Add Destination

IMS Tools

SQ buffer overflow protection

IMS Tools

SQ overflow protection

• What does it do?

– Protect IMS control region from x37 abends (out of storage) caused by run-away/looping applications

• Features

– Inactive mode – turn off overflow protection feature (default)

– Report mode – help customers study local buffer usage

– Enforce mode – automatic actions against incoming messages to avoid local buffer out of storage condition

• What does it NOT do?

– Overflow protection against SQ structure overflow

• Delivered via SPE PK84154/UK49281

IMS Tools

Implementation Details

• Exploit Queue Space Notification Exit DFSQSSP0

– SM exit does not interfere with dynamic buffer expansion/compressions by IMS

– Terminates unit of work as follows:

� ‘A7’ status code if message is from application

� DFS0777I if message from LU 6.2 conversation

� DFS1289I if message is from OTMA

• Requirements

– IMS QBUFMAX parameter must be set for Enforce mode

– Require IMS Tools Generic Exits common code to allow co-existence of multiple DFSQSSP0 exits

IMS Tools

Implementation Details (Cont)

• Proclib member control parameters:

– LBUFMODE= INACTIVE| REPORT|ENFORCE

� specifies requested run mode

– LBUFREPT=(InitialValue,BufferPctIncrement,BufferNoIncrement,TimeInterval

� specifies REPORT mode parameters

– LBUFWARN=(InitialValue,BufferPctIncrement,BufferNoIncrement,TimeInterva

� specifies ENFORCE mode parameters for WARNING mode

– LBUFACTN=(InitialValue,BufferPctIncrement,BufferNoIncrement,TimeInterval

� specifies ENFORCE mode parameters for ACTION mode

– LBUFCRIT=(InitialValue,BufferPctIncrement,BufferNoIncrement,TimeInterval)

� specifies ENFORCE mode parameters for CRITICAL mode

– LBUFLBUA= ###

� specifies no of buffers a caller must hold to be considered a large user in action mode. The exit will take actions against large user’s only.

– LBUFLBUC= ####

� specifies no of buffers a caller must hold to be considered a large user in critical mode. The exit will take actions against large user’s only.

IMS Tools

Sample Messages

• Report Mode (2 minutes interval reporting)

– 07.45.10 JOB00123 GJE9010I DFSQSSP0 REPORT MODE: 22 BUF 11 PCT IMS1

• Large buffer users (periodic messages):

– 08.22.08 JOB00191 GJE9050I DFSQSSP0 LARGE USER: 17 BUF FOR BMP255 IMS1

– 08.22.08 JOB00191 GJE9050I DFSQSSP0 LARGE USER: 12 BUF FOR BMP255 IMS1

• Warning Level

– 08.31.20 JOB00191 GJE9020I DFSQSSP0 WARNING MODE: 26 BUF 13 PCT IMS1

• Action Level

– 08.22.48 JOB00191 GJE9030I DFSQSSP0 ACTION MODE: 151 BUF 76 PCT IMS1

– 08.24.48 JOB00191 GJE9030I DFSQSSP0 ACTION MODE: 158 BUF 79 PCT IMS1

• Critical Level

– 23.01.19 JOB00173 GJE9040I DFSQSSP0 CRITICAL MODE: 179 BUF 90 PCT IMS1

– 23.02.19 JOB00173 GJE9040I DFSQSSP0 CRITICAL MODE: 180 BUF 90 PCT IMS1

IMS Tools

Managing CSL RM Structure

IMS Tools

Managing CSL RM Structure

• Common Service Layer RM Structure Content

– Holds global status of IMS Resources in IMSPlex

– Determines IMSPlex wide status of Trans, LTERMs, Users

– No capability to view content

– No capability to alter/delete inconsistently defined resources

• Resource Management Structure display

– Real-time display of structure content

– Selectable via resource type and name filtering

– Global status info to aid delete decision

– Capability to delete selected resource definitions (multiple delete, delete by resource type or by owner)

– Eliminates need to scratch and reallocate resource structure

IMS Tools

IMS Resource Structure Content

IMS Tools

Other Product Use Scenarios

IMS Tools

Scenarios

• IMS

– Scenario 1 – Taking Inventory and capture diagnostic data

– Scenario 2 – Managing IMS System Parameters

– Scenario 3 – Verifying IMS Resource Definitions

– Scenario 4 – Issuing IMS Commands

– Scenario 5 – Maintaining Command Audit Trail

– Scenario 6 – Managing Dependent Regions

– Scenario 7 – Viewing IMS CF Structures

• IMSplex

– Scenario 9 – Viewing Aggregate SCI, RM, OM Statistics

• Shared Queue and CQS

– Scenario 10 - View local buffer utilization

– Scenario 11 – Managing Destination Queue Depth

– Scenario 12 – Viewing CQS Structures

• Dashboard

– Scenario 13 – Dashboard and Thresholds

IMS Tools

Scenario 1 – Taking Inventory and Capture Diagnostics

• Many address spaces – IMS Control Region, IMS DLI/SAS, IMS DBRC, IRLM, CQS, RM, OM, SCI, etc..

– How do you identify related IMS components across the Sysplex?

– What is the status of these components?

– What version of IMS components are involved?

– How much resource are they using from z/OS perspective?

– How do you collect diagnostic data to debug sysplex problem?

• IMS Sysplex Manger structured TSO/ISPF interface – Guided display of IMS components

– Provides component id, task or job name, version, status and basic z/OS information such as CPU time and EXCP counts

– Drill-down to detailed component information

– Easily capture console dumps for IMS components across the plex

– Check DBRC RECON datasets placement and VSAM stats

IMS Tools

Component List

IMS Tools

Component List (cont)

IMS Tools

Capture Console Dumps

IMS Tools

Capture IMS CF structures Dump

IMS Tools

z/OS perspective for IMS address spaces

IMS Tools

DBRC RECON datasets and VSAM stats

• Show RECON datasets placement (COPY1, COPY2, SPARE) for all IMS systems

• Built-in LISTCAT for RECONs when drill down

IMS Tools

DBRC RECON VSAM stats

IMS Tools

Scenario 2 – Managing IMS System Parameters

• Many system run-time parameters

– Sources: DFSPBxxx, overrides via Control Region PARM=

– Which ones are being used?

– Are the parameters the same across the Sysplex?

• System parameter display

– Real-time scrollable display of “resolved” values

– Parameter values across all IMS systems for easy comparison

– New – System Parameter Tutor for instant description

IMS Tools

IMS System Parameters

IMS Tools

IMS System Parameters

IMS Tools

IMS System Parameters – Showing Unequal Parms

IMS Tools

IMS System Parameters – Tutor

IMS Tools

Scenario 3 – Verifying IMS Resource Definitions

• Resource definitions – Transactions, Programs, Data Bases, Nodes, LTERMS, etc.

– Are the definitions the same across the Sysplex?

– What is the resource status across the Sysplex?

– How do you alter the status across the Sysplex?

• Resource definition display – Query resource by status or attribute

– Real-time scrollable display of resources

– Resource attributes and status across all IMS systems for easy comparison

– Integrated IMS Type 1 command interface to alter resource status

– Ability to drill-down to related resource (from transaction to PSB, from PSB to databases… )

IMS Tools

IMS Resource Definitions – Filter Specification

IMS Tools

IMS Resource Definitions – Drill-down to PSB

IMS Tools

IMS Resource Definitions – Drill-down to Database

IMS Tools

IMS Resource Definitions – Databases for a PSB

IMS Tools

IMS Resource Definitions – Manage Transactions

IMS Tools

IMS Resource Definitions – Manage Transactions

IMS Tools

Scenario 4 – Issuing IMS Commands

• Issue Type 1 command to all IMS systems

– Display same resource type across Sysplex

– Alter resource status across Sysplex

• Command issued to each IMS system

– Output recorded to command file and logged history file

– ISPF Browse(view) used to display result

– Scrollable, Primary and line commands (find, exclude, etc.)

– Retrievable list of previously entered commands

IMS Tools

IMS Commands

IMS Tools

IMS Commands – Type-1

IMS Tools

IMS Commands – Type-2

IMS Tools

Scenario 5 – Maintaining command Audit Trail

• Keeping track of operations of your IMS systems

– Need for audit trail?

– Easy way of viewing IMS commands & system messages?

– Automatic archive of audit log?

• Sysplex Manager with its history datasets

– Log most type-1 IMS commands, command responses and MTO messages from all IMS images regardless of origins (z/OS console, terminal, OTMA, AOI programs using CMD or ICMD interface)

– Log OM processed command and output

– Searchable, filterable online viewing of log data using ISPF dialog

– Automatic archive for full history dataset

– Archive Directory to assist locating archived data

– Issue type-1 and type-2 IMS commands while viewing log data (similar to z/OS SDSF)

– Check SM History datasets status

IMS Tools

Command Audit Trail

IMS Tools

Command Audit Trail

IMS Tools

SM History database status and usage

• Up to 8 VSAM Linear datasets make up SM history database

• Used in a circular fashion similar to IMS OLDS

• Automatic archive process to save full datasets to user-defined output location

• Directory to help users keep track of archive output

• Real-time information on status of these history datasets

IMS Tools

View and retrieve archive datasets

• Locate which archive dataset has the info you need

• Browse the archive dataset instantly

IMS Tools

Scenario 6 – Managing Dependent Regions

• Transaction workload back-logged

– What dependent regions are available?

– What transaction classes do they handle?

– Are they occupied with work?

– What are they doing?

• Scrollable list of all dependent regions across Sysplex

– Enhanced IMS /DISPLAY ACTIVE REG

– Displays overall DL/I DB/TM call counts

– Sort the lock held column to see which reg holds the most locks

– Resequenced by primary or secondary classes

– Drill down to lower level of detail

IMS Tools

Dependent Region Display

IMS Tools

Scenario 7 – Viewing IMS CF Structures

• Growing use of Coupling Facility Structures

– Data Sharing, Shared Message Queues, Resource Manager

– No single source for list of in use structures and details

• Coupling Facility Structure display

– Real-time display of structure list

– Statistics, Connections, Coupling Facility information

IMS Tools

IMS Coupling Facility Structures

IMS Tools

Scenarios

• IMS

– Scenario 4– Issuing IMS Commands

• IMSplex

• Dashboard

IMS Tools

Scenario 8 – Aggregated SCI, RM, OM Statistics

• Managing the well being of Common Service Layer (CSL)

address spaces

– Lack of tools to obtain CSL statistical information

– Multiple instances to check

• Information gathered from CSL address spaces across Sysplex

– Aggregated into single system image

– Drill down for information from individual address space

IMS Tools

Aggregated RM Statistics

IMS Tools

Scenarios

• IMS

• IMSplex

• Dashboard

IMS Tools

Scenario 9 - SQ local buffer utilization

IMS Tools

Scenario 10 – Destination Queue Depth

• Managing Destination Queue Depth & CQS for Shared Queues

– Limited tools to browse, delete and recover messages on Shared Queues

– Lack of tools to obtain CQS statistical information and manage messages on Shared Queues

– Required to optimize Shared Queues environment

• DQD data & List of Shared Queue Structures in use

– Filter based on Destination name or ID

– High level information, Drill down to levels of detail

– Browse, Delete and Recover messages from Cold queue

– Statistics for: structure, rebuild, checkpoint

– CQS processing counters

IMS Tools

Destination Queue Depth

IMS Tools

Scenario 11 - CQS Shared Message Queues

IMS Tools

CQS Shared Message Queues

IMS Tools

Scenarios

• IMS

• IMSplex

• Dashboard

IMS Tools

Scenario 12 – Dashboard Sysplex at a Glance

• Managing the IMS Sysplex through key system indicators

– Determine overall Sysplex health at a Glance

– Alert when indicators violate predefined thresholds

– Set multiple monitoring thresholds depending on workloads, time of day…

• Critical data from key areas summarized on one or more screens

– User customized content, positioning, threshold value

– Threshold exceptions are logged for future review

– One or more per user, default supplied

– Automatic screen refresh capability for operational ease

– Drill down for additional detail

IMS Tools

Configure Your Dashboard

• Create and customize a new dashboard

IMS Tools

When to monitor

• Define monitoring periods

IMS Tools

Low and High Thresholds

• Define threshold values

IMS Tools

Threshold Processing Interval

• Set dashboard data collection interval

IMS Tools

Dashboard

IMS Tools

Dashboard – Drill Down

IMS Tools

References

• For publications and demo, visit IMS Sysplex Manager for z/OS

– http://www-306.ibm.com/software/data/db2imstools/imstools-library.html

IMS Tools

Contact information

• Andy Nguyen

• E-mail address: adn@us.ibm.com

IMS Sysplex Manager Functional Overview - IMS UG August 2012 Sao Paulo

Technology

IMS Performance Hints and Tips - IMS UG August 2012 Sao Paulo

Security Server (RACF) Planning: Installation and Migration · DFSMS DFSMS/MVS IBM IBMLink IMS Library Reader MVS MVS/ESA MVS/XA NetView OpenEdition OS/2 OS/390 Parallel Sysplex RACF

Exploiting Parallel Sysplex: A Real Customer Perspective · Adabas data sharing guideline ... vi Exploiting Parallel Sysplex: A Real Customer ... 4 Exploiting Parallel Sysplex: A

IBM z/OS V2R2: Sysplex · 2015-12-16 · x IBM z/OS V2R2: Sysplex Mark Brooks (z/OS Sysplex Design and Development, Poughkeepsie Center) for offering valuable advice and guidance

IMS Parallel Sysplex Best Practices - IMS UG May 2013 Stockholm

Sysplex Networking Technology Overview - SHARE · Sysplex Networking Technology Overview Thursday, August 5, ... PPRC Application A CEC-1 ... capability to coordinate the assignment

Parallel Sysplex Performance Topics

IMS Parallel Sysplex Best Practices

IBM Systems - uni-leipzig.de · 2012-04-25 · IMS InfoPrint* Language Environment* Multiprise* MVS NetView* OMEGAMON* OS/390* Parallel Sysplex* PR/SM Processor Resource/Systems Manager

Sysplex: Windows MultiPoint Server 2011

IMS Parallel Sysplex Best Practices - IMS UG May 2013 Oslo

Parallel Sysplex Overview: Introducing Data Sharing and ...largescalecomputing.wikispaces.com/file/view/IBM+sysplex+overview.… · Introducing Data Sharing and ParallelisminaSysplex

1 SYSPLEX By : Seyed Hamid Alvani December 2003. 2 Overview System/390 History Introduction to Sysplex What is Sysplex ? Why Sysplex ? Sysplex Philosophy

Front cover IMS in the Parallel Sysplex - IBM Redbooks · ibm.com/redbooks Front cover IMS in the Parallel Sysplex Volume III: IMSplex Implementation and Operations Jouko Jantti Juan

Ims09 ims in a sysplex environment - challanges and solutions - IMS UG May 2014 Sydney & Melbourne

Sysplex and Network Technologies and Considerations (Summer 2013) · 2013-08-10 · Sysplex Networking Technologies and Considerations Gus Kassimis - kassimis@us.ibm.com IBM Enterprise

IMS Performance Tools 2012 Update - IMS UG August 2012 Sao Paulo

Sysplex in a Nutshell

IMS Sysplex Manager

IMS Version 8 Sysplex Terminal Management - lightyr.comlightyr.com/presentations/SysplexTerminalManagement.pdf · IMS Version 8 Sysplex Terminal Management ... BTAM and OTMA resources