52
© Copyright 2019 INNOVATION Data Processing. All rights reserved. “The users are delighted with the 64 bit overrides the CICS sysprog put in place – 5X Transactions with minimal additional overhead.” - A Group Medical Insurance Company, MARCH 2019 As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern Mainframe Advances

As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

“The users are delighted with the 64 bit overrides the CICS sysprog put in place – 5X Transactions with minimal additional overhead.” - A Group Medical Insurance Company, MARCH 2019

As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern Mainframe Advances

Page 2: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Modernizing COBOL/VSAM to Build

z13/14 Data-in-Memory

Applications and Ensuring

Continuous Data Availability

Using Innovation Data Processing’s IAM as a

VSAM Replacement to Significantly Reduce Costs

and Improve Batch and CICS Performance

Page 3: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

VSAM KSDS File Structure

2

250 314

420420

420 980

980

950675 980

400 420

505 675

944 945 950

Index Set Level

To other index set nodes

Index Set Level

To other sequence set nodesSequence Set

Index Area

980

Control Area 1 Control Area 2 Control Area 3

2

1

3

Data Storage Area

Page 4: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Prime Data Area

IAM File StructureSelf-Contained Sequential File

Entire Compressed

Index is Loaded

Into 64 Bit Storage

Eliminating All

Index I/O

Inserted Records Go

Into the Extended

Overflow Without any

CI/CA Split Overhead

Data is Formatted

Into Quarter, Third or

Half Track Blocks

An IAM File is ‘Self

Describing’ –

Blocksize, LRECL,

Overrides, etc.Rec1…

Rec2…

Rec3…

Control Information

Index

Extended

Overflow

Extended

PE

3

Page 5: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM File Structure

• Designed to provide the highest level of

both file and data integrity

• Prime index structure will never be updated,

minimizing the need to update other file

structure information

• Methodology of “adding” to the existing

structure, as opposed to “modifying” the

existing file structure (VSAM)

Expandable, non-destructible file structure that provides an outstanding

level of performance and responsiveness.

Prime Data Area

Control Information

Index

Extended

Overflow

Extended

PE

4

Page 6: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Original VSAM DEFINE

//DEFINE EXEC PGM=IDCAMS

//SYSPRINT DD SYSOUT=*

//SYSIN DD *

DEFINE CLUSTER -

(NAME(EXAMPLEl.DATASET)-

VOLUMES(VOL00l)-

CYL(l0 1) -

ADD --> OWNER($IAM) - <-- ADD

SPEED REUSE ) -

DATA( -

NAME(EXAMPLE.DATASET.DATA)-

RECORDSIZE(200 256) -

KEYS(16 0) -

CISZ(4096) -

FREESPACE(10 10) ) -

INDEX(1024) -

LISTCAT ENT(EXAMPLEl.DATASET)ALL

/*

Converting a VSAM File to IAM

5

IAM DEFINE

//DEFINE EXEC PGM=IDCAMS

//SYSPRINT DD SYSOUT=*

//SYSIN DD *

DEFINE CLUSTER -

(NAME(EXAMPLEl.DATASET)-

VOLUMES(VOL00l)-

CYL(l0 1) -

SPEED REUSE ) -

DATA( -

NAME(EXAMPLE.DATASET.DATA)-

RECORDSIZE(200 256) -

KEYS(16 0) -

CISZ(4096) -

FREESPACE(10 10) ) -

INDEX(1024) -

LISTCAT ENT(EXAMPLEl.DATASET)ALL

/*

Page 7: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

VSAM Usage ReportDEVICE TYPE.......3390 VSAM CYLINDERS.......829365

0 TOTAL DISK EXCPS.......1425936862 VSAM EXCPS........709269673

1IAM400 SMF DATASET REPORT PROGRAM - IAMSMFVS VER 9.3/00P SPIN LEVEL 00 - INNOVATION DATA PROCESSING DATE - 2018.102 PAGE - 002

0

0 VSAM EXCP REPORT

% CLUSTER TOTAL SPLITS ALLOC

DATA SET NAME EXCPS EXCPS RECORDS READS INSERTS UPDATES DELETES CI CA TRKS

---- --- ---- ----- ----- ------- ----- ------- ------- ------- -- -- ----

0PRODFI.VSAM.DAF.MSTR.AH05 100 96025289

PRODFI.VSAM.DAF.MSTR.AH05.INDEX 54 51637166 73267 0 0 21927 0 1245 234 6750

PRODFI.VSAM.DAF.MSTR.AH05.DATA 46 44388123 295451301 9307216862 2758365 1664987 211012 7333 1245 604504

PRODFI.VSAM.DAF.MSTR.AH05 100 31327266

PRODFI.VSAM.DAF.MSTR.AH05.DATA 81 25522483 295451275 634899983 0 0 0 0 0 496500

PRODFI.VSAM.DAF.MSTR.AH05.INDEX 19 5804783 32026 0 0 0 0 0 0 3750

PRODFI.VSAM.DAF.MSTR.AH05 100 29739252

PRODFI.VSAM.DAF.MSTR.AH05.DATA 54 16075637 295451366 1341046933 91 0 0 5 2 1125

PRODFI.VSAM.DAF.MSTR.AH05.INDEX 46 13663615 61230 0 0 11 0 2 1 6750

PRODFI.VSAMTR.TRKHIS0 100 24068662

PRODFI.VSAMTR.TRKHIS0.DATA 86 20630907 30358194 693126275 16379 16454 15 5321 14 12000

PRODFI.VSAMTR.TRKHIS0.INDEX 14 3437755 138449 0 0 5704 0 14 14 555

PRODFI.VSAMTR.TRKHIS2 100 23628770

PRODFI.VSAMTR.TRKHIS2.DATA 86 20268223 30214677 689570789 17298 17724 82 5436 25 48000

PRODFI.VSAMTR.TRKHIS2.INDEX 14 3360547 134429 0 0 5850 0 25 23 1200

PRODFI.VSAMTR.TRKHIS1 100 23438069

PRODFI.VSAMTR.TRKHIS1.DATA 86 20054530 30357501 688815304 16771 17045 32 5530 14 12000

PRODFI.VSAMTR.TRKHIS1.INDEX 14 3383539 135324 0 0 5891 0 14 11 810

PRODFI.VSAMTR.CLPROD 100 23056649

PRODFI.VSAMTR.CLPROD.DATA 92 21134710 9050881 210034421 2644 228969 245 20 2 22500

PRODFI.VSAMTR.CLPROD.INDEX 8 1921939 22201 0 0 24 0 2 0 12000

PRODFI.VSAM.DAF.MSTR.FUND 100 18580267

PRODFI.VSAM.DAF.MSTR.FUND.DATA 54 9994596 31449035 6998633237 7937 195391 0 323 17 133504

PRODFI.VSAM.DAF.MSTR.FUND.INDEX 46 8585671 16494 0 0 369 0 17 6 1350

PRODFI.PZRORPGM.FINEXT.RPFILE 100 17417737

PRDFI.PZRORPGM.FINEXT.RPTFILE.INDEX 100 17416044 10 0 0 0 0 0 0 75

PRDFI.PZRORPGM.FINEXT.RPTFILE.DATA 0 1693 62310 161966 0 0 0 0 0 1500

PRODFI.VSAMTR.DIRECT 100 16447818

PRODFI.VSAMTR.DIRECT.DATA 70 11594583 4043529 21764700 922 964 608 353 2 36000

PRODFI.VSAMTR.DIRECT.INDEX 30 4853235 2381 0 0 372 0 2 2 900

PRODFI.DOL.OB3VSAM.ENTRIES 100 12604288

PRDFI.D12.OBSVSAM.ENTRIES.INDEX 86 10867466 104 0 0 0 0 0 0 75

PRDFI.D12.OBSVSAM.ENTRIES.DATA 14 1736822 27446 5415300 0 0 0 0 0 525

6

50% of Total I/O is VSAM

53% of all VSAM I/O is in

the Top 15 Files

Great Candidate for

Dynamic Reorg

(While Open For

Update in CICS)

CI/CA Splits Are

Eliminated with IAM

Page 8: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Single-Frame IBM z14 Model ZR1 Benefits IBM Z Organizations of All Sizes

May 2018 | by Suzanne Battenfeld, Ellen Carbarnes

Cloud-Ready Capabilities

“The z14 ZR1 offers up to 8 TB maximum available memory. This large memory can be used to support new workloads, data-in-memory applications and larger local buffer pools. It can efficiently process huge amounts of information for faster business insights.”

7

AS SEEN IN

IBM Systems Magazine

Page 9: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM – Using IBM’s z13/14 Large Memory Strategy/ 64 Bit Buffering in CICS Addressing Today’s Concerns

• 91% reduction in Transaction Wait Time

• Significant reduction in Transaction Elapsed Time

• Much improved Transaction Throughput

• Easily handle increased transaction demand from Web and Mobile

• 10 to 20% reduction in CICS MSUs / MLC

• Eliminate CICS Short on Storage and MAXTASK limit problems

• Continuous data availability by reorging IAM files while they are OPEN for

update in CICS. Only a few second delay is required for file transitioning

• Reduce Batch MSUs by 30% and elapsed time by 50 to 70%

• Syncsort’s recent survey said 51% of mainframe professionals plan to cut IT

costs through mainframe optimization

8

Page 10: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

MAJOR HEALTH INSURANCE COMPANY

CONVERTED THEIR CLAIMS SYSTEM TO

IAM AND INTO A DATA-IN-MEMORY

APPLICATION ON THEIR Z/13

9

Using Innovation Data Processing’s IAM as a

VSAM Replacement to Significantly Reduce Costs

and Improve Batch and CICS Performance

Page 11: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Very Active IAM Files Using From 30 to 700 Meg Per File

Storage used for each file is constantly adjusted to the current volume of I/O activity

IAM – Using IBM’s z13/14 Large Memory Strategy/64 Bit Buffering in CICS

0

200

400

600

800

VSMF1IAMF1

VSMF2IAMF2

VSMF3IAMF3

VSMF4IAMF4

Storage in

Megabytes

VSAM vs. IAM Files - 13:00

10

Page 12: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

11

Significant Mainframe Cost Savings with IAM and CICS Code Modernization

Modernizing a Claims Application by Using CICS Threadsafe Programming

and IAM With 64 Bit Buffering

Key Benefits

• Eliminated the need for expensive processor upgrades

• Remained at about the same MSU level for at least two years

• Significantly reduced MSUs, File I/O’s, Transaction Residency, Wait and

Response Time across all shifts

• Batch MSUs were reduced by an average of almost 20% across all shifts

• Eliminated situations such as CICS engine saturation, memory shortages and

transaction throughput-related issues

Page 13: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Significant Mainframe Cost Savings with IAM and CICS Code Modernization

Modernizing a Claims Application by Using CICS Threadsafe Programming

and IAM With 64 Bit Buffering

Key Benefits

• Moved daily peak MSU consumption from prime shift to third shift

• IAM used 64-bit storage to exploit additional z13/14 memory and kept very

large amounts of each file in storage (following IBM’s z13/14 Large

Memory Strategy)

Now implementing IAM Dynamic Reorg to extract point-in-time, non-fuzzy

backups from CICS six times per day

12

Page 14: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

CICS Online – Prime Shift MSU

• MSUs decreased 49% with the January code and IAM changes

• IAM changes alone decreased MSU consumption by 20%

• Transaction volume remained constantData Source- Type 110 Records (CICS) 13

Page 15: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

CICS Online – Prime Shift

• Residency decreased 55% with the January code and IAM changes

• IAM changes alone decreased Residency by 30%

• Transaction volume remained constantData Source- Type 110 Records (CICS) 14

Page 16: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

CICS Online – Prime Shift Wait

• Transaction Wait decreased 91% with IAM changes

Data Source - Type 110 Records 15

Page 17: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM Batch Results Using 64 Bit Bufferingon Random Read Access

• Buffer space went from 10 Meg with IAM 31 bit storage to 1.7 Gig with IAM 64 bit storage

• I/O’s were reduced by 50%

• Elapsed Time was reduced by 58%

• CPU Time was reduced by 17%

16

Page 18: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM Enhanced Data Set Reorganization

Dynamic REORG of IAM Files

• Provides continuous data availability for IAM data sets by allowing them to be OPEN in CICS for update while performing the IAM reorg process

High Activity Toleration (HAT) Handles File Requests During the File Transition Process

• Reads and Writes are slightly delayed

• Similar to a “CICS HANDLE CONDITION” in the program

Concurrently REORG up to 16 IAM Files in a Single JOBSTEP

• Multiple IAM data sets under either the same or different CICS region

• Each REORG is performed under a separate subtask in the JOBSTEP

17

Page 19: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

VSAM IDCAMS Reorg vs. IAM Dynamic Reorg File Request Delay Benchmark with Concurrent Processing

Environment

• Z13s

• CICS TS 5.2

• z/OS 2.2

• 50,000 track VSAM KSDS loaded with 9,000,000 records followed by a batch update of 227,000 records and the insertion of 15,000 records. The file has one alternate index.

• 25,000 track VSAM KSDS loaded with 3,000,000 records followed by a batch update of 111,000 records and the insertion of 7,200 records.

• 17,000 track VSAM KSDS loaded with 3,000,000 records followed by a batch update of 105,000 records and the insertion of 6,000 records.

18

Page 20: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

VSAM IDCAMS Reorg vs. IAM Dynamic Reorg File Request Delay Benchmark with Concurrent Processing

Process

• Tests were run on these files to demonstrate how long the file requests would be delayed by the IAM Dynamic Reorg HAT (High Activity Toleration) process and to measure the Elapsed and CPU Time

• Reorg three VSAM files using IDCAMS REPRO running three separate jobs simultaneously. The files are unavailable to CICS for the entire duration

• Reorg the three IAM files in one JOBSTEP using IAM Dynamic Reorg while it is open for update in CICS. File request delay time is limited to only a few seconds

19

Page 21: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

VSAM IDCAMS Reorg vs. IAM Dynamic ReorgElapsed Time File Is Not Available to CICS

0

200

400

600

800

1000

Elapsed Time in Seconds

869

77

2

VSAM IDCAMS

IAM Dynamic ReorgWhile Closed to CICS

IAM Dynamic ReorgWhile Open to CICSAccess Delayed by

14 Minutes & 29 Seconds

1 Minute & 17 Seconds

2 Seconds

20

Page 22: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

VSAM IDCAMS Reorg vs. IAM Dynamic ReorgCPU Time

0

50

100

150

200

250

300

CPU Time in Seconds

287

22

VSAM IDCAMS

IAM Dynamic Reorg

* IAM Dynamic

Reorg used 93%

less CPU Time

than the VSAM

IDCAMS Reorg

21

Page 23: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM Dynamic REORG Takes Just Seconds to Complete

06:07:19:4834 COMMAND: REORG FROM=IAMCICSV.CICSBIQA.IVTK6,

06:07:19:4834 COMMAND: TO=IAMCICSV.CICSBIQA.IVTK6.NEW,

06:07:19:4834 COMMAND: STORCLAS=EUSCS03,

06:07:19:4834 COMMAND: CICS=CICSBIQA,

06:07:19:4835 COMMAND: SAVESFX=YYYYDDD

06:07:19:5499 INPUT DSN: IAMCICSV.CICSBIQA.IVTK6

06:07:19:5499 OUTPUT DSN: IAMCICSV.CICSBIQA.IVTK6.NEW

06:07:19:5499 RENAME REQUESTED: IAMCICSV.CICSBIQA.IVTK6.D2018354

06:07:19:5499 CICS REGION: CICSBIQA

06:08:16:6271 IAM DYNAMIC REORG SUBTASK ENDS. HIGHEST RC=00000000

06:07:19:4835 COMMAND: REORG FROM=IAMCICSV.CICSBIQA.IVTK7,

06:07:19:4835 COMMAND: TO=IAMCICSV.CICSBIQA.IVTK7.NEW,

06:07:19:4835 COMMAND: STORCLAS=EUSCS03,

06:07:19:4835 COMMAND: CICS=CICSBIQA,

06:07:19:4836 COMMAND: SAVESFX=YYYYDDD

06:07:19:5434 INPUT DSN: IAMCICSV.CICSBIQA.IVTK7

06:07:19:5434 OUTPUT DSN: IAMCICSV.CICSBIQA.IVTK7.NEW

06:07:19:5434 RENAME REQUESTED: IAMCICSV.CICSBIQA.IVTK7.D2018354

06:07:19:5434 CICS REGION: CICSBIQA

06:08:17:3695 IAM DYNAMIC REORG SUBTASK ENDS. HIGHEST RC=00000000

06:07:19:4836 COMMAND: REORG FROM=IAMCICSV.CICSBIQA.IVTK8,

06:0: TO=IAMCICSV.CICSBIQA.IVTK8.NEW,

06:07:19:4836 COMMAND: STORCLAS=EUSCS037:19:4836 COMMAND,

06:07:19:4836 COMMAND: CICS=CICSBIQA,

06:07:19:4836 COMMAND: SAVESFX=YYYYDDD

06:07:19:5313 INPUT DSN: IAMCICSV.CICSBIQA.IVTK8

06:07:19:5313 OUTPUT DSN: IAMCICSV.CICSBIQA.IVTK8.NEW

06:07:19:5313 RENAME REQUESTED: IAMCICSV.CICSBIQA.IVTK8.D2018354

06:07:19:5313 CICS REGION: CICSBIQA

06:08:18:3852 IAM DYNAMIC REORG SUBTASK ENDS. HIGHEST RC=00000000

06:07:19:4837 COMMAND: REORG FROM=IAMCICSV.CICSBIQA.IVTK9,

06:07:19:4837 COMMAND: TO=IAMCICSV.CICSBIQA.IVTK9.NEW,

06:07:19:4837 COMMAND: STORCLAS=EUSCS03,

06:07:19:4838 COMMAND: CICS=CICSBIQA,

06:07:19:4838 COMMAND: SAVESFX=YYYYDDD

06:07:19:5227 INPUT DSN: IAMCICSV.CICSBIQA.IVTK9

06:07:19:5227 OUTPUT DSN: IAMCICSV.CICSBIQA.IVTK9.NEW

06:07:19:5227 RENAME REQUESTED: IAMCICSV.CICSBIQA.IVTK9.D2018354

06:07:19:5227 CICS REGION: CICSBIQA

06:08:22:0625 IAM DYNAMIC REORG SUBTASK ENDS. HIGHEST RC=00000000

4 VSAM Data Sets reorganized concurrently in 63 seconds with IAM Dynamic REORG

22

Page 24: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

PROTECTING DATA AND EXTRACTING

NON-FUZZY, POINT-IN-TIME IAM BACKUPS

FROM ACTIVE CICS REGIONS

23

Using IAM, Dynamic Reorg/Backup and FDR Backup Utilities

to Keep Mission Critical Data Current and Safe From Vulnerabilities

Storing & Managing Backups Securely on Offline DASD

Page 25: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

The Process

IAM Dynamic Reorg

• High-speed, low-overhead reorg and backup for IAM files while they are open for update in CICS

FDRINSTANT Backups

• Create instant, offline and secure duplicate copies of your DASD volumes containing IAM Dynamic Reorg backup files

• FDRINSTANT disables the volume to avoid the possibility of it being brought back online accidentally

• FDRCOPY uses FDRINSTANT to restore IAM backup files directly from offline volumes

FDR Backups

• Run FDR full volume and incremental backups against these offline duplicate volumes

24

Page 26: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Protecting Data Using IAM Dynamic Reorg and Backup with FDRINSTANT to Produce Gold, Secure Offline Backups

FDRINSTANT is used to produce secure, OFFLINE duplicates of active ONLINE IAM Files and then (optionally) dump the OFFLINE volumes to tape storage.

A 50,000 TRK file can be backed up and copied OFFLINE in 10 seconds

25

Page 27: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

USING FDRINSTANT TO PRODUCE

SECURE, OFFLINE DUPLICATES OF

IAM BACKUP FILES

26

Using IAM, Dynamic Reorg/Backup and FDR Backup Utilities

to Keep Mission Critical Data Current and Safe From Vulnerabilities

Storing & Managing Backups Securely on Offline DASD

Page 28: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

FDRINSTANT Disables the Volume So It Can’t Accidentally Be Brought Online

Command:

• V 8095,ONLINE

System Response:

• IEF008I DASD DEVICE 8095 NOT VARIED ONLINE –VOLUME SERIAL NOT VALID

8095

Offline &

Disabled

27

Page 29: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

FDRINSTANT Advantages Over Standard Backup Facilities

• FDRINSTANT uses DASD Fast Replication

• Works with backup volumes in their offline, disabled state

• Accesses the offline data directly across the channel

• Eliminates problems with duplicate volsers and the potential for VTOC/VVDS and Catalog discrepancies

• Data remains immediately accessible but still secure.

28

Page 30: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Using FDRCOPY to Restore Offline Duplicate Copies of IAM Files

FDRINSTANT enhances FDRCOPY

• FDRCOPY with FDRINSTANT uses DASD Fast Replication for restores

• Does not use the standard channel I/O

• Allows the restoring of data sets from offline volumes without the need to vary them online and restores them to online volumes in less than 1 second.

29

Page 31: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

FDRCOPY Using FDRINSTANT to Restore 4 Data Sets From Offline Volumes

IEF403I FDRRESTO - STARTED - TIME=13.28.02

- -----TIMINGS (MINS.)------

-STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK

-RESTOFFL 00 521 835 .00 .00 .0

IEF404I FDRRESTO - ENDED - TIME=13.28.02

-FDRRESTO ENDED. NAME-XTRHZB TOTAL TCB CPU TIME= 0.00

$HASP395 FDRRESTO ENDED - RC=0000

4 VSAM Data Seats restored from offline, disabled backup volumes in less than 1 second with FDRCOPY using FDRINSTANT

30

Page 32: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

FDRINSTANT Backup Performance Statistics For Two Volumes

IEF403I FDRINSTB - STARTED - TIME=13.02.41

-----TIMINGS (MINS.)------

-STEPNAME PROCSTEP RC EXCP CONN TCB SRB CLOCK

-FCOPY 00 218 70 .00 00 .0

IEF404I FDRINSTB ENDED - TIME=13.02.41

-FDRINSTB ENDED. NAME-XTRHZB TOTAL TCB CPU TIME= .00

$HASP395 FDRINSTB ENDED -RC=0000

4 VSAM Data Sets on 2 volumes replicated to 2 offline volumes in less than 1 second

31

Page 33: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

FDR WITH FDRINSTANT CAN BE USED

TO COPY OFFLINE DUPLICATES OF

IAM BACKUP FILES TO TAPE

32

Using IAM, Dynamic Reorg/Backup and FDR Backup Utilities

to Keep Mission Critical Data Current and Safe From Vulnerabilities

Storing & Managing Backups Securely on Offline DASD

Page 34: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

8095

Offline &

Disabled

FDRCOPY

Restore Data

Sets From Offline

Copies in Less

Than 1 Second

FDR

Invoking

FDRINSTANT

For the Offline

Volume Backup

Tape

Backup

Data on Volumes in Offline and Disabled States Can

Only Be Accessed By Restores and Backups That

Invoke FDRINSTANT

33

Page 35: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM vs. VSAM on a Long Running JOBSTEP Processing a Large File in an ATM Software Package

0

50

100

150

200

250224

37

8.6

VSAM

IAM With HardwareCompression

IAM With SoftwareCompression

37 Minutes

Elapsed Time in Minutes

3 Hours and 44 Minutes

37 Minutes

8.6 Minutes

34

Page 36: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM vs. VSAM on a Long Running JOBSTEP Processing a Large File in an ATM Software Package

0

500

1000

1500

2000 1798

208198

VSAM

IAM With HardwareCompression

IAM With SoftwareCompression

Total I/O’s in Thousands

35

Page 37: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM vs. VSAM on a JOBSTEP Processing a Large File in an ATM Software Package

0

10

20

30

40

39.7

108.8

VSAM

IAM With HardwareCompression

IAM With SoftwareCompression

Elapsed Time in Minutes

39.7 Minutes

10 Minutes

8.8 Minutes

36

Page 38: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM vs. VSAM on a JOBSTEP Processing a Large File in an ATM Software Package

0

2

4

6

8

10

12

1413.1

13

9.6VSAM

IAM With HardwareCompression

IAM With SoftwareCompression

Total MSUs

37

Page 39: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM vs. VSAM on a JOBSTEP Processing a Large File in an ATM Software Package

0

500

1000

1500

2000 1652

4347

VSAM

IAM With HardwareCompression

IAM With SoftwareCompression

Total I/O’s in Thousands

38

Page 40: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Buffer Retrieval Percentage Increases

as 64 Bit Buffers Are Added

64 Bit Buffering in CICS at a Large Medical Testing Company

39

Page 41: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM Record Level Sharing

IAM/Plex

• Cross LPAR Record Level Sharing

IAMRLS

• Cross region Record Level Sharing

• No batch program changes required

• Files do not have to be recoverable

• SYNCPOINTS can be done in JCL or a static commit count can be hard-coded

Local RLS

• Normal IAM functionality for single CICS regions and batch jobs without using the IAMRLS address space

• Locks on each record rather than the CI (VSAM) for better performance

• Eliminates CI deadlocks that can occur when locking at the CI level causing “File Status 93” errors

40

Page 42: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM to IAM/RLS - VSAM to VSAM/RLS System Resource Utilization Benchmark Comparison in CICS

Environment

• z13s processor

• CICS TS 5.2

• z/OS 2.2

• 63,897 Transactions in a simulated test run in a 1.5 hour time period

Tests were run on a single LPAR with a weighted emphasis on Inserting/Updating records to exploit IAM’s “ADD TO” file structure efficiency over VSAM’s “MODIFY” file structure.

41

Page 43: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM to IAM/RLS vs. VSAM to VSAM/RLSCPU Overhead

0

50

100

150

200

250

300

350

CPU Seconds -> MSUs -> MLC

195

162

348

200

VSAM

IAM

VSAM/RLS

IAM/RLS

* IAM/RLS used

43% less CPU

overhead than

VSAM/RLS

42

Page 44: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM to IAM/RLS vs. VSAM to VSAM/RLSEXCP (I/O) Overhead

0

0.5

1

1.5

2

EXCPs (I/O's)

1,149k

319k

1,933k

388k

Mil

lio

ns

VSAM

IAM

VSAM/RLS

IAM/RLS

* IAM/RLS used

80% less I/O

overhead than

VSAM/RLS

43

Page 45: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM to IAM/RLS vs. VSAM to VSAM/RLSLogical I/O’s Executed Per CPU Second

0

1

2

3

4

Logical (I/O's) Executed Per CPU Second

30553677

1714

2989T

ho

us

an

ds

VSAM

IAM

VSAM/RLS

IAM/RLS

* IAM/RLS was

able to Process

74% more I/O’s

per CPU second

than VSAM/RLS

44

Page 46: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM/RLS and Transactional VSAM

Transactional VSAM

• Cost option for VSAM

• Add-on to VSAM RLS

• JCL changes required

• Program changes required (or)

• COMMIT is done and all locks are released during step termination (only practical for jobsteps doing a limited amount of updates)

• Adds overhead

45

Page 47: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM/RLS and Transactional VSAM

Transactional VSAM – Program Changes

• Add TVS file definitions

• Modify Working Storage for File Status section

• Add COMMIT fields and update counts

• In PD – Open parameter file

• Evaluate TVS return and feedback codes

• Display error codes

• Add restart logic

• Code COMMIT and BACKOUT logic with counter loop

46

Page 48: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

IAM/RLS and Transactional VSAM

IAM/RLS

• Functional equivalent to VSAM RLS

• Has built-in Transactional VSAM functionality

• No-cost option with the base IAM

• No program changes required

• COMMIT and COMMIT Count can be specified in the JCL or have a static count hard coded for no JCL changes

• Reporting facility will help determine counts

• Overhead is much less than VSAM

47

Page 49: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Summary

• IAM’s use of 64 bit storage can easily transform IAM or VSAM systems into “Storage-in-Memory” applications.

• “Storage-in-Memory” applications cost much less to run, eliminate almost all of the I/O and can significantly reduce file I/O wait time to ensure large reductions in elapsed and response time.

• IAM Dynamic Reorg and Backup is a very high-speed, low-overhead process that allows IAM files to be open for update while they are reorged, backed up or both. The process uses about 95% less elapsed and CPU time than IDCAMS with VSAM.

• IAM Dynamic Reorg uses a sophisticated High Activity Toleration (HAT) process that delays any file requests while the file transition process occurs. This takes only a few seconds and once complete, the file requests are released and processed normally.

48

Page 50: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

Summary

• IAM Dynamic Reorg Backup files are non-fuzzy, point-in-time backups that can easily be copied to secure, offline and disabled volumes using FDRINSTANT to invoke Hardware Fast Replication. This can be achieved in under 1 second regardless of file size.

• Individual data sets can be immediately restored using FDRCOPY to invoke FDRINSTANT to restore the backed up file without having to bring the volume online. Full volume and incremental backups from offline volumes are also possible using FDR and ABR.

• IAM/RLS is a no-cost option that does not require any batch program changes or the file to be defined as recoverable. It uses much less CPU overhead than VSAM/RLS.

• Syncsort’s recent survey said 51% of mainframe professionals said they plan to cut IT costs through mainframe optimization. IAM users have been optimizing the mainframe for more than 45 years.

49

Page 51: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

50

Providing a Long Line of Solutions…

INNOVATION Data Processing, a leading international provider of enterprise data protection,

business continuance and storage resource management solutions satisfying customer

business information security concerns since 1972.

Combining high performance design along with non-disruptive virtualization, easy-to-use &

extremely reliable backup, recovery, data replication & privileged information protection,

INNOVATION solutions seek to eliminate business downtime while addressing data security

concerns. By actively partnering with leading storage vendors, to ensure technological currency,

INNOVATION is the choice of thousands of enterprise customers around the world for their

business resiliency needs.

You can rely on our software solutions to be easy-to-use, efficient, reliable and are supported by

a commitment to first class technical support.

LEARN MORE: www.fdr.com

Page 52: As seen at: SHARE Phoenix 2019 Using IAM to Exploit Modern ... · update of 111,000 records and the insertion of 7,200 records. •17,000 track VSAM KSDS loaded with 3,000,000 records

© Copyright 2019 INNOVATION Data Processing. All rights reserved.

18040- 18094

Trademarks and statements

FDR, ABR, IAM, IAM/RLS, IAM Dynamic Reorg, FDRINSTANT, FDRCOPY, CLOUDVTB, and are service marks, trademarks or registered trademarks of Innovation Data Processing Corporation. EMC, DLm, SYMMETRIX, VMAX, DMX and TimeFinder are trademarks or registered trademarks of the EMC Corporation. IBM, z/OS, zEDC, ProtecTIER, zDDB, FlashCopy, CICS, z13, z14, z Systems and FICON are trademarks or registered trademarks of International Business Machines Corporation. All other service marks, trademarks or registered trademarks are the property of their respective owners.

19002 - 19007

IAM Resources: USER MANUAL: www.fdr.com/IAMum DYNAMIC REORG OF IAM DATASETS: www.fdr.com/IAMdr BEST PRACTICES: www.fdr.com/IAMbp USER EXPERIENCES SAVING MLC: www.fdr.com/IAMue ENHANCED DATASET REORGANIZATION: www.fdr.com/IAMer