23
WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012 See "Document Change History" on page 23 for a description of the changes in this version of the document IBM Advanced Technical Skills Gaithersburg, MD WP102230 at ibm.com/support/techdocs © IBM Corporation 2012

WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

  • Upload
    others

  • View
    17

  • Download
    0

Embed Size (px)

Citation preview

Page 1: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WebSphere Application Server for z/OS

z/OS V1 Release 13

Shared File SystemImpact Study

Version Date: December 3, 2012

See "Document Change History" on page 23 for a descriptionof the changes in this version of the document

IBM Advanced Technical SkillsGaithersburg, MD

WP102230 at ibm.com/support/techdocs

© IBM Corporation 2012

Page 2: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

The WAS z/OS team in ATS consists of John Hutchinson, Mike Kearney, Mike Loos, Louis Wilen, Lee-Win Tai and Don

Bagwell. Glenn Fisher manages the team.

Mike Cox, Distinguished Engineer, serves as technical consultant to all our activities.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 2 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 3: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Table of Contents

Executive Overview...............................................................................................................................4z/OS R13 Shared File System Impact Study Overview and Results..................................................5

Test environment..........................................................................................................................................6Test scenarios...............................................................................................................................................6Test results....................................................................................................................................................8Conclusion....................................................................................................................................................8

Shared File System Impact Study Details...........................................................................................9File System Information................................................................................................................................9NON-SHARED Filesystem Test..................................................................................................................10SHARED Filesystem Test...........................................................................................................................17

Document Change History..................................................................................................................23

© 2012, IBM CorporationAmericas Advanced Technical Skills - 3 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 4: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Executive OverviewIBM z/OS V1R13 provides improvements to shared file system performance in a Sysplex environment. The Advanced Technical Skills (ATS) organization in Gaithersburg, Maryland designed a test to see how well these improvements actually performed.

The test involved a WebSphere Application Server z/OS environment build across two z/OS R13 LPARs, with multiple servers and multiple servants1. In successive tests we routed SYSPRINT and SYSOUT output from all those regions to unshared UNIX file systems, shared UNIX file systems, and JES spool. For good measure we turned on full tracing for the WAS servers so the output would provide sufficient stress to the output destinations.

Important: This was not a system stress test nor a full scalability test. Please do not consider it as such.

This test was designed to perform a reasonable comparison of shared file system and unshared file system to validate the z/OS R13 improvements.

Performance varies based on many factors. Your results may be different.

This study's findings showed the following:

There was no appreciable difference in elapsed time or CPU time to initialize the servers and have them idle (and produce full tracing output) for the data capture interval for unshared file systems compared to shared file systems

From that our conclusion is:

In the past we have recommended against shared file systems for a multi-LPAR WAS z/OS configuration. That recommendation was based on well-known shared file system performance issues.

With z/OS V1R13 performance enhancements to shared file systems now allows customers to use shared file systems for their WAS z/OS configuration if they wish. The option to use shared file system for WAS z/OS with z/OS V1R13 is now viable2.

Or, in picture format:

1 See "Test environment" on page 6 for a description and illustration of the WAS z/OS setup.2 Customers currently running with separate unshared file systems should continue with that configuration for existing environments. There

is no reason to move from unshared to shared for existing configurations. Using shared file systems for new configurations may now be considered.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 4 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 5: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

z/OS R13 Shared File System Impact Study Overview and ResultsFor years we have recommended that WebSphere customers make certain that the file systems that are used by servers on an LPAR (node) are owned by the LPAR on which the node is running:

Figure 1 - Previous recommendation concerning separate file systems owned by respective LPARs

Over the years we have dealt with a number of file system related performance problems:

File System Issue Recommended Solution

File system for a node owned by another z/OS system in the Sysplex. This would result in poor write operation performance

which typically showed as slow server startup times.

Remount the file system so it is owned by the z/OS system on which the node runs.

Nodes on different z/OS systems configured to write to a shared file system. This would show as one node performing relatively

less well than the other nodes.

Reconfigure the file systems so that each node would have it own, and each node's

file system was owned by the z/OS system on which the node ran.

In summary, for years we recommended separate unshared file systems for each node because shared file systems looked better on paper than they were in reality.

In z/OS R11 an attempt was made to provide better managed and better performing shared file systems in the sysplex environment. But the improvements were not sufficiently successful. The advice we had given for years did not change. We continued to tell customers to configure unshared configuration file systems and to make certain the file systems were owned by the z/OS system on which the node operated.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 5 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 6: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

With z/OS R13 further improvements were made to better manage shared file systems. It seemed like a good opportunity to test the improvements and see how well shared WAS z/OS configuration file systems performed. That was the catalyst for this study.

Test environment

To test the z/OS R13 performance improvements in shared file system write operations we built a two-LPAR WAS z/OS environment and routed all the SYSPRINT and SYSOUT output to ZFS rather than JES3. Further, we set tracing to *=all to have the WAS servers write a lot of ouput.

Figure 2 - WAS z/OS configuration used during this shared file system test

Notes: This test was not designed to stress the CP or memory limits of the system. The memory and CP configuration was set high to avoid contention in those areas.

The Service Integration Bus (SIbus) was configured to create the Control Region Adjunct (CRA) so that all the possible server components would be represented and writing output: CR, SR and CRA.

Each server was configured with three servant regions to allow for more output to be written from each server.

Test scenarios

We needed to compare to scenarios to test the write performance improvements in z/OS R13: one a baseline with unshared ZFS and the second the comparison test with shared ZFS4:

3 This test was a better test of the overall file system performance than simply building a shared file system cell and starting the servers. Server startup is largely a read operation and that by itself would not adequately stress write operations. Hence this environment where the SYSPRINT and SYSOUT for the WAS cell was routed to a file system. That resulted in a great deal of write operations.

4 For information on the file systems we used, see "File System Information" on page 9.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 6 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 7: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Figure 3 - Unshared file system baseline versus shared file system

The following graphic illustrates the sequence of activities, the capture interval, and the focus of the analysis once the numbers had been collected:

Figure 4 - Test activity sequence, data capture interval and objectives

Some notes about this:

• The composition of the activities within this interval is less important than the comparison of the same activities in an unshared environment versus a shared environment. That's what would tell the story of the shared file system performance improvements.

• The server startup took less than 3 minutes. That means less than 3 minutes out of the 10 minute interval involved server startup activity. Still, there was trace output activity in idle servers during this time, and there was chatter among the 26 address spaces spread across the two systems during this 10 minutes.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 7 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 8: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

• Using a 10 minute window was simply a convenient way of getting a rough estimate of the CPU time and elapsed time impact of using a shared file system for all server components versus system dedicated file systems.

• We were interested in how long the 4 application servers on the two systems took to initialize, based on elapsed time as reported by the control region. We looked at the job start time to the time the message BBOO0247I was issued to get the measure of the impact on elapsed time.

• We were interested in the total CPU consumption in the two LPARs as reported by RMF. This way we caught all the CPU time used during initialization of the control regions, servant regions and adjunct regions. In addition, we got the CPU time used by XCF and ZFS to deal with its cross system issues. Yes, we also got all the other system tasks, but again, nothing else was running in the LPARs other than WAS z/OS, the normal system tasks like TCP and RRS, and a TSO user watching over it all.

• Finally, we were interested in the XCF traffic between the two systems as reported by RMF. If the writes were not being function shipped to one system, then there should not be a huge amount of XCF traffic in the case where a shared file system is used by all cell components.

Test results

The following table summarizes the results5:

Metric Non-Shared File Systems Test6 Shared File System Test7

Output Written ~165 million lines of output~ 9 billion bytes of

~165 million lines of output~ 9 billion bytes of

CPU usage 1017 CPU seconds 1009 CPU seconds

Server start elapsed time Between 2:15 and 2:35 Approximately 2:30

XCF activity 35 messages for IOEZFS18K messages for GRS

64K messages for IOEZFS18K messages for GRS

Conclusion

With z/OS R13 the differences between non-shared file systems and shared file systems are small. The CPU usage was essentially the same and the server start time was essentially the same as well. With a shared file system the XCF activity for IOEZFS was more, but this is to be expected.

The bottom line is that the previous recommendation for separate unshared file systems for WAS z/OS is no longer required. The z/OS R13 enhancements have allowed unshared and shared to operate at essentially the same level of performance.

Those customers running with separate unshared file systems for each node should continue with that policy for their existing cells. New cells may be considered for shared configuration file systems provided z/OS V1R13 or later is in use.

5 In case you're curious, we did run a test comparing output to JES spool. The results were essentially the same as for output to a file system. Of course, JES has advantages beyond simply performance: better archival and manageability.

6 See "NON-SHARED Filesystem Test" starting on page 10 for the details behind these results.7 See "SHARED Filesystem Test" starting on page 17 for the details behind these results.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 8 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 9: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Shared File System Impact Study DetailsFile System Information

wsyb:/shared/output/mjcell-> df -v .Mounted on Filesystem Avail/Total Files Status /shared/output (WSCZFSLG.SHARED.WAS.OUTPUT.ZFS) 109070/18938880 4294967228 AvailableZFS, Read/Write, Device:170, ACLS=YFile System Owner : WSYA Automove=Y Client=NFiletag : T=off codeset=0Aggregate Name : WSCZFSLG.SHARED.WAS.OUTPUT.ZFS wsyb:/WSYA/var/output/mjcell-> df -v .Mounted on Filesystem Avail/Total Files Status /WSYA/var/output (WSCZFSLG.WSYA.WAS.OUTPUT.ZFS) 14/8640000 4294967252 AvailableZFS, Read/Write, Device:177, ACLS=YFile System Owner : WSYA Automove=Y Client=NFiletag : T=off codeset=0Aggregate Name : WSCZFSLG.WSYA.WAS.OUTPUT.ZFS wsyb:/WSYB/var/output/mjcell-> df -v .Mounted on Filesystem Avail/Total Files Status /WSYB/var/output (WSCZFSLG.WSYB.WAS.OUTPUT.ZFS) 298158/9475200 4294967255 AvailableZFS, Read/Write, Device:178, ACLS=YFile System Owner : WSYB Automove=Y Client=NFiletag : T=off codeset=0Aggregate Name : WSCZFSLG.WSYB.WAS.OUTPUT.ZFS

© 2012, IBM CorporationAmericas Advanced Technical Skills - 9 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 10: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

NON-SHARED Filesystem Test

Notes:

Interval 14:03 - 14:13 In this test, servers on each node write to system specific /var/output file system.

RMF jobs #MCCOX8A(J01611), #MCCOX8B(J016212) and #MCCOX9C(J01613)

JOB Infomation:

Name Jobid Start BBOO0247I

MJSR01B STC01588 14:06:13 14:08.31MJSR02B STC01589 14.06.13 14.08.39MJSR01A STC01591 14.06.13 14.08.27MJSR02A STC01592 14.06.13 14.08.48MJSR01BS STC01595MJSR01BA STC01596MJSR02BA STC01597MJSR02BS STC01598MJSR01AA STC01599MJSR01AS STC01600MJSR02AS STC01601MJSR02AA STC01602MJSR01BS STC01603MJSR01AS STC01604MJSR02BS STC01605MJSR02AS STC01606MJSR01BS STC01607MJSR01AS STC01608MJSR02BS STC01609MJSR02AS STC01610

© 2012, IBM CorporationAmericas Advanced Technical Skills - 10 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 11: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

RMF Information by system.Policy for WSYA:REPORT BY: POLICY=WLMPOL WPLEX WLM policy -TRANSACTIONS- TRANS-TIME HHH.MM.SS.TTT --DASD I/O-- ---SERVICE--- SERVICE TIME ---APPL %--- --PROMOTED-- ----STORAGE---- AVG 59.78 ACTUAL 182 SSCHRT 155.5 IOC 2669K CPU 503.737 CP 84.21 BLK 0.000 AVG 25380.94 MPL 59.78 EXECUTION 109 RESP 0.9 CPU 35196K SRB 1.228 AAPCP 0.00 ENQ 0.002 TOTAL 1483257 ENDED 2662 QUEUED 72 CONN 0.7 MSO 6627M RCT 0.011 IIPCP 45.34 CRM 0.000 SHARED 10691.67 END/S 4.44 R/S AFFIN 0 DISC 0.1 SRB 85782 IIT 0.297 LCK 0.050 #SWAPS 351 INELIGIBLE 0 Q+PEND 0.1 TOT 6665M HST 0.000 AAP N/A SUP 0.000 -PAGE-IN RATES- EXCTD 0 CONVERSION 0 IOSQ 0.0 /SEC 11108K AAP N/A IIP 0.00 SINGLE 0.0 AVG ENC 1.34 STD DEV 1.670 IIP 0.000 BLOCK 0.0 REM ENC 0.00 ABSRPTN 186K SHARED 0.0 MS ENC 0.00 TRX SERV 186K HSP 0.0 W O R K L O A D A C T I V I T Y PAGE 2 z/OS V1R13 SYSPLEX WPLEX START 11/13/2012-14.03.00 INTERVAL 000.09.59 MODE = GOAL RPT VERSION V1R13 RMF END 11/13/2012-14.12.59 POLICY ACTIVATION DATE/TIME 11/12/2012 12.36.49 - SERVICE POLICY PAGE - SERVICE DEFINITION: WLM WSC WPLEX Service Definition -SERVICE DEFINITION COEFFICIENTS- INSTALL DATE: 11/12/2012 12.33.11 INSTALLED BY: MJLOOS IOC CPU SRB MSO POLICY: WLMPOL WPLEX WLM policy I/O PRIORITY MANAGEMENT: NO 0.1 1.0 1.0 0.1000 DYNAMIC ALIAS MANAGEMENT: YES SYSTEMS ---ID--- OPT SU/SEC CAP% --TIME-- INTERVAL WSYA 01 69869.0 100 14.03.00 00.09.59

CPU for WSYA:CPU 2827 CPC CAPACITY 8801 SEQUENCE CODE 00000000000132C7 MODEL 795 CHANGE REASON=NONE HIPERDISPATCH=YES H/W MODEL HA1 ---CPU--- ---------------- TIME % ---------------- LOG PROC --I/O INTERRUPTS-- NUM TYPE ONLINE LPAR BUSY MVS BUSY PARKED SHARE % RATE % VIA TPI 0 CP 100.00 22.29 22.27 0.00 100.0 HIGH 13.46 4.52 1 CP 100.00 20.45 20.44 0.00 100.0 HIGH 4.89 18.02 2 CP 100.00 21.80 21.78 0.00 100.0 HIGH 2.32 17.10 3 CP 100.00 21.24 21.23 0.00 100.0 HIGH 141.7 1.30 TOTAL/AVERAGE 21.45 21.43 400.0 162.3 2.29

© 2012, IBM CorporationAmericas Advanced Technical Skills - 11 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 12: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Partition for Plex:

------ WEIGHTING STATISTICS ------ ---- PROCESSOR STATISTICS ---- ------ STORAGE STATISTICS ----- --- DEFINED --- ---- ACTUAL ----- ---- NUMBER --- -- TOTAL% -- --- CENTRAL --- -- EXPANDED -- CLUSTER PARTITION SYSTEM INIT MIN MAX AVG MIN % MAX % DEFINED ACTUAL LBUSY PBUSY WPLEX SOSP11 WSYA 10 0 0 10 - - 6 4.0 21.45 0.90 32768 N/A SOSP12 WSYB 10 0 0 10 - - 6 4.0 21.87 0.92 32768 N/A --------------------------- ---------------------------------- ------------------------------ ------------------------------- TOTAL 20 12 43.32 1.82 65536 N/A

XCF for WSYA:

XCF USAGE BY SYSTEM ------------------------------------------------------------------------------------------------------------------------------------ REMOTE SYSTEMS LOCAL --------------------------------------------------------------------------------------------------------- ----------------- OUTBOUND FROM WSYA INBOUND TO WSYA WSYA --------------------------------------------------------------------------- --------------------------- ----------------- ----- BUFFER ----- ALL TO TRANSPORT BUFFER REQ % % % % PATHS REQ FROM REQ REQ TRANSPORT REQ SYSTEM CLASS LENGTH OUT SML FIT BIG OVR UNAVAIL REJECT SYSTEM IN REJECT CLASS REJECT WSYB DEFAULT 4,028 7 0 100 0 0 0 0 WSYB 19,824 0 DEFAULT 0 LARGE 16,316 78 74 26 0 0 0 0 LARGE 0 LARGE32 32,700 40 100 0 0 0 0 0 LARGE32 0 SMALL 956 19,672 0 100 0 0 0 0 SMALL 0 ---------- ---------- TOTAL 19,797 TOTAL 19,824

---------------------------------------------------------------------- MEMBERS COMMUNICATING WITH WSYA ----------------------------------------------------------------- REQ REQ FROM TO GROUP MEMBER SYSTEM WSYA WSYA IOEZFS WSYB WSYB 35 31 ---------- ---------- TOTAL 35 31

© 2012, IBM CorporationAmericas Advanced Technical Skills - 12 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 13: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Policy for WSYB:

REPORT BY: POLICY=WLMPOL WPLEX WLM policy -TRANSACTIONS- TRANS-TIME HHH.MM.SS.TTT --DASD I/O-- ---SERVICE--- SERVICE TIME ---APPL %--- --PROMOTED-- ----STORAGE---- AVG 54.37 ACTUAL 171 SSCHRT 153.9 IOC 2607K CPU 514.125 CP 85.93 BLK 0.000 AVG 23560.15 MPL 54.37 EXECUTION 93 RESP 0.9 CPU 35921K SRB 1.159 AAPCP 0.00 ENQ 0.000 TOTAL 1249713 ENDED 2349 QUEUED 78 CONN 0.7 MSO 6919M RCT 0.001 IIPCP 46.80 CRM 0.000 SHARED 7674.32 END/S 3.92 R/S AFFIN 0 DISC 0.1 SRB 80969 IIT 0.295 LCK 0.065 #SWAPS 209 INELIGIBLE 0 Q+PEND 0.1 TOT 6957M HST 0.000 AAP N/A SUP 0.000 -PAGE-IN RATES- EXCTD 0 CONVERSION 0 IOSQ 0.0 /SEC 11596K AAP N/A IIP 0.00 SINGLE 0.0 AVG ENC 1.33 STD DEV 1.664 IIP 0.000 BLOCK 0.0 REM ENC 0.00 ABSRPTN 213K SHARED 0.0 MS ENC 0.00 TRX SERV 213K HSP 0.0 W O R K L O A D A C T I V I T Y PAGE 2 z/OS V1R13 SYSPLEX WPLEX START 11/13/2012-14.03.00 INTERVAL 000.09.59 MODE = GOAL RPT VERSION V1R13 RMF END 11/13/2012-14.13.00 POLICY ACTIVATION DATE/TIME 11/12/2012 12.36.49 - SERVICE POLICY PAGE - SERVICE DEFINITION: WLM WSC WPLEX Service Definition -SERVICE DEFINITION COEFFICIENTS- INSTALL DATE: 11/12/2012 12.33.11 INSTALLED BY: MJLOOS IOC CPU SRB MSO POLICY: WLMPOL WPLEX WLM policy I/O PRIORITY MANAGEMENT: NO 0.1 1.0 1.0 0.1000 DYNAMIC ALIAS MANAGEMENT: YES SYSTEMS ---ID--- OPT SU/SEC CAP% --TIME-- INTERVAL WSYB 01 69869.0 100 14.03.00 00.09.59

CPU for WSYB:

CPU 2827 CPC CAPACITY 8801 SEQUENCE CODE 00000000000132C7 MODEL 795 CHANGE REASON=NONE HIPERDISPATCH=YES H/W MODEL HA1 ---CPU--- ---------------- TIME % ---------------- LOG PROC --I/O INTERRUPTS-- NUM TYPE ONLINE LPAR BUSY MVS BUSY PARKED SHARE % RATE % VIA TPI 0 CP 100.00 22.43 22.41 0.00 100.0 HIGH 12.23 3.61 1 CP 100.00 21.26 21.24 0.00 100.0 HIGH 3.19 14.44 2 CP 100.00 22.08 22.07 0.00 100.0 HIGH 1.97 14.12 3 CP 100.00 21.72 21.71 0.00 100.0 HIGH 142.7 1.06 TOTAL/AVERAGE 21.87 21.86 400.0 160.1 1.68

© 2012, IBM CorporationAmericas Advanced Technical Skills - 13 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 14: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Partition for Plex:

------ WEIGHTING STATISTICS ------ ---- PROCESSOR STATISTICS ---- ------ STORAGE STATISTICS ----- --- DEFINED --- ---- ACTUAL ----- ---- NUMBER --- -- TOTAL% -- --- CENTRAL --- -- EXPANDED -- CLUSTER PARTITION SYSTEM INIT MIN MAX AVG MIN % MAX % DEFINED ACTUAL LBUSY PBUSY WPLEX SOSP11 WSYA 10 0 0 10 - - 6 4.0 21.45 0.90 32768 N/A SOSP12 WSYB 10 0 0 10 - - 6 4.0 21.87 0.92 32768 N/A --------------------------- ---------------------------------- ------------------------------ ------------------------------- TOTAL 20 12 43.32 1.82 65536 N/A

XCF for WSYB:

XCF USAGE BY SYSTEM ------------------------------------------------------------------------------------------------------------------------------------ REMOTE SYSTEMS LOCAL --------------------------------------------------------------------------------------------------------- ----------------- OUTBOUND FROM WSYB INBOUND TO WSYB WSYB --------------------------------------------------------------------------- --------------------------- ----------------- ----- BUFFER ----- ALL TO TRANSPORT BUFFER REQ % % % % PATHS REQ FROM REQ REQ TRANSPORT REQ SYSTEM CLASS LENGTH OUT SML FIT BIG OVR UNAVAIL REJECT SYSTEM IN REJECT CLASS REJECT WSYA DEFAULT 4,028 63 0 100 0 0 0 0 WSYA 19,713 0 DEFAULT 0 LARGE 16,316 96 69 31 0 0 0 0 LARGE 0 LARGE32 32,700 170 100 0 0 0 0 0 LARGE32 0 SMALL 956 19,587 0 100 0 0 0 0 SMALL 0 ---------- ---------- TOTAL 19,916 TOTAL 19,713

XCF USAGE BY MEMBER --------------------------------------------------------------------------- MEMBERS COMMUNICATING WITH WSYB ----------------------------------------------------------------- REQ REQ FROM TO GROUP MEMBER SYSTEM WSYB WSYB IOEZFS WSYA WSYA 35 33 ---------- ---------- TOTAL 35 33

© 2012, IBM CorporationAmericas Advanced Technical Skills - 14 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 15: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Policy for WPlex:

REPORT BY: POLICY=WLMPOL WPLEX WLM policy -TRANSACTIONS- TRANS-TIME HHH.MM.SS.TTT --DASD I/O-- ---SERVICE--- SERVICE TIME ---APPL %--- --PROMOTED-- ----STORAGE---- AVG 114.15 ACTUAL 177 SSCHRT 309.4 IOC 5276K CPU 1017.862 CP 170.14 BLK 0.000 AVG 24514.61 MPL 114.15 EXECUTION 102 RESP 0.9 CPU 71117K SRB 2.387 AAPCP 0.00 ENQ 0.002 TOTAL 2732958 ENDED 5011 QUEUED 75 CONN 0.7 MSO 13546M RCT 0.012 IIPCP 92.13 CRM 0.000 SHARED 18365.91 END/S 8.35 R/S AFFIN 0 DISC 0.1 SRB 166751 IIT 0.592 LCK 0.115 #SWAPS 560 INELIGIBLE 0 Q+PEND 0.1 TOT 13622M HST 0.000 AAP N/A SUP 0.000 -PAGE-IN RATES- EXCTD 0 CONVERSION 0 IOSQ 0.0 /SEC 22704K AAP N/A IIP 0.00 SINGLE 0.0 AVG ENC 2.67 STD DEV 1.667 IIP 0.000 BLOCK 0.0 REM ENC 0.00 ABSRPTN 199K SHARED 0.0 MS ENC 0.00 TRX SERV 199K HSP 0.0

Filesystem info:

wsya:/WSYA/var/output-> du -kt . 8 ./mjcell/mjdemn 432 ./mjcell/mjdmnode/mjdmgr 440 ./mjcell/mjdmnode 200 ./mjcell/mjnodea/mjagnta 2186896 ./mjcell/mjnodea/mjsr01a 2098896 ./mjcell/mjnodea/mjsr02a 4286000 ./mjcell/mjnodea 8 ./mjcell/mjnodeb/mjagntb 8 ./mjcell/mjnodeb/mjsr01b 8 ./mjcell/mjnodeb/mjsr02b 32 ./mjcell/mjnodeb 4286488 ./mjcell 4286496 .wsya:/WSYA/var/output-> cat `find . -name '*.txt'` | wc 82661076 291273315 4386827491 wsya:/WSYA/var/output->

wsyb:/WSYB/var/output-> du -kt . 8 ./mjcell/mjdemn

© 2012, IBM CorporationAmericas Advanced Technical Skills - 15 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 16: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

8 ./mjcell/mjdmnode/mjdmgr 16 ./mjcell/mjdmnode 8 ./mjcell/mjnodea/mjagnta 8 ./mjcell/mjnodea/mjsr01a 8 ./mjcell/mjnodea/mjsr02a 32 ./mjcell/mjnodea 200 ./mjcell/mjnodeb/mjagntb 2198352 ./mjcell/mjnodeb/mjsr01b 2144464 ./mjcell/mjnodeb/mjsr02b 4343024 ./mjcell/mjnodeb 4343088 ./mjcell 4343096 .wsyb:/WSYB/var/output-> cat `find . -name '*.txt'` | wc 83776833 295345305 4448850568 wsyb:/WSYB/var/output->

Basically, 165 million lines and 8.9 billion characters.

© 2012, IBM CorporationAmericas Advanced Technical Skills - 16 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 17: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

SHARED Filesystem Test

Notes:

Interval 10:23 - 10:33

In this test, servers on each node write to common /shared/output file system

RMF jobs #MCCOX9A(J01544), #MCCOX9B(J01545) and #MCCOX9C(J01547)

JOB Information:

Name Jobid Start BBOO0247I

MJSR01A STC01522 10.26.03 10.28.26MJSR02A STC01523 10.26.03 10.28.25MJSR01B STC01524 10.26.03 10.28.27MJSR02B STC01525 10.26.03 10.28.26MJSR02AA STC01528MJSR02AS STC01529MJSR01AS STC01530MJSR01AA STC01531MJSR01BA STC01532MJSR02BA STC01533MJSR02BS STC01534MJSR01BS STC01535MJSR02AS STC01536MJSR01AS STC01537MJSR01BS STC01538MJSR02BS STC01539MJSR02BS STC01540MJSR01BS STC01541MJSR01AS STC01542MJSR02AS STC01543

© 2012, IBM CorporationAmericas Advanced Technical Skills - 17 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 18: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

RMF Information by system:Policy for WSYA:REPORT BY: POLICY=WLMPOL WPLEX WLM policy -TRANSACTIONS- TRANS-TIME HHH.MM.SS.TTT --DASD I/O-- ---SERVICE--- SERVICE TIME ---APPL %--- --PROMOTED-- ----STORAGE---- AVG 56.81 ACTUAL 152 SSCHRT 168.7 IOC 2590K CPU 503.035 CP 84.28 BLK 0.000 AVG 27100.62 MPL 56.81 EXECUTION 86 RESP 0.9 CPU 35147K SRB 2.280 AAPCP 0.00 ENQ 0.006 TOTAL 1504061 ENDED 2631 QUEUED 66 CONN 0.6 MSO 6911M RCT 0.007 IIPCP 45.06 CRM 0.000 SHARED 7747.77 END/S 4.39 R/S AFFIN 0 DISC 0.1 SRB 159334 IIT 0.336 LCK 0.060 #SWAPS 296 INELIGIBLE 0 Q+PEND 0.1 TOT 6949M HST 0.000 AAP N/A SUP 0.000 -PAGE-IN RATES- EXCTD 0 CONVERSION 0 IOSQ 0.0 /SEC 11582K AAP N/A IIP 0.00 SINGLE 0.0 AVG ENC 1.31 STD DEV 1.567 IIP 0.000 BLOCK 0.0 REM ENC 0.00 ABSRPTN 204K SHARED 0.0 MS ENC 0.00 TRX SERV 204K HSP 0.0 W O R K L O A D A C T I V I T Y PAGE 2 z/OS V1R13 SYSPLEX WPLEX START 11/13/2012-10.23.00 INTERVAL 000.09.59 MODE = GOAL RPT VERSION V1R13 RMF END 11/13/2012-10.32.59 POLICY ACTIVATION DATE/TIME 11/12/2012 12.36.49 - SERVICE POLICY PAGE - SERVICE DEFINITION: WLM WSC WPLEX Service Definition -SERVICE DEFINITION COEFFICIENTS- INSTALL DATE: 11/12/2012 12.33.11 INSTALLED BY: MJLOOS IOC CPU SRB MSO POLICY: WLMPOL WPLEX WLM policy I/O PRIORITY MANAGEMENT: NO 0.1 1.0 1.0 0.1000 DYNAMIC ALIAS MANAGEMENT: YES SYSTEMS ---ID--- OPT SU/SEC CAP% --TIME-- INTERVAL WSYA 01 69869.0 100 10.23.00 00.09.59

CPU for WSYA:CPU 2827 CPC CAPACITY 8801 SEQUENCE CODE 00000000000132C7 MODEL 795 CHANGE REASON=NONE HIPERDISPATCH=YES H/W MODEL HA1 ---CPU--- ---------------- TIME % ---------------- LOG PROC --I/O INTERRUPTS-- NUM TYPE ONLINE LPAR BUSY MVS BUSY PARKED SHARE % RATE % VIA TPI 0 CP 100.00 22.18 22.16 0.00 100.0 HIGH 20.42 3.21 1 CP 100.00 21.16 21.14 0.00 100.0 HIGH 5.75 14.22 2 CP 100.00 21.47 21.45 0.00 100.0 HIGH 3.10 15.79 3 CP 100.00 21.15 21.14 0.00 100.0 HIGH 146.5 1.19 TOTAL/AVERAGE 21.49 21.47 400.0 175.8 2.11

© 2012, IBM CorporationAmericas Advanced Technical Skills - 18 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 19: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Partition for Plex:

------ WEIGHTING STATISTICS ------ ---- PROCESSOR STATISTICS ---- ------ STORAGE STATISTICS ----- --- DEFINED --- ---- ACTUAL ----- ---- NUMBER --- -- TOTAL% -- --- CENTRAL --- -- EXPANDED -- CLUSTER PARTITION SYSTEM INIT MIN MAX AVG MIN % MAX % DEFINED ACTUAL LBUSY PBUSY WPLEX SOSP11 WSYA 10 0 0 10 - - 6 4.0 21.49 0.90 32768 N/A SOSP12 WSYB 10 0 0 10 - - 6 4.0 21.37 0.90 32768 N/A --------------------------- ---------------------------------- ------------------------------ ------------------------------- TOTAL 20 12 42.86 1.80 65536 N/A

XCF for WSYA:

XCF USAGE BY SYSTEM ------------------------------------------------------------------------------------------------------------- REMOTE SYSTEMS --------------------------------------------------------------------------------------------------------- OUTBOUND FROM WSYA INBOUND TO WSYA --------------------------------------------------------------------------- --------------------------- ----- BUFFER ----- ALL TO TRANSPORT BUFFER REQ % % % % PATHS REQ FROM REQ REQ SYSTEM CLASS LENGTH OUT SML FIT BIG OVR UNAVAIL REJECT SYSTEM IN REJECT WSYB DEFAULT 4,028 26 0 100 0 0 0 0 WSYB 83,788 0 LARGE 16,316 74 78 22 0 0 0 0 LARGE32 32,700 44 100 0 0 0 0 0 SMALL 956 83,725 0 100 0 0 0 0 ---------- ---------- TOTAL 83,869 TOTAL 83,788

XCF USAGE BY MEMBER ---------------------------------------------------------------------------- MEMBERS COMMUNICATING WITH WSYA ----------------------------------------------------------------- REQ REQ FROM TO GROUP MEMBER SYSTEM WSYA WSYA IOEZFS WSYB WSYB 64,169 64,160 ---------- ---------- TOTAL 64,169 64,160

© 2012, IBM CorporationAmericas Advanced Technical Skills - 19 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 20: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Policy for WSYB:

REPORT BY: POLICY=WLMPOL WPLEX WLM policy -TRANSACTIONS- TRANS-TIME HHH.MM.SS.TTT --DASD I/O-- ---SERVICE--- SERVICE TIME ---APPL %--- --PROMOTED-- ----STORAGE---- AVG 54.40 ACTUAL 164 SSCHRT 147.0 IOC 2585K CPU 500.069 CP 83.87 BLK 0.000 AVG 23757.43 MPL 54.40 EXECUTION 82 RESP 0.9 CPU 34939K SRB 2.863 AAPCP 0.00 ENQ 0.007 TOTAL 1261736 ENDED 2111 QUEUED 81 CONN 0.6 MSO 6480M RCT 0.000 IIPCP 45.09 CRM 0.000 SHARED 7692.19 END/S 3.52 R/S AFFIN 0 DISC 0.2 SRB 200026 IIT 0.280 LCK 0.049 #SWAPS 85 INELIGIBLE 0 Q+PEND 0.1 TOT 6517M HST 0.000 AAP N/A SUP 0.000 -PAGE-IN RATES- EXCTD 0 CONVERSION 0 IOSQ 0.0 /SEC 10862K AAP N/A IIP 0.00 SINGLE 0.0 AVG ENC 1.29 STD DEV 1.725 IIP 0.000 BLOCK 0.0 REM ENC 0.00 ABSRPTN 200K SHARED 0.0 MS ENC 0.00 TRX SERV 200K HSP 0.0 W O R K L O A D A C T I V I T Y PAGE 2 z/OS V1R13 SYSPLEX WPLEX START 11/13/2012-10.23.00 INTERVAL 000.09.59 MODE = GOAL RPT VERSION V1R13 RMF END 11/13/2012-10.32.59 POLICY ACTIVATION DATE/TIME 11/12/2012 12.36.49 - SERVICE POLICY PAGE - SERVICE DEFINITION: WLM WSC WPLEX Service Definition -SERVICE DEFINITION COEFFICIENTS- INSTALL DATE: 11/12/2012 12.33.11 INSTALLED BY: MJLOOS IOC CPU SRB MSO POLICY: WLMPOL WPLEX WLM policy I/O PRIORITY MANAGEMENT: NO 0.1 1.0 1.0 0.1000 DYNAMIC ALIAS MANAGEMENT: YES SYSTEMS ---ID--- OPT SU/SEC CAP% --TIME-- INTERVAL WSYB 01 69869.0 100 10.23.00 00.09.59

CPU for WSYB:

CPU 2827 CPC CAPACITY 8801 SEQUENCE CODE 00000000000132C7 MODEL 795 CHANGE REASON=NONE HIPERDISPATCH=YES H/W MODEL HA1 ---CPU--- ---------------- TIME % ---------------- LOG PROC --I/O INTERRUPTS-- NUM TYPE ONLINE LPAR BUSY MVS BUSY PARKED SHARE % RATE % VIA TPI 0 CP 100.00 22.18 22.16 0.00 100.0 HIGH 20.42 3.21 1 CP 100.00 21.16 21.14 0.00 100.0 HIGH 5.75 14.22 2 CP 100.00 21.47 21.45 0.00 100.0 HIGH 3.10 15.79 3 CP 100.00 21.15 21.14 0.00 100.0 HIGH 146.5 1.19 TOTAL/AVERAGE 21.49 21.47 400.0 175.8 2.11

© 2012, IBM CorporationAmericas Advanced Technical Skills - 20 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 21: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Partition information for Plex:

------ WEIGHTING STATISTICS ------ ---- PROCESSOR STATISTICS ---- ------ STORAGE STATISTICS ----- --- DEFINED --- ---- ACTUAL ----- ---- NUMBER --- -- TOTAL% -- --- CENTRAL --- -- EXPANDED -- CLUSTER PARTITION SYSTEM INIT MIN MAX AVG MIN % MAX % DEFINED ACTUAL LBUSY PBUSY WPLEX SOSP11 WSYA 10 0 0 10 - - 6 4.0 21.49 0.90 32768 N/A SOSP12 WSYB 10 0 0 10 - - 6 4.0 21.37 0.90 32768 N/A --------------------------- ---------------------------------- ------------------------------ ------------------------------- TOTAL 20 12 42.86 1.80 65536 N/A

XCF for WSYB:

XCF USAGE BY SYSTEM -------------------------------------------------------------------------------------------------------------- REMOTE SYSTEMS --------------------------------------------------------------------------------------------------------- OUTBOUND FROM WSYA INBOUND TO WSYA --------------------------------------------------------------------------- --------------------------- ----- BUFFER ----- ALL TO TRANSPORT BUFFER REQ % % % % PATHS REQ FROM REQ REQ SYSTEM CLASS LENGTH OUT SML FIT BIG OVR UNAVAIL REJECT SYSTEM IN REJECT WSYB DEFAULT 4,028 26 0 100 0 0 0 0 WSYB 83,788 0 LARGE 16,316 74 78 22 0 0 0 0 LARGE32 32,700 44 100 0 0 0 0 0 SMALL 956 83,725 0 100 0 0 0 0 ---------- ---------- TOTAL 83,869 TOTAL 83,788

XCF USAGE BY MEMBER ----------------------------------------------------------------------------- MEMBERS COMMUNICATING WITH WSYA ----------------------------------------------------------------- REQ REQ FROM TO GROUP MEMBER SYSTEM WSYA WSYA IOEZFS WSYB WSYB 64,169 64,160 ---------- ---------- TOTAL 64,169 64,160

© 2012, IBM CorporationAmericas Advanced Technical Skills - 21 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 22: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Policy for WPlex: REPORT BY: POLICY=WLMPOL WPLEX WLM policy -TRANSACTIONS- TRANS-TIME HHH.MM.SS.TTT --DASD I/O-- ---SERVICE--- SERVICE TIME ---APPL %--- --PROMOTED-- ----STORAGE---- AVG 111.20 ACTUAL 157 SSCHRT 315.7 IOC 5175K CPU 1003.104 CP 168.15 BLK 0.000 AVG 25465.81 MPL 111.20 EXECUTION 84 RESP 0.9 CPU 70086K SRB 5.143 AAPCP 0.00 ENQ 0.013 TOTAL 2765793 ENDED 4742 QUEUED 72 CONN 0.6 MSO 13391M RCT 0.007 IIPCP 90.15 CRM 0.000 SHARED 15439.93 END/S 7.90 R/S AFFIN 0 DISC 0.2 SRB 359360 IIT 0.616 LCK 0.110 #SWAPS 381 INELIGIBLE 0 Q+PEND 0.1 TOT 13466M HST 0.000 AAP N/A SUP 0.000 -PAGE-IN RATES- EXCTD 0 CONVERSION 0 IOSQ 0.0 /SEC 22444K AAP N/A IIP 0.00 SINGLE 0.0 AVG ENC 2.59 STD DEV 1.639 IIP 0.000 BLOCK 0.0 REM ENC 0.00 ABSRPTN 202K SHARED 0.0 MS ENC 0.00 TRX SERV 202K HSP 0.0

Filesystem Information:wsya:/shared/output-> du -kt . 8 ./mjcell/mjdemn 440 ./mjcell/mjdmnode/mjdmgr 448 ./mjcell/mjdmnode 200 ./mjcell/mjnodea/mjagnta 2134032 ./mjcell/mjnodea/mjsr01a 2143224 ./mjcell/mjnodea/mjsr02a 4277464 ./mjcell/mjnodea 200 ./mjcell/mjnodeb/mjagntb 2144896 ./mjcell/mjnodeb/mjsr01b 2126056 ./mjcell/mjnodeb/mjsr02b 4271160 ./mjcell/mjnodeb 8549088 ./mjcell 8549096 .

wsya:/shared/output-> cat `find . -name '*.txt'` | wc -l 165423772 wsya:/shared/output-> cat `find . -name '*.txt'` | wc -m 9600102214 wsya:/shared/output->

Basically, 165 Million lines and 9 Billion bytes written

© 2012, IBM CorporationAmericas Advanced Technical Skills - 22 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012

Page 23: WebSphere Application Server for z/OS V6 · 2019-06-18 · WebSphere Application Server for z/OS z/OS V1 Release 13 Shared File System Impact Study Version Date: December 3, 2012

WP102230 - z/OS Release 13 Shared File System Impact Study

Document Change HistoryCheck the date in the footer of the document for the version of the document.

November 30, 2012 Original document at time of Techdoc creation

December 3, 2012 Document republished with assigned WP102230 number.

End of WP102230

© 2012, IBM CorporationAmericas Advanced Technical Skills - 23 -

WP102230 at ibm.com/support/techdocsVersion Date: Monday, December 03, 2012