78
www.compaq.com Performance Management and OpenVMS Too ls 1 Performance Performance Management Management and OpenVMS Tools and OpenVMS Tools Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

Embed Size (px)

Citation preview

Page 1: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 1

Performance ManagementPerformance Managementand OpenVMS Toolsand OpenVMS Tools

Tools and utilities available with OpenVMS

Bart Z. Lederman, OpenVMS Performance Expertise Center

Page 2: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 2

OverviewOverview

Tools and utilities available with OpenVMS. Locating tools and resources. What information they provide. Learning the tuning process. Not an in-depth tutorial on specific tools.

Page 3: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 3

The ManualsThe Manuals

Good place to start. Good way to refresh your memory. Keep up with changes and improvements. Don’t memorize them: become familiar with

where topics are covered. Also check manuals for applications and layered

products.

Page 4: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 4

Some of the ManualsSome of the Manuals

A Comparison of System Management on OpenVMS AXP and OpenVMS VAX

OpenVMS System Management Utilities Reference Manual OpenVMS System Manager's Manual: Tuning, Monitoring, and

Complex Systems OpenVMS Performance Management DECnet for OpenVMS Network Management Utilities DECamds User's Guide DECevent Translation and Reporting Utility DECevent Analysis and Notification Utility DECnet/OSI (DECnet-Plus) manuals.

Page 5: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 5

Manuals: Advice changes over time.Manuals: Advice changes over time.

VMS is 20+ years old. A lot has been written about VMS over the years. Computer ‘power’ is increasing rapidly. The cost of hardware is decreasing. Advice that was valid 5 or 10 years ago may no

longer apply to current systems. Be especially wary of “Rules of Thumb”

Page 6: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 6

Manuals: Application vs. System ChangesManuals: Application vs. System Changes

Many manuals have a ‘fix the system’ orientation. It is often better to ‘fix’ the application. Can the demand for resources be reduced? Can the demand for resources be redistributed

(different systems or different times)?

Page 7: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 7

Installation GuidesInstallation GuidesRelease NotesRelease Notes

May contain information on system parameters, quotas, etc.

Often guidelines or minimums: your system may be different.

Things change: check the release notes. May have information on previous releases as

well. Also look for “New Features” manuals.

Page 8: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 8

Error LoggingError Logging

Before a system can be tuned, it must be working properly.

Software can mask errors. Check Error Logs. Check ECO and hardware revision levels.

Page 9: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 9

$ SHOW ERROR$ SHOW ERROR

Device Error Count

PIRULO$DKA0: 5

PIRULO$DKA300: 3

PIRULO$DKA500: 1

PIRULO$PKA0: 4

[Only devices with any errors are shown. Note that some errors could be 'soft' errors, or startup initialization messages.]

Page 10: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 10

$ ANALYZE /ERROR$ ANALYZE /ERROR

DEVICE SUMMARY LOGGED BY SID 12000003

ERRORS TIMEOUTS UCB ERROR UCB OPERATION

[HARD] [SOFT] [HARD] [SOFT] COUNT COUNT

_PIRULO$DKA300:

"OPENVMS062"

4. 2. 0. 0. 6. 2344958.

"OPENVMS070"

3. 0. 0. 0. 3. 7917.

------- ------- ------- ------- ------------ -------------

TOTALS 7. 2. 0. 0. 3. 7917.

Page 11: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 11

$ ANALYZE /ERROR$ ANALYZE /ERROR

V A X / V M S SYSTEM ERROR REPORT COMPILED 12-APR-1996

SUMMARY OF ALL ENTRIES LOGGED BY SID 12000003

DEVICE ERROR BIT SET 32.

SYSTEM START-UP 18.

ERRLOG.SYS CREATED 1.

FATAL BUGCHECK 14.

TIME-STAMP 84.

VOLUME MOUNT 147.

VOLUME DISMOUNT 124.

DEVICE ATTENTION 12.

DATE OF EARLIEST ENTRY 9-FEB-1995 10:39:24.48

DATE OF LATEST ENTRY 12-APR-1996 13:27:37.33

Page 12: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 12

$ DIAGNOSE /TRANS /SUM$ DIAGNOSE /TRANS /SUM

$ DIAGNOSE /TRANSLATE /SUMMARY

SUMMARY OF ALL ENTRIES LOGGED ON NODE PRFGRP

unknown major class

New errorlog created 1.

Timestamp 103.

Volume dismount 121.

Crash Re-start 31.

System startup 37.

Volume mount 222.

Hard ECC error 3.

SCSI 308.

DATE OF EARLIEST ENTRY 15-JUL-1996 09:27:50

DATE OF LATEST ENTRY 13-AUG-1997 12:29:46

Page 13: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 13

$ DIAG /TRAN /BRIEF $ DIAG /TRAN /BRIEF /INCLU=TAPE/INCLU=TAPE********************** ENTRY 708 **********************

Logging OS 1. OpenVMS

System Architecture 2. Alpha

OS version V7.1

Event sequence number 15247.

Timestamp of occurrence 11-JUN-1997 09:34:00

Host name PRFGRP

System Model DEC 3000 Model 500

---- Device Profile ----

Unit PRFGRP$MKA500

Product Name TLZ06

-- Driver Supplied Info -

VMS SCSI Error Type 3. Send SCSI Command Failed

Page 14: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 14

Network Management ToolsNetwork Management Tools

DECnet keeps counters on lines, circuits, executive.

Error counters can be used to find problems. Amount of data transferred can be used to

measure performance. Other networking products (software and

hardware) should also have counters.

Page 15: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 15

$ NCP SHOW LINE COUNTERS$ NCP SHOW LINE COUNTERS

>65534 Seconds since last zeroed

11947338 Data blocks received

10215202 Multicast blocks received

8 Receive failure, including:

Frame too long

2394634188 Bytes received

1924531620 Multicast bytes received

0 Data overrun

1824950 Data blocks sent

104040 Multicast blocks sent

Page 16: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 16

$ NCP $ NCP (continued)(continued)

141341 Blocks sent, multiple collisions

79167 Blocks sent, single collision

201061 Blocks sent, initially deferred

335483778 Bytes sent

5966839 Multicast bytes sent

21 Send failure, including:

Excessive collisions

0 Collision detect check failure

0 Unrecognized frame destination

15 System buffer unavailable

3 User buffer unavailable

Page 17: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 17

$ NCL$ NCL

$ NCL SHOW NODE 0 CSMA-CD STATION * ALL COUNTERS

Node 0 CSMA-CD Station EWA-0

at 1996-04-23-08:56:03.147-04:00I20072005.710

Counters

Creation Time = 1996-04-19-15:45:23.378-04:00Iinf

Octets Received = 2289234977

Octets Sent = 2282075619

PDUs Received = 5812954

PDUs Sent = 5731279

Multicast Octets Received = 2460645

Multicast Octets Sent = 198605

Page 18: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 18

$ NCL$ NCL (continued) (continued)

Multicast PDUs Received = 39466

Multicast PDUs Sent = 2336

Initially Deferred PDUs Sent = 128707

Single Collision PDUs Sent = 794833

Multiple Collisions PDUs Sent = 418837

Excessive Collisions = 2

Carrier Check Failures = 0

Late Collisions = 0

Collision Detect Check Failures = 0

Frame Check Errors = 0

Frame Size Errors = 0

Send Data Length Errors = 0

Alignment Errors = 0

Frames Too Long = 0

Page 19: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 19

$ UCX SHOW INTERFACE /FULL$ UCX SHOW INTERFACE /FULLInterface: SE0

IP_Addr: 16.32.160.164 NETWRK: 255.255.255.0 BRDCST: 16.255.255.255

Ethernet_Addr: AA-00-04-00-65-FF MTU: 1500

Flags: UP BRDCST NOTRL RUN

RECEIVE SEND

Packets 5456912 22879

IP packets 21357 17778

Broadcast IP packets 809127 0

Trailer 1 IP packets 0

Trailer 2 IP packets 0

ARP packets 222 4903

Broadcast ARP packets 4626206 198

Drops

IP packets 0 0

ARP packets 0 0

Errors

Hardware 0 2

Software 0 0

Page 20: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 20

AGEN$FEEDBACKAGEN$FEEDBACKAUTOGENAUTOGEN

Captures data about actual system use. Detects when some resources are exhausted:

disk cache, memory, pool. AUTOGEN can format the data into a report

without making changes to your system. AUTOGEN can use the feedback to adjust

system parameters.@SYS$UPDATE:AUTOGEN HELP

Page 21: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 21

AGEN$FEEDBACK.DATAGEN$FEEDBACK.DAT

FEEDBACK_NODE = "PIRULO "

FEEDBACK_SID = 301989891

FEEDBACK_TIME = " 1-APR-1996 14:17:24.40"

FEEDBACK_UPTIME = 268041

LOCKS_INUSE = 290

LOCKS_PEAK = 1024

GBLPAGES_CUR = 102400

GBLSECTIONS_CUR = 1024

PAGEDYN_ALLOCFAIL = 0

PAGEDYN_ALLOCFAILPAGES = 0

PAGEDYN_REQUESTS = 107140

Page 22: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 22

AGEN$FEEDBACK.DATAGEN$FEEDBACK.DAT(continued)(continued)

GBLPAGES_PEAK = 43084

GBLSECTIONS_PEAK = 379

DINDXHITS = 77332

DINDXATTEMPTS = 81535

DIRHITS = 62936

DIRATTEMPTS = 66405

HDRHITS = 65647

HDRATTEMPTS = 86317

SWAPFILE1_PEAK = 0

PAGEFILE1_NAME = "SYS$SYSTEM:PAGEFILE.SYS"

PAGEFILE1_PEAK = 21597

Page 23: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 23

AGEN$PARAMS.REPORTAGEN$PARAMS.REPORT

NPAGEDYN parameter information:

Feedback information.

Old value was 1339904, New value is 1667584

Maximum observed non-paged pool size: 1667584 bytes.

Non-paged pool request rate: 0 requests per 10 sec.

Override Information - parameter calculation has been overridden.

The calculated value was 1585664. The new value is 1667584.

NPAGEDYN is not allowed to be less than 1667584.

ACP_DIRCACHE parameter information:

Feedback information.

Old value was 162, New value is 162

Hit percentage: 99%

Attempt rate: 3 attempts per 10 sec.

Page 24: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 24

MODPARAMS.DATMODPARAMS.DAT

Edit this file, then use AUTOGEN to change system parameters.

AUTOGEN “knows” about interrelated system parameters.

Feedback is good, but you need to guide AUTOGEN.

Use MIN_ and MAX_ rather than hard values when appropriate.

Include comments, keep old versions for your records.

Page 25: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 25

MODPARAMS.DATMODPARAMS.DAT(Example 1)(Example 1)

MIN_GBLPAGES = 102400

MIN_GBLSECTIONS = 1024

MIN_LNMSHASHTBL = 512

LOCKDIRWT = 0

MIN_LOCKIDTBL = 1024

MIN_MAXPROCESSCNT = 90

MIN_NPAGEDYN = 1667584

MIN_PAGEDYN = 1065472

MIN_RESHASHTBL = 300

SCSNODE = "PIRULO"

SCSSYSTEMID = 65381

Page 26: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 26

MODPARAMS.DATMODPARAMS.DAT(Example 2)(Example 2)

!MIN_IRPCOUNT=2245 ! increase for VMS 5.2 T. Hickman 17-Jan-90

MIN_LRPCOUNT=12 ! increase for PSI B. Z. Lederman 17-Aug-89

MIN_GBLSECTIONS=350 ! For Rdb 3.0A B. Z. Lederman 14-Aug-89

!MIN_NPAGEDYN=600000

MIN_NPAGEVIR=1100000

! Proposed changes 6-Mar-1990 B. Z. Lederman

ACP_QUOCACHE = 0 ! disk quotas not used

MIN_CLISYMTBL = 500 ! command interpretor symbol table

MIN_LNMSHASHTBL = 1024 ! fast logical name table lookup

MIN_SRPCOUNT = 7000 ! feedback plus observation

MIN_IRPCOUNT = 4000 ! feedback plus observation

MIN_PAGEDYN = 300000 ! feedback

MIN_NPAGEDYN = 750000 ! feedback

Page 27: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 27

Hint for Alpha UsersHint for Alpha Users

VAX and Alpha will expand paged and non-paged dynamic memory (pool).

Performance penalty on VAX relatively small. Performance penalty on Alpha relatively severe. Additional pool usually thousands of bytes: main memory

tens or hundreds of millions of bytes. Pool is cheap; lack of pool is expensive; pre-allocate a

generous amount of pool.

Page 28: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 28

What Does this Really Mean?What Does this Really Mean?(why is this example in this session?)(why is this example in this session?) Check manuals and release notes. All changes need to be evaluated. “Cost vs. Benefit” analysis on changes. “Common Sense” factor. Some resources must be allocated, even if they

are expensive. Most tools only give you raw data, which you

have to interpret.

Page 29: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 29

$ SHOW $ SHOW commandscommands

Many DCL SHOW commands are useful. Try them all.

Page 30: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 30

$ SHOW MEMORY$ SHOW MEMORY

System Memory Resources on 22-MAY-1996 14:37:57.36

Physical Memory Usage (pages): Total Free In Use Modified

Main Memory (512.00Mb) 65536 35801 26998 2737

Virtual I/O Cache (Kbytes): Total Free In Use

Cache Memory 7496 0 7496

Granularity Hint Regions (pages): Total Free In Use Released

Execlet code region 1024 0 566 458

Execlet data region 120 7 113 0

VMS exec data region 2271 0 2271 0

Resident image code region 1024 0 818 206

Slot Usage (slots): Total Free Resident Swapped

Process Entry Slots 267 169 98 0

Balance Set Slots 265 169 96 0

Dynamic Memory Usage (bytes): Total Free In Use Largest

Nonpaged Dynamic Memory 16351232 8235648 8115584 4238592

Paged Dynamic Memory 4513792 1505872 3007920 1491504

Page 31: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 31

$ SHOW MEMORY$ SHOW MEMORY(continued)(continued)

System Memory Resources on 28-MAY-1996 09:15:10.23

Paging File Usage (pages): Free Reservable Total

DISK$OPENVMS062:[SYS0.SYSEXE]SWAPFILE.SYS

4280 4280 5000

DISK$STANDALONE:[SYS0.SYSEXE]SWAPFILE.SYS;1

4992 4992 4992

DISK$OPENVMS062:[SYS0.SYSEXE]PAGEFILE.SYS

25068 11164 26400

DISK$STANDALONE:[SYS0.SYSEXE]PAGEFILE.SYS;1

24516 11165 26392

Of the physical pages in use, 6294 pages are permanently allocated to OpenVMS.

Page 32: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 32

$ SHOW MEMORY /POOL $ SHOW MEMORY /POOL /FULL/FULL

System Memory Resources on 22-MAY-1996 14:38:02.11

Nonpaged Dynamic Memory (Lists + Variable)

Current Size (bytes) 16351232 Current Size (pagelets) 31936

Initial Size (NPAGEDYN) 16351232 Initial Size (pagelets) 31936

Maximum Size (NPAGEVIR) 68845568 Maximum Size (pagelets) 134464

Free Space (bytes) 8235520 Space in Use (bytes) 8115712

Size of Largest Block 4238592 Size of Smallest Block 64

Number of Free Blocks 19803 Free Blocks LEQU 64 Bytes 765

Free Blocks on Lookasides 17789 Lookaside Space (bytes) 3570240

Paged Dynamic Memory

Current Size (PAGEDYN) 4513792 Current Size (pagelets) 8816

Free Space (bytes) 1505824 Space in Use (bytes) 3007968

Size of Largest Block 1491504 Size of Smallest Block 16

Number of Free Blocks 456 Free Blocks LEQU 64 Bytes 442

Page 33: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 33

System AccountingSystem Accounting

Information on processes and images. Peak Working Set, Page Faults, I/O. Can tell you when and how system is used. Can measure application performance. Must be enabled, usually in SYSTARTUP_VMS.COM

$ SET ACCOUNTING /ENABLE = (classes) Can also be enabled on specific images.

Page 34: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 34

Example of SET ACCOUNTINGExample of SET ACCOUNTING

$ SET ACCOUNTING /ENABLE = (BATCH, DETACHED, INTER, -

LOGINFAIL, MESSAGE, NET, PROC, SUBPROC)

(i.e., everything except IMAGE accounting.)

Page 35: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 35

$ ACCOUNTING /FULL$ ACCOUNTING /FULLUsername: SYSTEM UIC: [SYSTEM]

Account: SYSTEM Finish time: 12-APR-1996 13:35:13.57

Process ID: 00000458 Start time: 12-APR-1996 13:34:18.09

Owner ID: Elapsed time: 0 00:00:55.48

Terminal name: RTA1: Processor time: 0 00:00:01.18

Remote node addr: 65381 Priority: 4

Remote node name: PIRULO Privilege <31-00>: FFFFFFFF

Remote ID: LEDERMAN Privilege <63-32>: FFFFFFFF

Remote full name:

Queue entry: Final status code: 00000001

Queue name:

Job name:

Final status text: %SYSTEM-S-NORMAL, normal successful completion

Page faults: 1443 Direct IO: 49

Page fault reads: 41 Buffered IO: 210

Peak working set: 543 Volumes mounted: 0

Peak page file: 3096 Images executed: 10

Page 36: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 36

INSTALLINSTALL

Not just what images are installed and how: also gives usage count and number of shared users.

Don’t worry if installed image isn’t used much. Don’t remove images installed by Compaq. May want to installed images that are often used

and not currently installed. INSTALL can also give global sections and

pages summary.

Page 37: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 37

$ INSTALL LIST /FULL$ INSTALL LIST /FULL

DISK$OPENVMS070:<SYS0.SYSCOMMON.SYSEXE>.EXE

COPY;1 Open Hdr Shar

Entry access count = 206

Current / Maximum shared = 0 / 2

Global section count = 1

DCL;1 Open Hdr Shar Lnkbl

Entry access count = 502

Current / Maximum shared = 10 / 16

Global section count = 1

Page 38: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 38

$ INSTALL LIST $ INSTALL LIST /GLOBAL /SUMMARY/GLOBAL /SUMMARY

Summary of Local Memory Global Sections

377 Global Sections Used, 43084/59316 Global Pages Used/Unused

Page 39: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 39

Application StatisticsApplication Statistics

Some applications show resources used. SORT / MERGE utility is one example. If you write your own applications, consider

adding counters. Sometimes easier to tell what an application is

doing from the “inside” than from the “outside”. OpenVMS RTL functions supply information.

Page 40: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 40

$ SORT /STATISTICS$ SORT /STATISTICS

$ SORT /STAT /NODUP input.file output.file

OpenVMS VAX Sort/Merge Statistics

Records read: 1634 Input record length: 512

Records sorted: 1634 Internal length: 512

Records output: 1634 Output record length: 512

Working set extent: 16400 Sort tree size: 1636

Virtual memory: 2439 Number of initial runs: 0

Direct I/O: 31 Maximum merge order: 0

Buffered I/O: 11 Number of merge passes: 0

Page faults: 1892 Work file allocation: 0

Elapsed time: 00:00:01.09 Elapsed CPU: 00:00:00.72

Page 41: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 41

RTL Routines and LexicalsRTL Routines and Lexicals

LIB$INIT_TIMER LIB$SHOW_TIMER LIB$STAT_TIMER LIB$SHOW_VM LIB$STAT_VM SYS$START_ALIGN_FAULT_REPORT SYS$GET_ALIGN_FAULT_DATA $GETJPI $GETSYI

F$GETJPI F$GETSYI

SYS$EXAMPLES:WORKING_SET.COM

Page 42: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 42

MONITORMONITOR

Displays a wide variety of system resources. Real time display. Capture to a file (text or binary). Can provide summaries, maximums, averages,

etc. Can play back data. Much more than can be shown here: dedicated

session follows this session. Easy to learn from built-in HELP (though

browsing the manuals is also a good idea).

Page 43: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 43

MONITORMONITOR(some capabilities)(some capabilities)

Monitor cluster communications, DECnet, disks, general I/O, MSCP server, locking.

System Modes and States. File system and RMS activities. Processes by the rate they consume: CPU,

Faults, Direct I/O, Buffered I/O. Everything at once. Try all of the commands on your system.

Page 44: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 44

$ MONITOR PAGE$ MONITOR PAGE

CUR AVE MIN MAX

Page Fault Rate 4.80 89.61 4.80 185.57

Page Read Rate 0.00 4.83 0.00 19.60

Page Read I/O Rate 0.00 0.48 0.00 1.96

Page Write Rate 0.00 0.00 0.00 0.00

Page Write I/O Rate 0.00 0.00 0.00 0.00

Free List Fault Rate 3.84 12.07 2.94 22.33

Modified List Fault Rate 0.00 9.17 0.00 31.73

Demand Zero Fault Rate 0.96 66.66 0.96 133.98

Global Valid Fault Rate 0.00 1.20 0.00 4.80

Wrt In Progress Fault Rate 0.00 0.00 0.00 0.00

System Fault Rate 0.00 0.00 0.00 0.00

Free List Size 25444.00 25501.75 25444.00 25620.00

Modified List Size 521.00 495.00 452.00 521.00

Page 45: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 45

$ MONITOR IO$ MONITOR IO

CUR AVE MIN MAX

Direct I/O Rate 0.00 0.19 0.00 0.96

Buffered I/O Rate 0.00 1.74 0.00 2.94

Mailbox Write Rate 0.00 0.00 0.00 0.00

Split Transfer Rate 0.00 0.00 0.00 0.00

Log Name Translation Rate 8.73 7.93 6.86 8.73

File Open Rate 0.00 0.00 0.00 0.00

Page Fault Rate 3.88 72.34 3.88 187.50

Page Read Rate 0.00 3.86 0.00 19.60

Page Read I/O Rate 0.00 0.38 0.00 1.96

Page Write Rate 0.00 0.00 0.00 0.00

Page Write I/O Rate 0.00 0.00 0.00 0.00

Inswap Rate 0.00 0.00 0.00 0.00

Free List Size 25440.00 25489.40 25440.00 25620.00

Modified List Size 525.00 501.00 452.00 525.00

Page 46: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 46

$ MONITOR FCP$ MONITOR FCP

CUR AVE MIN MAX

FCP Call Rate 65.38 11.09 0.00 65.38

Allocation Rate 0.00 0.16 0.00 0.96

Create Rate 0.00 0.00 0.00 0.00

Disk Read Rate 0.00 0.00 0.00 0.00

Disk Write Rate 13.46 2.41 0.00 13.46

Volume Lock Wait Rate 0.00 0.00 0.00 0.00

CPU Tick Rate 16.34 2.89 0.00 16.34

File Sys Page Fault Rate 0.00 0.96 0.00 5.76

Window Turn Rate 0.00 0.00 0.00 0.00

File Lookup Rate 50.96 8.52 0.00 50.96

File Open Rate 0.00 0.00 0.00 0.00

Erase Rate 0.00 0.00 0.00 0.00

Page 47: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 47

$ MONITOR SYSTEM$ MONITOR SYSTEM + CPU Busy (5) -+ LEF: 7 LEFO: 0

|* | HIB: 25 HIBO: 0

CPU 0 +--------------------------+ 100 COM: 0 COMO: 0

| | PFW: 0 Other: 1

+--------------------------+ MWAIT: 0

Cur Top: (0) Total: 33

+ Page Fault Rate (3) -+ + Free List Size (25421) -+

|| | |************ | 54K

MEMORY 0 +--------------------------+ 100 0 +--------------------------+

| | |*** | 3800

+--------------------------+ + Modified List Size (544) +

Cur Top: (0)

+ Direct I/O Rate (0) -+ + Buffered I/O Rate (0) -+

| | | |

I/O 0 +--------------------------+ 60 0 +--------------------------+ 150

| | | |

+--------------------------+ +--------------------------+

Cur Top: (0) Cur Top: (0)

Page 48: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 48

DECamdsDECamds

Collects data on several nodes, analyzes it, displays it.

Used to be a layered product: now runs with any OpenVMS license.

Included on the CD-ROM distribution kit. Not installed by default: you must install it. Manuals included in paper documentation kit,

distribution kit, and On-line Documentation kit.

Page 49: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 49

DECamdsDECamds(2)(2)

Two parts: Data Provider on system(s) being measured; Data Analyzer collects and displays data.

Need Workstation with Motif or X-Windows for best display (log file is text).

Does require some processing power for analysis.

Page 50: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 50

DECamdsDECamds(3)(3)

Real-time display of system(s) being monitored: similar to MONITOR with additional capabilities.

Error and Information display: issues warnings when resources are low.

You can run with the defaults, but some investment in time and effort is needed to take advantage of all of it’s capabilities.

In general, the more versatile a tool is the more effort it takes to learn to use it.

The display portion is easy to learn (point and click).

Page 51: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 51

DECamdsDECamds(4)(4)

Other tools provide raw data: DECamds can perform the first step in analysis.

Uses default values for comparison, or you can enter your own.

You run other tools to interrogate system: DECamds can monitor systems and issues warnings.

Page 52: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 52

DECamdsDECamdsInformation Window and Log FileInformation Window and Log File

Time Sev Event

Opening DECamds Event Log on date/time: 17-APR-1996 10:32:17.05

10:32:23.70 80 LOMEMY, WRKHRD free memory is low

10:32:42.31 30 RESDNS, SPLEFX resource hash table dense 142% full (1461 resources, hash table size 1024)

10:32:54.19 75 HIHRDP, WRKHRD hard page fault rate is high

10:32:38.86 60 HIBIOR, SPLEFX buffered I/O rate is high

10:32:59.22 60 HINTER, WRKHRD interrupt mode time is high

10:32:43.87 60 HIBIOR, WRKHRD buffered I/O rate is high

10:35:33.83 60 DSKMNV, ABNRML $10$DKB100($10$DKB100) disk mount verify in

10:35:33.84 60 DSKOFF, SAILOR $4$DRA0((SAILOR)) is offline

10:35:33.86 60 DSKMNV, HEEBEE $10$DKB100($10$DKB100) disk mount verify in

10:42:32.13 60 PRBIOR, WRKHRD AMDS$COMM Buffered I/O rate is high

10:42:27.09 80 LOMEMY, WRKHRD free memory is low

10:42:27.09 60 HIBIOR, WRKHRD buffered I/O rate is high

Page 53: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 53

DECamdsDECamdsSystem OverviewSystem Overview

Page 54: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 54

DECamdsDECamdsCPU Modes SummaryCPU Modes Summary

Page 55: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 55

Customize Events MenuCustomize Events Menu

Page 56: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 56

DECamdsDECamdsProcess DisplayProcess Display

Page 57: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 57

Process DisplayProcess Display(2)(2)

Page 58: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 58

Process DisplayProcess Display(3)(3)

Page 59: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 59

DECeventDECeventDECwindows InterfaceDECwindows Interface

Page 60: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 60

Performance APIPerformance API There is an interface that MONITOR uses to get data. Others would like the same data. The interface is not documented. The interface would not scale well. Changing it would break MONITOR. Alternative is for users to write “Inner Mode” code.

Risky.Difficult to test.Changes with operating system upgrades.

Page 61: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 61

Performance APIPerformance API

Create a new interface based on the old one, but documented.

Incorporates input from customers and third-party products.

Data provider only: you write your own applications. Goal is VAX and Alpha. “Cloned” from existing service, so people who used the

old one should be able to switch easily. New items added as needed.

Page 62: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 62

Performance APIPerformance API

$GETRMIGet Resource Monitor Information

Returns system performance information about the local system.

SYS$GETRMI [efn] ,[nullarg] ,[nullarg] , itmlst ,[iosb] ,[astadr] ,[astprm]

Page 63: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 63

Performance APIPerformance API

RMI$_FRLIST number of pages on the freelist.RMI$_MODLIST number of pages on the modified page list.RMI$_FAULTS number of pages faults per secondRMI$_PREADS number of pages read.RMI$_PWRITES number of pages written.RMI$_PWRITIO physical page write I/O's.RMI$_PREADIO physical page read I/O's. (and more)

Page 64: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 64

Disk AccessDisk AccessYear Drive Average Device

Access Time(mS)

I/O perSecond

1956 RAMAC 1015.0 .981964 2314 112.5 8.91975 3350 36.7 27.31987 3380K 24.6 40.61996 3390-3 23.2 43.11998 Cheetah 18 18.0 55.51996 Elite 23 19.0 52.61997 Elite 47 19.0 52.62000 (est.) 12.0 83.3

Computer Technology Review Storage Inc. Quarter 1 2000

Page 65: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 65

CPU Speed.CPU Speed.Processor Instruction Cycle (nS)PDP-1 5,000 / 10,000PDP-8I 1,500 / 3,000PDP-15 800 / 1,600LSI-11 2,380PDP-11/ 70 300VAX-11/ 785 274µVAX-II 430VAX 3600 180VAX 8550 140VAX 4000-M90 30VAX 9000 17AS210 4/ 166 6AS2100 5/ 250 4AS1000A 56/ 333 3GS160 6/ 833 1+

Page 66: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 66

What’s getting faster?What’s getting faster?

Drive Capacity increase: > 6,000 CPU Performance increase: >3,000

(with increased word size: >15,000)(with pipelining, &c: > 60,000 to 90,000)

Drive Performance increase: 9 CPU and Memory performance increase at a

faster rate than I/O, and I/O probably won’t catch up any time soon.

I/O bottlenecks will continue to be a concern.

Page 67: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 67

It isn’t just disks.It isn’t just disks.

Network I/O is also important. Networks are getting faster (100x improvement

since mid-1980s). Networks are all electronic: easier to improve

speed than with physical devices. Usually easier to install parallel paths.

Page 68: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 68

Throw Hardware at the Problem?Throw Hardware at the Problem?

VAX II & RD53

VAX 3600 & RA82

AS4100 & HSZ40

?????

Page 69: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 69

It’s not just the “big” systems.It’s not just the “big” systems.

Page 70: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 70

VMS is working on this.VMS is working on this.

Shadowing Fastpath Lock Manager Cluster Interconnect and communications File Cache Storage Solutions

Page 71: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 71

The three bottlenecks,The three bottlenecks,

CPU (instructions per second) I/O Memory

Page 72: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 72

will become four bottlenecks (?)will become four bottlenecks (?)

CPU (instructions per second) I/O Memory (quantity) Memory (bandwidth)

particularly on multi-processor systems

Page 73: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 73

or five bottlenecks (?)or five bottlenecks (?)

CPU (instructions per second) I/O Memory (quantity) Memory (bandwidth)

particularly on multi-processor systems Backplane / Bus bandwidth

Page 74: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 74

Locks, SMP Sync.Locks, SMP Sync.

Locking schemes that work well on slower systems don’t always scale.

SMP traps that work well on slower system don’t always scale.

SMP schemes that work on 2 or 4 processors don’t always scale.

User-written schemes should be reviewed.

Page 75: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 75

Code stops working?Code stops working?

Faster CPUs sometimes expose ‘sloppy’ programming (not checking status, etc.).

Multi-processors sometimes expose ‘sloppy’ programming (shared status fields / blocks).

Assuming something will complete in a certain time (or in no less than a certain time) will come back to haunt you.

Page 76: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 76

Keep your tools up-to-dateKeep your tools up-to-date

CC /OPT=(TUNE=EV6) But only if you have the current version of the

compiler! Keeping compilers, etc., up-to-date will probably

become more important in the future.

Page 77: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 77

Other ResourcesOther Resources

Freeware CD DECUS (CD, Tapes, Library, DECUServe) I’ve included my own tools on previous

collections, and on the current collection. www.encompasserve.org www.openvms.compaq.com

Page 78: Www.compaq.com Performance Management and OpenVMS Tools 1 Tools and utilities available with OpenVMS Bart Z. Lederman, OpenVMS Performance Expertise Center

www.compaq.comPerformance Management and OpenVMS Tools 78

QuestionsQuestions