Pre-Con Ed: CA Workload Automation ESP Edition: SLA Management and Business Continuity

World®’16

CAWorkloadAutomationESPEditionSLAManagementandBusinessContinuitySteveWotton,CATechnologies,Sr.PrincipalConsultant

MFX26E

MAINFRAMEANDWORKLOADAUTOMATION

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

InthissessionyouwilllearnhowyoucanbenefitbyactivatingdynamicCriticalPathAnalysisandbyusingCAWorkloadAutomationServiceGovernorESPEdition(CAWAServiceGovernorESPEdition)andCAWorkloadAutomationHighAvailabilityESPEdition(CAWAHighAvailabilityESPEdition).

SeehowtoidentifyjobsonthecriticalpathandshortentheelapsedtimeofanESPApplicationbyleveragingCAWAServiceGovernorESPEditiontogiveprioritytothosecriticaljobsmostlikelytoimpactyourSLAobjectives.

YouwillalsolearnhowtotakeadvantageofCAWAHighAvailabilityESPEditionwhichusesIBMclusteringSysplextechnologytoensureenterprisejob-streamscontinuetorununinterruptedintheeventofeitheraplannedorunplannedoutageoftheprimaryCAWorkloadAutomationESPEdition(CAWAESPEdition)system.

SteveWotton

CATechnologiesSr.PrincipalConsultant


Agenda

CRITICALPATHANALYSIS

CAWORKLOADAUTOMATIONSERVICEGOVERNORESPEDITION

CAWORKLOADAUTOMATIONHIGHAVAILABILITYESPEDITION

1

2

3


CriticalPathAnalysis



§ YoucanidentifyajobwithinanApplicationthatrepresentsacriticalpointofthejob-stream,andthelongestpathtothatjobbasedonhistoricalexecutiontime,isacriticalpath

§ Ifyoudonotidentifyanyjobsascritical,thelongestpathbasedonhistoricalexecutiontime,tothejobthatwillfinishlastisidentifiedandthatpathisdeemedthecriticalpath

Overview



§ MultiplecriticalpathsmayexistinasingleApplication

§ Thecriticalpathisrecalculatedasworkloadprogresses,withanticipatedendingtimesbeingreevaluatedandbothgraphicalandcustomviewrepresentationsupdatedasrequired

Overview


TurningonCriticalPathAnalysisExample


TurningonCriticalPathAnalysis

§ UseCRITICALkeywordtoforceajobontothecriticalpathevenifhistoricalrun-timeswouldnothavedeemeditascritical

APPLBILLINGWAITCRITPATHONJCLLIB'WOTST01.DEMO.CNTL'NOTIFYOVERDUEFAILURE

JOBBACKUPRUNDAILYRELEASE(XREF)DUEOUTEXEC19:30

ENDJOB

JOBXREFCRITICALRUNDAILYRELEASE(SADGEN)

ENDJOB

JOBSADGENRUNNDAILY

ENDJOB


DisplayingtheCriticalPath

– EasilyidentifyyourCriticalJobswithinGraphicalVieworwithCustomViews

– Anticipatedendingtimesareautomaticallycalculatedandthecriticalpathisre-drawnasnecessary

– Optionally,leverageCAWAServiceGovernorESPEditiontoexpeditejobsonthecriticalpath


DisplayingtheCriticalPath

– CriticalPathdisplaycanspanApplicationsthroughanExternaljobdependency

TwodifferentApplications

CAWorkloadAutomationServiceGovernorESPEdition


CAWAServiceGovernorESPEdition

§ CAWAServiceGovernorESPEditioncanhelpensureyoumeetyourSLACommitmentsbyenactingpredictiveprioritizationofcriticalworkloadsbasedontheirscheduledefinitions,theprocessingloadontargetsystemsandbyinteractingdirectlywithIBM’sWorkloadManager(WLM)

Overview


CAWAServiceGovernorESPEdition

§ Performsthefollowing3primarytasks:1. JobExpeditehelpsprovideameansofacceleratingajob-streamsby

givingprioritytojobsforwhichSLAsaredefined,basedonDUEOUTorcriticalpathspecifications,therebyshorteningtheoverallelapsedtimerequiredtorunthebatchworkload

2. WorkloadBalancingselectswheretorunworkloadbasedonsystemload,usingfeedbackfromIBM’sWLMforz/OSsystemsandAgentpollingfordistributedsystems

3. ResourceBalancingmonitorsallCAWAESPResourcesinthetopologyanddetermineswhichCPUhasmoreavailableResources,andselectsthatCPUtomoreevenlydistributeworkload

Overview


JobExpedite

§ WheneveranSLAisdefinedinanCAWAESPApplicationviatheDUEOUTstatement,orajobisonthecriticalpath,theJobExpeditefeaturegivesspecialtreatmenttothosejobstreams

§ JobExpediteinteractswiththeoperatingsystemtoincreasethedispatchpriorityofthejobinquestion,togetthejob-streambackontracktowardsmeetingthedefinedSLA

§ ActionsarebasedonbyExpeditePoliciesdefinedinCAWAESPEditionInitializationParameters

Overview


JobExpedite

§ z/OSjobhasnotyetbeensubmitted:– IncreasetheResourcepriorityifthejobiswaitingforCAWAESP

Resources

§ z/OSjobhasbeensubmittedbuthasnotstartedexecution:– Changethejob’sJESExecutionClass– Changethejob’sJESPriority– Startthejobimmediately

§ z/OSjobisinexecution:– Changethejob’sServiceClass(IBMWLMGoalMode)– Changethejob’sPerformanceGroup(IBMWLMCompatibilityMode)

Overview


JobExpediteExample EXPEDITEGOFASTADDOVERDUEPRIORITY(15)SRVCLASS(JES_FAST)

EXPEDITESLAFASTADDALLOVERDUECRITICAL_PATH-SRVCLASS(JES_SLOW)ESP_PRIORITY(20)CLASS(H)START-PRIORITY(13)

APPLJCLLIB‘MY.PROD.JCLLIB'EXPEDITEGOFAST

JOBJOB001RELEASEJOB002RUNDAILY

ENDJOB

JOBJOB002EXPEDITEOFFRELEASEJOB003RUNDAILY

ENDJOB

JOBJOB003EXPEDITESLAFASTRUNDAILY

ENDJOB

JOBJOB004DUEOUT8amRUNDAILY

ENDJOB


CAWorkloadAutomationHighAvailabilityOptionESPEdition


CAWAHighAvailabilityOptionESPEdition

§ TakesfulladvantageoftheIBMSysplextechnologybyleveragingXCFcommunicationservicestoimprovetheavailabilityofsystemresources

§ Provides4primarybenefits:1. Automaticfailover– ShadowManager2. UniversalLogin3. ARMRegistration4. XCFIntervalStatusMonitoring

Overview


Network

PrimaryESPManagerShadowManager

ESPProxyShadowManager



Client`

XCFenabled

AgentsonDistributedServers

– CAWAESPShadowManagermonitorsthecurrentlyactiveCAWAESPMasterinitsXCFgroup

– WhentheCAWAESPMasterterminates,theShadowManagertakesactionaccordingtoShadowGoals

– ThemostcommonactionofanESPShadowManageristotakeoverastheCAWAESPMaster

– Enablesbothmainframeanddistributedprocessingtocontinue

z/OSSysplex

ProvidingHighAvailabilityAcrossTheEnterprise


ProvidingHighAvailabilityAcrossTheEnterprise

§ Inafail-oversituation,processingcontinuesuninterrupted:– JobtrackingandsubmissionwillcontinuebecausetheESPProxyknows

wherethenewCAWAESPMasteriswithintheXCFgroup– CAWAESPWorkstationclientswillbeautomaticallyreconnected

becauseWorkstationServercommunicatestotheCAWAESPProxywhichknowswherethenewCAWAESPMasteris

– DistributedprocessingwillcontinuebecausethenewCAWAESPMasterwillnotifyCAWAESPAgentsofitsnewIPsothattheAgentscanautomaticallyreconnect


WhatisaShadowManager?

§ AnESPManagerthat:– EntersShadowModeoninitialstart-up– MonitorstheCAWAESPMasterinitsXCFgroupfortermination

§ Fail(abnormaltermination)

§ Quiesce(normaltermination)

§ Leave(normaltermination)

– Upontermination,initiatestheaction(s)specifiedbytheshadowgoal(s)§ TakeoverasnewESPMaster§ TakeoverasnewCAWAESPMasterandtriggeranESPEvent

§ IssueanMVSoperatorcommand

§ Issueawarningmessage(4397)


SettingUpaShadowManager

§ ItisrecommendedthattheCAWAESPMasterandESPShadowbothreferencethesameInitializationParametermember– UsesameCKPTfile– UsesameSUBSYSID– UsedifferentXCFmembernames(e.g.,use%SHADOWvariable)

SYSPLEX GROUP(DEM54)MEMBER(DEMO54%SHADOW)

Example



§ SpecifyShadowGoalsinInitializationParameters

IF SYSNAME='SYSA' THEN DOSHADGOAL MASTER(FAIL) AFTER(60) WARN TAKEOVERSHADGOAL MASTER(QUIESCE) AFTER(300) WARN COMMAND(‘RO SYSC.S ESPX')SHADGOAL MASTER(LEAVE) AFTER(300) WARN TR(PROD.LEAVEA)ENDDO

IF SYSNAME='SYSC' THEN DOSHADGOAL MASTER(FAIL) AFTER(300) WARN TAKEOVERSHADGOAL MASTER(QUIESCE) AFTER(300) WARN COMMAND(‘S ESPX')SHADGOAL MASTER(LEAVE) AFTER(300) WARN TR(PROD.LEAVEC)ENDDO

Example



§ AnCAWAESPMastercanbeShadowEnabledorShadowDisabled

§ AShadowEnabledCAWAESPMasterbecomesaShadowManagerifitdetectsanalreadyactiveCAWAESPMasterinitsXCFgroup– UsesPRIMARYkeywordoftheESPStartparameter– UsesSHADOW(0)keywordoftheESPStartparameter

§ AShadowDisabledCAWAESPMasterterminatesifitdetectsanalreadyactivemasterinitsXCFgroup– UsesSECONDARYkeywordontheESPStartparameter

Example



§ DefinetheStartedTasksforPrimaryandShadowManagers

//DEMO54 PROC,PREFIX=‘CYB3.DEMO.V54’//IEFPROC EXEC PGM=CYBJS000,PARM='PRIMARY SHADOW(1)’//STEPLIB DD DSN=&PREFIX..SSCPLINK,DISP=SHR//ESPPARM DD DSN=&PREFIX..PARMLIB(CYBESS03),DISP=SHR//ESPCOLD DD DSN=&PREFIX..PARMLIB(CYBESS04),DISP=SHR//ESPWARM DD DSN=&PREFIX..PARMLIB(CYBESS05),DISP=SHR

Example

//DE54SHAD PROC PREFIX='CYB3.DEMO.V54’//IEFPROC EXEC PGM=CYBJS000,PARM='SECONDARY SHADOW(2)'//STEPLIB DD DSN=&PREFIX..SSCPLINK,DISP=SHR//ESPPARM DD DSN=&PREFIX..PARMLIB(CYBESS03),DISP=SHR//ESPCOLD DD DSN=&PREFIX..PARMLIB(CYBESS04),DISP=SHR//ESPWARM DD DSN=&PREFIX..PARMLIB(CYBESS05),DISP=SHR

ShadowEnabledMaster

ShadowDisabledMaster


FailoverInAction

§ XCFDISPLAYGROUPcommandwilldisplaystatusofthedefinedXCFGroupanditsassociatedmembers

XXCF D GGroup=DEM54, Member=DEMO541, TermOpt=QuiesceGroup Member System ASID Jobname SSID ESP StatusDEM54 DEMO541 SYSC 007D DEMO54 DE54 Master ActiveDEM54 DEMO542 SYSA 006C DE54SHAD DE54 Shadow ActiveDEM54 DP1 SYSC 004F DP1 DP1 Proxy ActiveDEM54 DP2 SYSA 0055 DP2 DP2 Proxy Active

XCF D GGroup=DEM54, Member=DP1, TermOpt=QuiesceGroup Member System ASID Jobname SSID ESP StatusDEM54 DEMO541 SYSA 0087 DEMO54 DE54 Unknown ActiveDEM54 DEMO542 SYSA 006C DE54SHAD DE54 Master ActiveDEM54 DP1 SYSC 004F DP1 DP1 Proxy ActiveDEM54 DP2 SYSA 0055 DP2 DP2 Proxy Active

XCFdisplaypriortoCAWAESPMasterbeingcancelled

XCFdisplayafterESPShadowtakesoverasnewESPMaster

XCF D GGroup=DEM54, Member=DP1, TermOpt=QuiesceGroup Member System ASID Jobname SSID ESP StatusDEM54 DEMO541 SYSA 0087 DEMO54 DE54 Shadow ActiveDEM54 DEMO542 SYSA 006C DE54SHAD DE54 Master ActiveDEM54 DP1 SYSC 004F DP1 DP1 Proxy ActiveDEM54 DP2 SYSA 0055 DP2 DP2 Proxy Active

XCFdisplayafterCAWAESPMasterisrestartedandbecomesnewESPShadow


FailoverInActionExample$HASP373 DE54SHAD STARTEDDEMO544217I XCF service TRACKING started, Group=DEM54DEMO544217I XCF service DSTRIG started, Group=DEM54DEMO544217I XCF service ROUTING started, Group=DEM54DEMO544217I XCF service SCOREBD started, Group=DEM54DEMO544280I IXCJOIN, Previously in failed state, Group=DEM54, Member=DEMO542DEMO544390I Master fail shadow goal, After 10 seconds, Warn, TakeoverDEMO544390I Master leave shadow goal, After 10 seconds, Warn, TakeoverDEMO544390I Master quiesce shadow goal, After 10 seconds, Warn, TakeoverDEMO544371I Entering shadow modeDEMO544396I Master fail shadow goal activated, ESP master ended, Member=DEMO541DEMO544397W ESP master DEMO541 in failed state for 10 secondsF DE54SHAD,SHADOW TAKEOVERDEMO544372I Exiting shadow modeDEMO544374I Shadow manager assuming ESP master (primary) roleDEMO541150I 60 APPLICATIONS ARE ACTIVEDEMO54499I ESP RELEASE 5.4.0 INITIALIZED, SUBSYS DE54DEMO544395I Master fail shadow goal takeover complete

ESPShadowtakingoverfromfailedCAWAESPMaster


FailoverInActionExample

$HASP373 DEMO54 STARTEDDEMO541058I Critical path calculation is ENABLEDDEMO544217I XCF service TRACKING started, Group=DEM54DEMO544217I XCF service DSTRIG started, Group=DEM54DEMO544217I XCF service ROUTING started, Group=DEM54DEMO544217I XCF service SCOREBD started, Group=DEM54DEMO544280I IXCJOIN, Previously in failed state, Group=DEM54, Member=DEMO541DEMO544330W XCF member DEMO541 not set to ESP master, ESP master is XCF memberDEMO544390I Master fail shadow goal, After 10 seconds, Warn, TakeoverDEMO544390I Master leave shadow goal, After 10 seconds, Warn, TakeoverDEMO544390I Master quiesce shadow goal, After 10 seconds, Warn, TakeoverDEMO544371I Entering shadow mode

CAWAESPMasterbecomingthenewESPShadow


ESPEnvironmentExample

LPAR1 LPAR2CAESPMaster

CAESPSHDShadow

CAESPP1Proxy

CAESPP2Proxy

High Availability

CAESPW1Workstation

ESP1AUXEncore

ESP2AUXEncore

CAESPW2Workstation

Shared DASDXCF

SMF interceptOFF

SMF interceptON

ESP Agents


ResultsInthissessionwediscussed:§ ActivatingdynamicCriticalPathAnalysistohelpidentifyandmanageyourSLAjob-streams§ LeveragingCAWAServiceGovernorESPEditiontoincreasepriorityandexpeditecriticalworkload§ ExploitingCAWAHighAvailabilityOptionESPEditiontomaintainbusinesscontinuityforbothmainframe

anddistributedworkload

SummaryAFewWordstoReview


Questions?


RecommendedSessionsSESSION# TITLE DATE/TIME

MFX31EBetterBigDataAnalyticswithCAWorkloadAutomationforHadoop

11/14/2016at3:00pm

JasmineB

MFX24EWobtrigs andFileTriggerswithCAWorkloadAutomationESPEdition

11/15/2016at11:00am

JasmineB

MFX33EBestPracticesforsettingupCAWorkloadAutomationESPApplicationProcedures

11/15/2016at1:00pm

JasmineB

MFX129SVisionandRoadmap:CAWorkloadAutomationESPEdition

11/16/2016at12:45pm

JasmineC


MustSeeDemos

ModernWorkloadAutomation

CAWLADEMFandWorkloadAutomation

SeamlessApplicationAutomationAgents&AdvancedIntegrationsMFandWorkloadAutomation

CAConversionasaService

CAWorkloadAutomationMFandWorkloadAutomation

Innovations:CrossEnterpriseWorkloadAutomationCAWLAAE&DEMFandWorkloadAutomation

@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.35 @CAWORLD#CAWORLD

MainframeandWorkloadAutomation

FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI


Thankyou

Stayconnectedatcommunities.ca.com

Technology

Pre-Con Ed: CA Workload Automation ESP Edition: SLA Management and Business Continuity