Embed Size (px)
Citation preview
Copyright © 2017 HCL Products & Platforms | www.hcltech.comPRODUCTS & PLATFORMS
Workload Automation for z - 9.3 and SPEsMarco Cardelli – Workload Automation Offering Manager
© 2014 IBM Corporation2 2015
Automate. Predict. Connect.
IBM Workload Automation v9.3 themes
Automate
Manage the hybrid. Simplify
IT tasks. Embrace new
activities in the automation
Connect
Speeds application
developers’ work,
connecting the automation
with new critical business
applications
Hybrid AcceleratedIntelligent
� Developers pressed by new business driven projects
� Demand for speed and integration
� IT pressed by increased complexity
� Demand for advanced automation, consumability and simplification
� IT pressed by difficult SLA management
� Demand for prediction and optimization
Empowers schedulers’ control
through predictive capability
Predict
IBM Workload Automation v9.3 adds intelligence, integration, and advanced automation to increase productivity and governance, and manage hybrid IT
Design Thinking implementation - designed on customer behaviour
© 2015 IBM Corporation3
Duration feedback process improvementDURATIONDURATIONDURATIONDURATION VARIANCE VARIANCE VARIANCE VARIANCE for each job is calculated and stored in the
database
Planned/estimated start/end time varianceDuration variance is used in the planning phase to calculate the PLANNED START/END TIME VARIANCE PLANNED START/END TIME VARIANCE PLANNED START/END TIME VARIANCE PLANNED START/END TIME VARIANCE for all the jobs.AND THE ESTIMATED START/END TIME VARIANCE AND THE ESTIMATED START/END TIME VARIANCE AND THE ESTIMATED START/END TIME VARIANCE AND THE ESTIMATED START/END TIME VARIANCE for all the jobs
in a critical path.
Dynamic critical path enhancementThe dynamical critical path handler uses the variance to calculate
the estimated end times GAUSSIAN DISTRIBUTIONGAUSSIAN DISTRIBUTIONGAUSSIAN DISTRIBUTIONGAUSSIAN DISTRIBUTION.
New Concepts
Predict: New Confident Factor parameter
© 2015 IBM Corporation4
Confidence factorThe Gaussian distribution is used to calculate the probability that the critical job ACTUAL END ACTUAL END ACTUAL END ACTUAL END is BEFORE ITS DEADLINE BEFORE ITS DEADLINE BEFORE ITS DEADLINE BEFORE ITS DEADLINE (CONFIDENCE CONFIDENCE CONFIDENCE CONFIDENCE
FACTORFACTORFACTORFACTOR)
RISKCONFIDENCE ParameterRISKCONFIDENCE(1RISKCONFIDENCE(1RISKCONFIDENCE(1RISKCONFIDENCE(1----99)99)99)99) allows to link the HIGH RISK level to the
confidence factor rather then simply comparing the estimated
end time to the deadline.
Example: RISKCONFIDENCE(70)
A critical job risk level status will become HIGH RISK when the probability that the actual job end occurs before its deadline, is less than 70%.
Predict: New Confidence Factor parameter
© 2015 IBM Corporation5
Predict: Variable durations
New variable durations and deadlines
• Multiple durations (and deadlines) per single job
• Associated to different run days
• Adjusted by feedback algorithm
Last day of the
week the same
operation
takes longer to complete
In the week-end
the usual deadline
is not needed
to be met
© 2015 IBM Corporation6
Sysplex A
LPAR 2LPAR 1
TrackerTracker
Controller
Databases
Sysplex B
LPAR 2LPAR 1
Tracker
Tracker
Hot Standby
Databases
Need
• Enable sysplex failover
• Planned and unplanned failures
• Shortest RTO and RPO
Mirror plans and data to remote site in near real time
JT, CP1/2 NCP CX NCX XD1/2 AD WS RD OI
Solution
New component: backup Controller
Planned and unplanned failover
• Switch Controller
• Switch Controller and trackers
Reverse switch from backup to primary
Pre-requisites
TCP/IP connection between sites
Challenge
Automate: Remote Hot StandBy Controller
© 2015 IBM Corporation7
WAPLBatch/STC/TSO
90 commands
Function commands
ADD LISTJOB LISTSTATGETDATES etc
Occurrence commands
RUNIF ALTIF Commands in USRF etc
Current Plan Commands
HOLD RELEASE NOPUNNOP ALTER BIND etc
Data commands (PIF)
LIST SELECT DELETEMODIFY INSERT etc
Programming language
Variables, FunctionsIF/THEN/ELSE REXXDO/UNTIL/WHILE etc
TSO commands
OPSTAT SRSTATWSSTAT OPINFO etc
Batch Loader
ADSTART CLSTART ETTSTART WSSTART etc
Communication
SENDMAIL SENDMSGCONSOLE DISPLAY etc
Workload Automation Programming Language for z/OS
Automate: WAPL
v9.3 – Workload Scheduler for z/OS SPEs: latest enhancements
� Insightful audit (PI48075, PI48133, PI54662)
� Additional CP-related auditing information for JT logs
� New DB-related auditing information (new set of JT-like sequential datasets)
� New support for d-driven agents (PI47613)
� JES3 support
� Enhanced security (PI57531)
� Finer-graned security access level
� NOP and MH in operation definition (PI57310)
� NOP, MH definitions in AD at operation level
� NOP, MH and Critical Job definitions in the run cycle options
� Application dependencies (PI62520, PI62521)
� Application depends on an application
� Operation depends on an application
� Application depends on an operation
� Output collector – jobname for Writer ID (PI63396)
� New optional parameter to fill the Writer ID field with the jobname
Modern Workload Automation
9
© 2016 IBM Corporation
IT Leaders need to simplify operations and reduce total cost of ownership
Everything is getting more complex and
I’m alone here
I need the product to more easily fit with complex scenarios
The need for modern workload automation
© 2016 IBM Corporation
Timeline of features for modern automation
� Easier management of
operations time-zone
(PI47506)
� NOP and MH in
operation definition
(PI57310)
� Application dependencies
(PI62520, PI62521)
2015
2Q 3Q 4Q 2Q 3Q 4Q1Q
2016
End-to-end
� Zero downtime for z-
Centric agent upgrade
(IWSd v9.4)
� New support for d-
Driven agents
(PI47613 )
End-to-end
© 2016 IBM Corporation
Features for modern automation - Details
• Easier timezone management for time-dependent operations
• New «/F subsys, RFRUX14T» modify command to reload exit 14 criteria table with no recycle
• New support for d-Driven agents
• D-Driven agents can now run in a JES3 environment
© 2016 IBM Corporation
Zero downtime for z-Centric agent upgrade - Details
Value Solution
� Planning the maintenance of your
agents no longer means negotiating
rare idle time windows
� Perform the upgrade of the agents
without need to stop the submission
© 2016 IBM Corporation
NOP and MH options in operation definition - Details
Value Solution
� Dynamic schedules, with variable
applications, allow easier mapping
of various scenarios
� Depending on when they run,
applications can have different
scheduling rules
� The following settings can be
specified in the “Time Specification”
section of operation definition:
� NOP
� Manual Hold
� Critical job indicator
© 2016 IBM Corporation
NOP, MH and CRIT for a Time Dependent job
Automatic
Option
Default: No Critical Path
Time & Run Cycle
Options
Except Monday: Initially NOped in CP
Only Monday: Initially Manually Held and in Critical Path
© 2016 IBM Corporation
New application dependencies - Details
Value Solution
�More flexible definition of
workflows
� Eliminate possible dummy jobs,
specifically created to link
applications
�Now, you can specify
operations/applications
dependencies as follows:
� An operation depends on
another operation
An operation depends on an
application
An application depends on
another application
An application depends on an
operation of another application
© 2016 IBM Corporation
New application dependencies - Scenario
Appl XYZ1
NETZ2
NETZ
10
NN91
20
NN91
21
NN9122
NN91
255
NETZ
Operations 1, 2 and 255 are used as place holder for
dependencies to other applications
Appl XYZ
After implementing application dependencies
operations 1, 2 and 255 have been replaced by deps
on other applications
Dep on ABC
Dep on DEF
10
NN91
20
NN91
21
NN9122
NN91
Dep on GHI
Agile Workload Automation
1
8
© 2016 IBM Corporation
IT Leaders need to confidently extend the product access to Developers
I need to give I need to give workload automation access to developers,
for everyone’s benefit..
With Developers entering WA, I need to manage the Wild West!
The need for superior control and audit
© 2016 IBM Corporation
Timeline of features for superior audit and control
2015
2Q 3Q 4Q 2Q 3Q 4Q1Q
2016
Insightful audit
(PI48075):
Enhanced security:
�Finer-grained
security access level
(PI57531)
Insightful audit
(PI48133):
Insightful audit
(PI54662):
© 2016 IBM Corporation
Insightful Audit - Details
Value Solution
� Being ready to track detailed
auditing info for any changes to
scheduling objects:
� When
� Who
� How
� What
� Additional CP-related auditing
information (JT logs):
� Manually completed occurrences
� Automatic completion of internal
completed predecessors
� Job name added
� Old status added to operation
records
� Possibility to filter Auditing info
� New DB-related auditing
information (new set of JT-like
sequential datasets: EQQDB*)
© 2016 IBM Corporation
Enhanced Security - Details
Value Solution
� More granularity in security access
help guarantee product stability
� Secure actions, in addition to data
� Security access can now be
controlled at any level, from object
level down to action level
© 2016 IBM Corporation
AUTHDEF
COMMAND1(J,ARC,…)
SUBRESOURCES(CP.ADDOPER,
CP.COMMAND1)
RACF Commands
RDEF IBMOPC CP.ADDOPER
PERMIT CP.ADDOPER ID(JASON) ACCESS(UPDATE) CLASS(IBMOPC)
Fixed
resource
Subresource &
RACF resource
name
Description
CP CP.ADD Add workload (occurrences or operations)
CP.MODIFY Modify attributes
CP.DELETE Delete workload (occurrences or operations)
CP.COMMANDx Line commands
CP.ADDOPER Add operations
CP.DELOPER Delete operations
CP.MODOPER Modify operations
CP.ADDDEP Add dependencies
CP.DELDEP Delete dependencies
CP.MODDEP Modify dependencies
CP.MODOPSTAT Modify operation status
• Define actions as sub-resources in AUTHDEF statement
• Use RACF commands to provide/deny access to users
Enhanced Security - DetailsOccurrence Commands
• RG Remove from group
• DG Delete group
• CG Complete group
• C Complete an occurrence
• W Set waiting
• R RerunOperation Commands
� J Edit JCL (J command resource)
� MH, MR Manual Hold, Manual Release (MR, MH command
resources)
� NP, UN NOP,UN NOP (NP, UN command resources)
� K Kill (K command resource)
� EX Execute (EX command resource)
� JR/FJR JT, Fast path JR (JR command resource)
� SR/FSR SR, Fast path SR (SR command resource)
� SC/FSC SC, Fast path SC (SC command resource)
� SJR Simple Job Restart Execute (SJR command resource)
� R Reset Status (MODOPSTAT resource)
� BIND Bind operation (BND command resources)
� N Set NEXT logical status (MODOPSTAT resource)
� N-x Set specific status (MODOPSTAT resource)
© 2016 IBM Corporation
Enhanced Security - Scenarios
Tim, the System
Administrator
Tim can now authorize Jason, the
Scheduler, to add operations to the
Current Plan.
In the same time, he can prevent him
from adding new occurrences.
Jason, the scheduler
Tim can secure a set of commands, creating new User
Profiles.
• He can authorize Jane to perform a recovery action
• He can authorize Jason to Complete and Rerun an existing
occurrence, but prevent him from adding new occurrences
Jane, the Application Developer
1 2
© 2016 IBM Corporation
• Define the CP.ADD and CP.ADDOPER
subresources in the AUTHDEFSUBRESOURCES(CP.ADD,CPADDOPER)
(AUTHDEF statement)
• Define them to RACF and give
universal NONE access by defaultRDEF IBMOPC CP.ADD
RDEF IBMOPC CP.ADDOPER
• Give user Jason update access to the
CP.ADDOPER resource PERMIT CP.ADDOPER ID(JASON)
ACCESS(UPDATE) CLASS(IBMOPC)
• Define the CP.COMMANDx subresources in the
AUTHDEFAUTHDEF CLASSNAME(IBMOPC)
COMMAND1(ARC)
COMMAND2(C,R)
SUBRESOURCES(CP.COMMAND1,CP.COMMAND2)
• Define to RACFRDEF IBMOPC CP.COMMAND1
RDEF IBMOPC CP.COMMAND2
• Give Jane update access to CP.COMMAND1 PERMIT CP.COMMAND1 ID(JANE) ACCESS(UPDATE)
CLASS(IBMOPC)
• Give Jason update access to CP.COMMAND2 PERMIT CP.COMMAND2 ID(JASON)
ACCESS(UPDATE) CLASS(IBMOPC)
1 2
Enhanced Security - Scenarios
26 | Copyright © 2017 HCL Products & Platforms | www.hcltech.comPRODUCTS & PLATFORMS
- IBM Workload Automation –
Modern Workload Automation integrating IT, Operational and Business workflows to orchestrate the execution of services built to operate in hybrid cloud environments
Thank you!
http://www.workloadautomation-community.com/
