Best Practices for Implementing Unicenter NSM r11.1 in an HA MSCS Environment Part I -Last Revision...

Best Practices for Implementing

Unicenter NSM r11.1 in an HA MSCS Environment

Part I- Last Revision April 24, 2006

Agenda

- This presentation will cover the following topics:

- Introduction to High Availability (HA) and Microsoft Cluster Server (MSCS)

- Preparing Unicenter NSM release 11.1 for MSCS

- Failover Considerations

- Installing Unicenter NSM r11.1

- Remote MDB Install

- Unicenter NSM r11.1 install sharing HA DSM MDB

Disclaimer

- Although the focus of this presentation is on 2 node clusters, Microsoft Cluster supports more than 2 server nodes. The concepts that apply to 2 node clusters also apply to multiple server node clusters

- The topics and procedures provided in this presentation pertain to Unicenter NSM r11.1 which uses an MS-SQL based MDB

- Ingres based MDBs are supported in Unicenter NSM r11 only. Best practices for r11 are provided in a separate presentation

References

- For additional information, review “Appendix C: “Making Components Cluster Aware and Highly Available” in the Unicenter NSM r11.1 Administrator Guide

Introduction

Why Highly Available?

- This presentation assumes you are already familiar with Microsoft Cluster and the benefits of HA solution.

- The main objective of an HA solution is to aim for zero downtime

What is HAS?

- High Availability Service

- HAS is part of CA Common Services (CCS) and is installed automatically when NSM r11.x is installed in MSCS environment

- Specifically designed to exploit full functionality of MSCS clustering and other vendor clusters on different platforms

- Automates the process of detecting the active cluster node and manages the components such as Agent Technology aws_dsm and aws_wvgate

How does HAS work?

- HAS service runs on all server nodes of the cluster

- Highly available CA Applications register components with HAS

- HAS monitors registered cluster resources and notifies them of failed and newly active nodes

- When notification is received from HAS, the HA CA Application stops the component on the failed node and starts it on the newly active node

- Agent Technology exploits this feature by registering aws_dsm component with HAS

HAS Library

- Some CA applications call HAS library to check if the application is running in a cluster environment and to gather other cluster details (e.g., cluster name)

- Several CA applications exploit this library support, including CAM, CCI, Install Process, Agent Technology, World View, etc.

Multiple Server Nodes Cluster

- Windows Server 2003, Enterprise Edition and Datacenter Edition, support 8 node clusters

- HAS also supports more than 2 node clusters

NSM r11.1 Highly Available Components

This shows NSM r11.1 components which are HA.

Note that Enterprise Management – Alert sub component is not HA compliant

HA Agents

- The Agents that can be installed in a cluster setup include:-

- Windows System Agent

- Windows Log Agent

- WMI Agent

- The install process will not display other agents for selection

- Active Directory Agent

- AS400 Agent

Release 11.1 HA Agents

Shows Agents that are selectable in a MSCS environment

Preparing Unicenter NSM r11.1 for MSCS

- Note: If you are installing r11.0, skip this section

Identify Resource Group

The install process requires a resource group.- For the Local MDB:

- MS-SQL Server must already be installed- Install process will automatically list all eligible SQL groups

- For Remote MDB, - If the SQL Server is installed, then the install process will

automatically list all eligible SQL groups. Non-SQL groups will not be included - This is despite the fact you want to connect to a remote MDB.

This behavior is designed to support future installation of manager components, such as WV Manager, where a local MDB is required.

- If SQL server is not installed, then select any other resource group which has Network Name, IP Address and Physical Disk resource types

SQL Instance Resource Group

- Unicenter NSM r11.1 supports SQL instances.

- If multiple SQL instances are installed, you will need to:

- First, identify the SQL instance where MDB is to be installed

- Then, select the SQL resource group where this SQL instance is defined

Resource Groups

- The following shows a cluster setup with 4 resource groups

Resource

- In the previous example, there were 4 cluster groups – each with an IP address, network name and disk resources. However, only two of those groups are eligible for selection.

- SQL InstanceA has SQL Server installed with SQL Instance Name MDBSQL

- SQL InstanceB has SQL Server install with SQL Instance Name SQLINSTB

- SQL InstanceC has no SQL Server instance associated with the group

SQL Instances

SQL Instance MDBSQL

SQL Instances

SQL Instance SQLINSTB

Eligible Resource Groups

This shows two resource groups eligible for selection

Identifying SQL Resource Groups

- Look for cluster resource type of “SQL Server”

Shared Disk

- During the install process, if NSM is selected as HA and local MDB is created, that MDB will be created on the SQL Server shared disk (i.e, where MS-SQL Server instance data files are kept)

- In addition, Unicenter Console Logs, Agent Technology NSM Store, AIS catalog, and other files are also created on the shared disk. This shared disk can be selected during the installation and the recommendation is that it be different from SQL shared disk.

Shared Disk - MDB

Shared Disk – NSM Components

Verify Cluster Setup

- Identify the cluster resource group for NSM r11.1

- MOVE GROUP to verify cluster setup is correctly defined

- If any problems with move group, resolve them PRIOR to the install of NSM r11.1. CA Support cannot address system setup issues

Resource Group – Before NSM Install

Resource Group – After NSM Install

NSM r11.1 HA installation:-

Disk G: Application Shared Disk

Disk H: SQL Shared Disk

Cluster Resources created by the install process

Resource Group

- After NSM r11.1 is installed, NSM resources will be set to “offline”

- This will enable the group to be moved to other cluster nodes where NSM is to be installed

Two Node Cluster setup

SQL Server Instance

aws_dsm aws_wvgate

Enterprise Management

World View

Active Node Components

Failover Considerations

- Active Server crashes

- Cluster Service detects the failure and starts cluster application services on passive node

- Cluster Application failure

- Cluster Service detects the application failure. Offline services on active node and Online services on passive node. Failed application server remains online

- Explicit Move Groups for housekeeping

- Same as Cluster Application failure

Agent Technology - DSM

- awservices will be active on all cluster nodes

- Agent Technology aws_dsm and aws_wvgate will only start on the active node

AT DSM

Active Node

Inactive Nodeaws_snmp may be active on both nodes if performance agents are installed

Installing Unicenter NSM r11.1

Local MDB- Note: If you are installing r11, skip this section

Two Nodes Cluster Install

1. Node A is active Node

2. Install on Node A

3. Move Group

4. Install on Node B

Install Tasks – Node A

- Move Groups to verify cluster is correctly set up

- Identify SQL Cluster resource group for NSM r11.1

- Verify NSM was not previously installed as non-HA

- Move Group to Cluster Node A if Cluster Node A is not active node

- Install NSM components on Node A

- Do not perform any customization!

Install Tasks – Node B

- From Cluster Administrator, offline NSM Resources (NSM install on Node A should have set it offline)

- Move Group to Cluster Node B. Since resources are offline, they will not start on Node B

- Cluster Resource Group Selection window is NOT be displayed when installing on second or subsequent nodes – it is only displayed for first

- Install NSM components on Node B. Select the same options as Install on Node A.

- Once the install on Node B is completed, the system is ready for customization

- MDB is created during install on first Cluster Node.

- On subsequent cluster nodes, install verifies the MDB exists and is at the correct MDB level (1.0.4)

- If it is at the correct level, which it should be, MDB is NOT upgraded or recreated

Install

Resource Groups

This shows cluster resources prior to install

Resource Group Selection

Install process automatically detects if running in a cluster environment and displays Resource Group Selection menu for HA mode

HA vs. Non-HA

- Install process performs several checks prior to displaying HAS Resource Group Selection window

- Install process will not permit mix of non-HA components with HA components if there is any interdependency between them. For example:

- If Agent Technology manager was installed as non-HA and, later, you decide to add an EM component, EM will be forced to be non-HA and the Resource Group Selection window will not be displayed

Installing NSM in NON-HA mode

This window is displayed only if cluster services are installed

Installing NSM in NON-HA Mode- If NSM r11.1 is installed in MSCS environment and the install process is not forced into non-HA mode due to interdependency mix, the HAS Resource Group selection window will be displayed

- If you wish to install in non-HA mode, then deselect “Use Resource Group for HA Install” option

Install

MDB for SQLAT Manager

Install

Note, EM Provider is not selectable

Install

Enterprise Management and WorldView services are forced to manual start as these services run only on Active Node

Install – MDB Setup

Installing in HA mode automatically selects SQL Virtual Node name for Database Server

Install – Database Selection

Install – Event Server

Event Manager set to SQL VNode

Install – Global Catalog

Global Catalog created on the shared disk with SQL Vnode

Global Catalog

Contents of the Global Catalog. Entries with SQL VNode name

Install

Offline Resources

- NSM Resources should be set to offline by the install process. If they are not offline, offline them prior to moving groups

- If NSM Resources are not offline, install process will attempt to start NSM components with move group and this will fail because the components are not yet installed on the new active node

Verify NSM Resources Offline

Active SQL Connections

- If Agent Technology manager is installed, it will automatically start aws_dsm and aws_wvgate.

- If, after moving group to Node B, aws_dsm and aws_wvgate services are not stopped on Node A, manually stop them using “awservices stop”

- awservices is dependent on HAS service. However, if for some reason it is not stopped, the install process on the second cluster node will detect an active SQL client connection and will not let you continue

- This will also be case if any other remote aws_dsms connect to the Node A MDB prior to install on Node B

- Similarly if any other remote WV applications connect to Node A MDB prior to install on Node B, this will also leave active SQL connection

Active SQL Client connection

This shows aws_dsm was not stopped on the first node prior to move group

Install on Cluster Node B

- Install NSM components on cluster Node B. Node B will be active after Move Group

- Select same options (e.g., directory names, shared disk, etc.) as the install for Node A

- Subcomponent selections, however, can be different if necessary. If so, this requirement should be reviewed carefully as you may comprise HA. For example:

- Enterprise Management subcomponent Job Management Option (JMO) was selected on Node A but not on Node B. If Node A fails, then the Workload Manager will not run on Node B – potentially compromising failover of JMO.

Node B - Install

Reboot

- After the install completes on all cluster nodes, start the customization

- If the install process requires reboot, do the following:

- Move Group to Cluster Node A. If reboot was required on Node A, this should have been carried out while Node B was active

- Put NSM cluster resources online if they are offline

- Reboot Cluster Node B

Installing NSM r11.1Remote MDB

- Note: If you are installing r11, skip this section

Remote MDB

- This section shows how to install HA NSM components connecting to a remote SQL MDB.

- Installation of SQL Client is required to enable connection to a remote SQL MDB.

- Certain Manager components, such as WV Manager, can only be installed if local MDB is used

Two Nodes Cluster Install

Cluster Node Cluster Node Real node A Real node B

1. Node A is active Node

2. Install on Node A

3. Move Group

4. Install on Node B

Install Tasks – Node A

- Move Groups to verify cluster is correctly set up

- Identify the Cluster resource group for NSM r11.1.

- Since SQL server is not installed, this will be the resource group that has IP address, network name and disk resources defined

- Verify NSM was not previously installed as non-HA

- Move Group to Cluster Node A if Cluster Node A is not active node

- Install NSM components on Node A

Install Tasks – Node B

- From Cluster Administrator, offline NSM Resources (NSM install on Node A should have set it offline)

- Move Group to Cluster Node B. As the resources are offline, they will not start on Node B.

- Cluster Resource Group Selection window will not display when installing on second or subsequent nodes – it is only displayed for the first node

- Install NSM components on Node B, selecting the same options as for Node A

- Once the install on Node B is complete, the system is ready for customization

Install – Remote MDB

Resource Group

SQL Server is not installed so there is no SQL Resource Group. In this case, it displays the resource groups that have IP address, network name and disk resources defined

Resource Group

Remote MDB

Management Database, Worldview Manager and Worldview Provider cannot be selected as there is no SQL Server

Remote MDB – Component Restrictions

Worldview – Remote MDB

Enterprise Manager

DIA - SRV

SRV record not defined. Manual customization is required

Database Configuration - EM

Database Configuration – CORE

Install Process

- When the install process on Node A completes successfully, move group and repeat the same process on subsequent nodes

Installing Unicenter NSM r11.1

Sharing HA MDB Created by Unicenter DSM

- Note: If you are installing r11, skip this section

HA MDB

- This section demonstrates how to install Unicenter NSM that will use a shared HA MDB created by Unicenter Desktop and Server Management (DSM) r11.1

Unicenter NSM Install Sharing HA MDB- If you are installing Unicenter NSM and intend it to share an

HA MDB that was created by Unicenter DSM, you must still select the “Install MDB” option, even though the MDB already exists

- This is because the NSM install requires the MDB to be locked down

- If the SQL MDB already exists, it will not be recreated by NSM install process. Instead, the install will verify if the MDB is at the correct level or if an upgrade of MDB is required. If no upgrade is required, the install will simply exit and lock down the MDB

- The rest of install is same as described in Section 2

Best Practices for Implementing Unicenter NSM r11.1 in an HA MSCS Environment Part I -Last Revision...

Documents

FABp4 ctr E-MSCs 0 10 20 30 AU OC ctrE-MSCs 0 10 20 30 AU Col2a1 ctr E-MSCs 0 10 20 30 AU AB C controlE-MSCs 7dcontrolE-MSCs 7d Figure 1S Multipotency

AppManager Connector for CA Unicenter NSM

MSCS With VMWare

DSM Scalability Considerations for Unicenter NSM r11

Best Practices for Implementing Unicenter Asset Portfolio Management r11.2 in an HA MSCS Environment -Part I: Installing UAPM Optional Components Draft

Unicenter Service Desk Itil User Guide3758

Unicenter Asset Portfolio Management 11.3.4 Service Release Summary John Fulton Director, Product Management, Unicenter APM February 14, 2008 CA Blue R0

· Web viewIsolation of the rat bone marrow MSCs (BM-MSCs) and adipose tissue MSCs (AD-MSCs) and assessing their growth kinetics and their role in improvement of angiogenesis after

SJ-20100211152857-006-ZXWN MSCS (V3.09.21) MSC Server Data Configuration Guide(MSCS)

Unicenter AutoSys Job Management - Write Trends

Unicenter AutoSys Job Management - Cluster

1 Making Unicenter talk through a Firewall Unicenter NSM Revised August 11 2003

Unicenter NSM Debugging Tips & Tricks -Release r11

ALE Interoperability Tests Reports OTBE R2.1 OXE R11.1

CA 7 r11.1 Features and Functions · > CA 7 WA will optionally track the event of VSAM cluster closes when the cluster is opened for update ... CA 7 r11.1 Features and Functions

Unicenter Automatic Duplicate Suppression EvtADS

Best Practices for Implementing Unicenter Service Desk r11.x in an HA MSCS Environment - Part 3: HA Primary Server Revised January 02, 2009 Although this

LTU Armadillo 2007 IGVC Jeremy Gray, BSEE; Shawn Ellison, MSCS; Phil Munie, MSCS; Brandon Bell, MSCS

SPECTRUM CA Unicenter NSM Agent User Guide (5174)

Best Practices for Implementing Unicenter NSM r11 in an HA MSCS Environment Part I -Last Revision April 24, 2006