01 Cluster Ware Install JMW4

8/7/2019 01 Cluster Ware Install JMW4

http://slidepdf.com/reader/full/01-cluster-ware-install-jmw4 1/48

Copyright © 2006, Oracle. All rights reserved.

Oracle Clusterware Installation

and Configuration



Copyright © 2006, Oracle. All rights reserved.1 - 2

Objectives

After completing this lesson, you should be able to:

� Describe the installation of Oracle RAC 10g

� Perform RAC preinstallation tasks

� Perform cluster setup tasks� Install Oracle Clusterware




Oracle RAC 10g Installation

� Oracle RAC 10g incorporates a two-phase installation

process:

± Phase one installs Oracle Clusterware.

± Phase two installs the Oracle Database 10g software with

RAC.







Oracle RAC 10g Installation: Outline

1. Complete preinstallation tasks:

± Hardware requirements

± Software requirements

±

Environment configuration, kernelparameters, and so on

2. Perform Oracle Clusterware installation.

3. Perform ASM installation.

4. Perform Oracle Database 10g software

installation.5. Install EM agent on cluster nodes.

6. Perform cluster database creation.

7. Complete postinstallation tasks.




Windows and UNIX Installation Differences

� Startup and shutdown services

� Environment variables

� DBA account for database administrators

� Account for running the OUI




Preinstallation Tasks

Check system requirements.

Check software requirements.

Check kernel parameters.

Create groups and users.Perform cluster setup.




Hardware Requirements

� At least 1 GB of physical memory is needed.

� A minimum of 1 GB of swap space is required.

� The /tmp directory should be at least 400 MB.

� The Oracle Database 10g software requires up to 4 GB

of disk space.

# gre p Me mTotal /proc/m e minfo

Me mTotal: 1126400 kB

# gre p SwapTotal /proc/m e minfo

SwapTotal: 1566328 kB

# d f -k /tmpFilesyste m 1K-blocks Used Availa ble Use%

/dev/sd a6 6198556 3137920 2745756 54%




Network Requirements

� Each node must have at least two network adapters.

� Each public network adapter must support TCP/IP.

� The interconnect adapter must support User Datagram

Protocol (UDP).� The host name and IP address associated with the

public interface must be registered in the domain nameservice (DNS) or the /etc/hosts file.




Virtual IP Addresses and RAC

ERP=(DESCRIPTION=((HOST=clusnode-1vip))

((HOST=clusnode-2vip))

(SERVICE_N AM E=ERP))

clnode-1

ERP=(DESCRIPTION=((HOST=clusnode-1))

((HOST=clusnode-2))

(SERVICE_N AM E=ERP))

Timeoutwait

clnode-2

clnode-1 clnode-2

2

5

3

7

clnode-1vip

clnode-2vip

2

clnode-1vipclnode-2vip

3

4

7

Clients

14

6

15

6




RAC Network Software Requirements

� Supported interconnect software protocols are

required:

± TCP/IP

± UDP

± Reliable Data Gram

� Token Ring is not supported on AIX platforms.




Package Requirements

� Package versions are checked by the cluvfy utility.

� For example: Required packages and versions for Red

Hat 3.0:

± gcc-3.2.3-34

± gli bc-2.3.2-95.27

± compat-db-4.0.14.5

± compat-gcc-7.3-2.96.128

± compat-gcc-c++-7.3-2.96.128

±compat-li bstd c++-7.3-2.96.128

± compat-li bstd c++-devel-7.3-2.96.128

± openmotif21-2.1.30-8

± setarch-1.3-1




hangcheck-tim er Module Configuration

� The hangcheck-tim er module monitors the Linux

kernel for hangs.

� Make sure that the hangcheck-tim er module is

running on all nodes:

� Add entry to start the hangcheck-tim er module on all

nodes, if necessary:

# /sbin/ls mod |gre p ±i hang

M od ule Size Used by Not tainted

hangcheck-tim er 2648 0 (unused )

# vi /etc/rc.local

/sbin/ins mod hangcheck-tim er hangcheck _ tick=30\hangcheck _ margin=180




Required UNIX Groups and Users

� Create an oracle user, a dba, and an oinstall group

on each node:

� Verify the existence of the no body nonprivileged user:

# groupadd -g 500 oinstall

# groupadd -g 501 dba

# useradd -u 500 -d /hom e/oracle -g "oinstall" \

±G "dba" - m -s / bin/ bash oracle

# gre p no body /etc/passwd

No body:x:99:99: No body:/:/sbin/no body




The oracle User Environment

� Set umask to 022.

� Set the DISPL AY environment variable.

� Set the OR ACLE_ BASE environment variable.

� Set the T M P and T M PDIR variables, if needed.

$ cd

$ vi .bash _ profile

umask 022

OR ACLE_ BASE=/u01/app/oracle; export OR ACLE_ BASET M P=/u01/m ytmp; export T M PT M PDIR=$T M P; export T M PDIR




User Shell Limits

� Add the following lines to the/etc/security/limits.conf file:

� Add the following line to the /etc/pam .d /login file:

* soft nproc 2047

* hard nproc 16384

* soft nofile 1024

* hard nofile 65536

session req uired /li b/security/pam _ limits.so




Configuring for Remote Installation

The OUI supports User Equivalence or Secure Shell (ssh)

for remote cluster installations. To configure user

equivalence:

1. Edit the /etc/hosts.eq uiv file.

2. Insert both private and public node names for each

node in your cluster.

3. Test the configuration using rsh as the oracle user.

# vi /etc/hosts.eq uiv

ex0044

ex0045

$ rsh ex0044 unam e ±r

$ rsh ex0045 unam e ±r




Configuring for Remote Installation

To configure Secure Shell:

1. Create the public and private keys on all nodes:

1. Concatenate id _ dsa. pu b from all nodes into the

authorized _ keys file on the first node:

1. Copy the authorized _ keys file to the other nodes:

[ex0044]$ /usr/ bin/ssh-keygen -t dsa

[ex0045]$ /usr/ bin/ssh-keygen -t dsa

[ex0044]$ ssh ex0044 "cat ~/.ssh/id _ dsa. pu b" >> \

~/.ssh/authorized _ keys[ex0044]$ ssh ex0045 "cat ~/.ssh/id _ dsa. pu b" >> \

~/.ssh/authorized _ keys

[ex0044]$ scp ~/.ssh/authorized _ keys ex0045:/hom e/oracle/.ssh/







Required Directories for the

Oracle Database Software

You must identify five directories for the Oracle database

software:

� Oracle base directory

� Oracle inventory directory� Oracle Clusterware home directory

� Oracle home directory for the database

� Oracle home directory for ASM







Linux Operating System Parameters

Parameter Value File

se mm sl 250 /proc/sys/kernel/se m

se mmns 32000 /proc/sys/kernel/se m

se mopm 100 /proc/sys/kernel/se m

se mmni 128 /proc/sys/kernel/se m shmall 2097152 /proc/sys/kernel/shmall

shmmax ½ physical

memory

/proc/sys/kernel/shmmax

shmmni 4096 /proc/sys/kernel/shmmni

file- max 65536/proc/sys/fs/file- max

r m e m _ max 262144 /proc/sys/net/core/r m e m _ max

r m e m _ default 262144 /proc/sys/net/core/r m e m _ default

w m e m _ max 262144 /proc/sys/net/core/ w m e m _ max

w m e m _ default 262144 /proc/sys/net/core/ w m e m _ default







Cluster Setup Tasks

1. View the Certifications by Product section at

http: //metalink.oracle.com /.

2. Verify your high-speed interconnects.

3. Determine the shared storage (disk) option for your system:

± OCFS or other shared file system solution

± Raw devices

± ASM

ASM ca

nnot be used f

or th

e OCR an

d V otin

g Di sk f

il es!

4. Install the necessary operating system patches.




Obtaining OCFS (Optional)

� To get OCFS for Linux, visit the Web site at

http: //oss.oracle.com /projects /ocfs /files.

� Download the following Red Hat Package Manager

(RPM) packages:

± ocfs-support-1.0-n.i386.r pm

± ocfs-tools-1.0-n.i386.r pm

� Download the following RPM kernel module:ocfs-2.4.21-EL-typeversion.r pm ,

where typeversion is the Linux version.




Using Raw Partitions

1. Install shared disks.

2. Identify the shared disks to use.

3. Partition the device.

# fd isk ±l

Disk /dev/sd a: 9173 MB, 9173114880 bytes

255 heads, 63 sectors/track, 1115 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb: 9173 MB, 9173114880 bytes

255 heads, 63 sectors/track, 1115 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytes

...

# fd isk /dev/sd a

...




Using Raw Partitions

Volume for OCR1001

Clusterware voting disk201

Password file51

Server parameter file (SPFILE)51

TE M P tablespace2501

First and second control files1102

2 online redo logs per instance1202 per instance

USER S tablespace1201

EX AM PLE tablespace1601

U NDOTBSn tablespace5001 per instance

SYSAUX tablespace300 + 250 per

instance

1

SYSTE M tablespace5001

PurposePartition Size(MB)

Number of

Partitions




Binding the Partitions

1. Identify the devices that are already bound:

2. Edit the /etc/sysconfig/ra wdevices file:

3. Adjust the ownership and permissions of the OCR fileto root:dba and 640, respectively.

4. Adjust the ownership and permissions of all other rawfiles to oracle:dba and 660, respectively.

5. Execute the ra wdevices command.

# /usr/ bin/ra w -q a

# cat /etc/sysconfig/ra wdevices file# ra w device bind ings

dev/ra w/ra w1 /dev/sd a1

...







Raw Device Mapping File

1. Create a database directory, and set proper

permissions:

2. Edit the$OR ACLE_ BASE/orad ata/db name/db name _ ra w.conf

file:

3. Set the DBCA _R AW _ CONFIG environment variable to

specify the full path to this file.

# m kd ir - p $OR ACLE_ BASE/orad ata/dbnam e

# cho wn oracle:oinstall $OR ACLE_ BASE/orad ata

# chmod 775 $OR ACLE_ BASE/orad ata

# cd $OR ACLE_ BASE/orad ata/db name/ # vi db name _ ra w.conf







Verifying Cluster Setup with cluvfy

� Install the cvuqd isk rpm required for cluvfy:

� Run the cluvfy utility as oracle as shown below:

# su root

# cd /stage/10201- prod uction/clusterware/r pm

# export C V UQDISK _ GRP=dba

# r pm -iv cvuqd isk-1.0.1-1.r pm

# cd /u01/stage/10gR 2/clusterware/cluvfy

./runcluvfy.sh stage - post h wos -n all -verbose




Installing Oracle Clusterware

$ /cdrom/clusterware/runInstaller




Specifying the Inventory Directory




Specify Home Details




Product-Specific Prerequisite Checks




Cluster Configuration




Private Interconnect Enforcement




Oracle Cluster Registry File




Voting Disk File




Summary and Install




Run Configuration Scripts on All Nodes




End of Installation




Verifying the Oracle Clusterware Installation

� Check for Oracle Clusterware processes with the ps

command.

� Check the Oracle Clusterware startup entries in the/etc/initta b file.

# cat /etc/initta b

# R un xd m in runlevel 5

x:5:res pa wn:/etc/X11/prefd m -nod ae mon

h1:35:res pa wn:/etc/init.d /init.ev m d run > /dev/null

2>&1 </dev/null

h2:35:res pa wn:/etc/init.d /init.cssd fatal > /dev/null

2>&1 </dev/null

h3:35:res pa wn:/etc/init.d /init.crsd run > /dev/null

2>&1 </dev/null







Summary

In this lesson, you should have learned how to:

� Describe the installation of Oracle RAC 10g

� Perform RAC preinstallation tasks

� Perform cluster setup tasks� Install Oracle Clusterware




Practice 1: Overview

This practice covers the following topics:

� Performing initial cluster configuration

� Installing Oracle Clusterware



Documents

01 Cluster Ware Install JMW4