Rapid Home Provisioning

BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA

HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH

Rapid Home ProvisioningA new Oracle Grid Infrastructure 12.1.0.2 feature

Ludovico CaldaraOracle ACE, Senior Oracle Consultant

Trivadis SA

About Ludovico Caldara

Rapid Home Provisioning2 09.12.2015

■ 16 Years DBA (Not Only Oracle)

▪ I do it everywhere (even Windows)

■ RAC ATTACK Ninja & co-writer

■ VP, SOUG & ITOUG Board member

■ OCP (11g, 12c, MySQL) & OCE

■ Italian living in Switzerland

■ http://www.ludovicocaldara.net

■ @ludodba

■ ludovicocaldara

Our company.


Trivadis is a market leader in IT consulting, system integration, solution engineering

and the provision of IT services focusing on and

technologies in Switzerland, Germany, Austria and Denmark.

We offer our services in the following strategic business fields:

Trivadis Services takes over the interactive operation of your IT systems.

O P E R A T I O N

COPENHAGEN

MUNICH

LAUSANNE

BERN

ZURICH

BRUGG

GENEVA

HAMBURG

DÜSSELDORF

FRANKFURT

STUTTGART

FREIBURG

BASEL

VIENNA

With over 600 specialists and IT experts in your region.


14 Trivadis branches and more than

600 employees

200 Service Level Agreements

Over 4,000 training participants

Research and development budget:

CHF 5.0 / EUR 4 million

Financially self-supporting and

sustainably profitable

Experience from more than 1,900

projects per year at over 800

customers


Patching, Patching, Patching

(or how I will NOT apply PSUs every quarter)

Patching, Patching, Patching


(Original: https://xkcd.com/838/ )

https://xkcd.com/838/

Patching, worst way


1. Stop everything

2. In-place binaries patching

3. Database patching, "big bang" mode

4. Start everything

Patching, worst way


1. Stop everything

2. In-place binaries patching

3. Database patching, "big bang" mode

4. Start everything

Problem: you seriously need a check-up of your operational practices

Patching, better way


1. Re-install binaries, out-of-place binaries patching

2. Stop databases, one by one

3. Move to new ORACLE_HOME, patch one by one

4. Decommission old binaries

Patching, better way


1. Re-install binaries, out-of-place binaries patching




Problem: what if you have many servers/environments and patch frequently?

Patching, best way (so far)


1. Install binaries somewhere

2. Detach and patch them

3. Keep them as golden images somewhere

4. Deploy them on the servers somehow, attach them













Flexible?

YES!










Flexible?

YES!

Easy?

NO!


Rapid Home Provisioning

What is it?

Rapid Home Provisioning is...


Usage: srvctl ... asm

Usage: srvctl ... cvu

Usage: srvctl ... database

Usage: srvctl ... diskgroup

Usage: srvctl ... exportfs

Usage: srvctl ... filesystem

Usage: srvctl ... gns

Usage: srvctl ... havip

Usage: srvctl ... home

Usage: srvctl ... instance

Usage: srvctl ... listener

Usage: srvctl ... mgmtdb

Usage: srvctl ... mgmtlsnr

Usage: srvctl ... mountfs

Usage: srvctl ... network

Usage: srvctl ... nodeapps

Usage: srvctl ... oc4j

Usage: srvctl ... rhpclient

Usage: srvctl ... rhpserver

Usage: srvctl ... scan

Usage: srvctl ... scan_listener

Usage: srvctl ... server

Usage: srvctl ... service

Usage: srvctl ... srvpool

Usage: srvctl ... vip

Usage: srvctl ... volume

grid$ srvctl -help | grep Usage: | awk '{printf ("%s %s ... %s\n", $1, $2, $4)}' | sort | uniq

Something that messes my srvctl help!

Rapid Home Provisioning is...


Usage: rhpctl ... client

Usage: rhpctl ... database

Usage: rhpctl ... image

Usage: rhpctl ... role

Usage: rhpctl ... series

Usage: rhpctl ... server

Usage: rhpctl ... user

Usage: rhpctl ... workingcopy

grid$ rhpctl -help | grep Usage: | awk '{printf ("%s %s ... %s\n", $1, $2, $4)}' | sort |uniq

It has its own rhpctl command too! This is how you administer it.

Rapid Home Provisioning - the idea


DF

OH_1 OH_2 OH_3

RHP SERVER

-MGMTDB

RHP CLIENT

RHP CLIENT

RHP CLIENT

RHP CLIENT

RHP CLIENT

RHP CLIENT

RHP CLIENT RHP CLIENT

GOLDEN

IMAGE

DB

WORKING

COPY

Rapid Home Provisioning is a tool for...


Provisioning and patching

– Oracle Homes

– other Software

Simplifying software deployment

Patching Databases (Mass patching possible)

Centralizing Golden Images

Ensuring standardization within the enterprise

Rapid Home Provisioning has mandatory requirements


Oracle Grid Infrastructure release 12.1.0.2 or upwards (use the last PSU)

ASM Cluster File System (ACFS)

Oracle Grid Infrastructure Global Naming Services (GNS)

NFS Server and HAVIP (optional*)

Lifecycle Management Pack Option (optional*)

* how optional is optional? We will see in the next episode (coming soon)

Rapid Home Provisioning has also limitations!


The main ones:

Not available on Windows

Cannot upgrade from a release to another (planned in 12.2)

Cannot provision Grid Infrastructure Homes (not yet, maybe 12.2?)

– Bug 19596245 : IMPLEMENT GRID INFRASTRUCTURE SUPPORT IN RAPID HOME PROVISIONING

Cannot provision OS Images or VMs, not in the scope of the tool

Rapid Home Provisioning - Security Roles


Several roles -> specific permissions on Working Copies and and Golden Images

But basically three composite roles:

– GH_SA : RHP Server administrator

– GH_CA : RHP Client administrator

– GH_OPER : for generic administration



Single Cluster Architecture

(or when you have only one cluster)

Single Cluster Architecture - Setup


RHP Server Cluster

ASM RHP DG-MGMTDB



RHP Server Cluster

ASM RHP DG-MGMTDB

Existing

OraHome

1



RHP Server Cluster

ASM RHP DG-MGMTDB

RHP

ServerExisting

OraHome

1

# srvctl add rhpserver -storage /my/path/to/rhp/ -diskgroup RHP

# srvctl start rhpserver

new resource ora.ghs is created

ASM DG must exist,

ADVM Compatible >= 12.1.0.0

Single Cluster Architecture - Adding Images


RHP Server Cluster

ASM RHP DG-MGMTDB

RHP

Server

Existing

OraHome

ACFS Mount

Base

Golden

Image

grid $ rhpctl grant role -role GH_CA -user oracle -client rhps-cluster

oracle $ rhpctl import image -image 12cR1_EE_Base \

-path $OH -imagetype ORACLEDBSOFTWARE

Getting Golden Image details


grid $ rhpctl query image -image 12cR1_EE_Base

Image name: 12cR1_EE_Base

Owner: grid@rhps-cluster

Site: rhps-cluster

Access control: USER:oracle@rhps-cluster

Access control: ROLE:OTHER

...

Parent Image:

Image Type: ORACLEDBSOFTWARE

Image Version: 12.1.0.2.0

Software home path:

/u01/app/12.1.0.2/grid/srvm/images/i12cR1_EE_Base296880/swhome

Image state: PUBLISHED

Image size: 5332MB

Image platform: Linux_AMD64

Interim patches installed:

Complete: TRUE

Single Cluster Architecture - Adding Working Copies


RHP Server Cluster

ASM DG-MGMTDB

RHP

ServerExisting

OraHome

1

ACFS Mount

Base

Golden

Image

no more needed

oracle $ rhpctl add workingcopy -workingcopy 12cR1_EE_Base_1 \

-image 12cR1_EE_Base -oraclebase /u01/app/oracle

ACFS Snap

Base

Working

Copy

Getting Working Copy details


oracle $ rhpctl query workingcopy -workingcopy 12cR1_EE_Base_1

Working copy name: 12cR1_EE_Base_1


Owner: oracle@rhps-cluster

Site: rhps-cluster

Access control: USER:oracle@rhps-cluster

Access control: ROLE:GH_WC_ADMIN

Software home path:

/u01/app/12.1.0.2/grid/srvm/images/i12cR1_EE_Base296880/.ACFS/snaps/w12cR1

_EE_Base_1/swhome

Oracle base: /u01/app/oracle

Storage type: RHP Managed

Configured databases:

Interim patches installed:

Complete: TRUE

YOUR ORACLE_HOME

ON RHP SERVER

Single Cluster Architecture - Using Working Copies


RHP Server Cluster

ASM DG-MGMTDB

RHP

Server

ACFS Mount

Base

Golden

Image

ACFS Snap

Base

Working

Copy

DB

You can use the working copy as ORACLE_HOME for databases

$ rhpctl add database -workingcopy 12cR1_EE_base_1 -dbname ORCL \

-datafileDestination DATA -dbtemplate General_Purpose.dbc

... or ...

Single Cluster Architecture - Patching Working Copies


RHP Server Cluster

ASM DG-MGMTDB

RHP

Server

ACFS Mount

Base

Golden

Image

ACFS Snap

Patched

Working

Copy

oracle $ cd PSUx/patchnumber

oracle $ opatch apply



RHP Server Cluster

ASM DG-MGMTDB

RHP

Server

ACFS Mount

Base

Golden

Image

ACFS Snap

Patched

Working

Copy

oracle $ cd PSUx/patchnumber

oracle $ opatch apply

oracle $ rhpctl add image –image 12cR1_EE_PSUx \

-workingcopy 12cR1_EE_Base_1

ACFS Snap

Patched

Golden

Image



$ rhpctl add image -image 12cR1_EE_PSU4 -workingcopy 12cR1_EE_PSU4_1

rhpsh02.trivadistraining.com: Finding ACFS of previous image "12cR1_EE_Base" ...

rhpsh02.trivadistraining.com: Creating snapshot for image "12cR1_EE_PSU4" from

working copy "12cR1_EE_PSU4_1" ...

rhpsh02.trivadistraining.com: Changing the home ownership ...

$

Single Cluster Architecture - Images and Working Copies


RHP Server Cluster

ASM DG-MGMTDB

RHP

Server

ACFS Mount

Base

Golden

Image

ACFS Snap

Patched

Golden

Image

You can have as many Images and Working copies as you need.

ACFS Snap

Patched

Working

Copy

ACFS Snap

Base

Working

Copy

$ rhpctl query workingcopy

Working copy name: 12cR1_EE_Base_1

Working copy name: 12cR1_EE_PSU4_1

Working copy name: 12cR1_EE_PSU4_2

$ rhpctl query image

Image name: 12cR1_EE_PSU4


ACFS Snap

Patched

Working

Copy

Single Cluster Architecture - Database Patching


RHP Server Cluster

ASM DG-MGMTDB

RHP

Server

ACFS Mount

Base

Golden

Image

ACFS Snap

Patched

Golden

Image

ACFS Snap

Patched

Working

Copy

ACFS Snap

Base

Working

Copy

Unpatched

DB

Database patching is dead simple!



RHP Server Cluster

ASM DG-MGMTDB

RHP

Server

ACFS Mount

Base

Golden

Image

ACFS Snap

Patched

Golden

Image

ACFS Snap

Patched

Working

Copy

ACFS Snap

Base

Working

Copy

Unpatched

DB

Database patching is dead simple!

$ rhpctl move database -sourcewc 12cR1_EE_Base_1 \

-patchedwc 12cR1_EE_PSU4_1 -dbname ORCL

Patched

DB

Database

must be open



$ rhpctl move database -sourcewc 12cR1_EE_Base_1 -patchedwc 12cR1_EE_PSU4_1 -dbname ORCL

rhpsh02.trivadistraining.com: Starting to move database from

"/u01/app/12.1.0.2/grid/srvm/images/i12cR1_EE_Base296880/.ACFS/snaps/w12cR1_EE_Base_1/swhome" to

"/u01/app/12.1.0.2/grid/srvm/images/i12cR1_EE_Base296880/.ACFS/snaps/w12cR1_EE_PSU4_1/swhome"

on server cluster

...

SQL Patching tool version 12.1.0.2.0 on Sat Oct 24 17:06:22 2015

...

Adding patches to installation queue and performing prereq checks...done

...

The following patches will be applied:

20831110 (Database Patch Set Update : 12.1.0.2.4 (20831110))

...

Installing patches...

...

rhpsh02.trivadistraining.com: Completed the 'move database' operation on server cluster


DEMO?

By Michael Tiemann at en.Wikipedia CC-BY-SA

https://en.wikipedia.org/wiki/User:Michael_Tiemann

http://en.wikipedia.org/



Multi Cluster Architecture

(or when you have a private cloud)

Multi Cluster Architecture - Additional requirements


NFS Server and HAVIP

Lifecycle Management Pack OptionLicensed on

all RHP Client

Clusters

Source: https://docs.oracle.com/database/121/DBLIC/editions.htm#DBLIC110

Multi Cluster Architecture - Adding a Client Cluster


## SERVER

# srvctl add havip -id rhp -address 192.168.89.202

$ rhpctl add client -client rhpc-cluster -toclientdata

/home/grid

$ scp /home/grid/rhpc-cluster.xml rhpch01:/home/grid

## CLIENT

# srvctl add rhpclient -clientdata /home/grid/rhpc-cluster.xml

# srvctl start rhpclient

# rhpctl query server

Rapid Home Provisioning Server (RHPS): rhps-cluster

Storage base path: /u01/app/12.1.0.2/grid/srvm

Disk Groups: RHP

Port number: 23795

Multi Cluster Architecture - Adding a Client Cluster


## SERVER

# srvctl add havip -id rhp -address 192.168.89.202

# rhpctl add client -client rhpc-cluster -toclientdata

/home/grid

# scp /home/grid/rhpc-cluster.xml rhpch01:/home/grid

## CLIENT

# srvctl add rhpclient -clientdata /home/grid/rhpc-cluster.xml

# srvctl start rhpclient

# rhpctl query server

Rapid Home Provisioning Server (RHPS): rhps-cluster

Storage base path: /u01/app/12.1.0.2/grid/srvm

Disk Groups: RHP

Port number: 23795

Multi Cluster Architecture - NFS Provisioning


RHP Server Cluster

ASM Volume 1-MGMTDB

RHP

Server

ACFS SnapACFS Mount

Golden

Image

Working

Copy

for NFS

RHP Client Cluster

RHP

Client Node 1

NFS Mount

Node 2

NFS Mount

Multi Cluster Architecture - NFS Provisioning


RHP Server Cluster

ASM Volume 1-MGMTDB

RHP

Server

ACFS SnapACFS Mount

Golden

Image

Working

Copy

for NFS

RHP Client Cluster

RHP

Client Node 1

NFS Mount

Node 2

NFS Mount

exportfs

mountfs mountfs

Multi Cluster Architecture - Provisioning via NFS


oracle@rhpc $ rhpctl add workingcopy -workingcopy 12cR1_EE_PSU4_rhpc \

-image 12cR1_EE_PSU4 -storagetype NFS -path /u01/app/oracle/product/12.1.0.2.4 \

-oraclebase /u01/app/oracle

rhpch02.trivadistraining.com: Starting server-side action for 'add workingcopy'...

rhpsh01.trivadistraining.com: Adding storage for working copy ...

rhpsh01.trivadistraining.com: Storing metadata in repository for working copy

"12cR1_EE_PSU4_rhpc" ...

rhpsh01.trivadistraining.com: Finding ACFS file system of the image "12cR1_EE_PSU4"

...

rhpsh01.trivadistraining.com: Creating snapshot ...

rhpsh01.trivadistraining.com: Adding export file system for image


...

rhpsh01.trivadistraining.com: Successfully executed attach home operation.











...




...












...




...


ORACLE_HOME

via NFS. What

can go wrong?

Multi Cluster Architecture - LOCAL Provisioning


RHP Server Cluster

ASM Volume 1-MGMTDB

RHP

Server

ACFS Mount

Golden

Image

ACFS Snap

Working

Copy

for Local

Copy

RHP Client Cluster

RHP

Client Node 1 Node 2

Local Copy Local Copy



RHP Server Cluster

ASM Volume 1-MGMTDB

RHP

Server

ACFS Mount

Golden

Image

ACFS Snap

Working

Copy

for Local

Copy

RHP Client Cluster

RHP

Client Node 1 Node 2

Local Copy Local Copy

local ACFS

or other FS



oracle@rhpc $ rhpctl add workingcopy -workingcopy 12cR1_EE_PSU4_c1 \

-image 12cR1_EE_PSU4 -storagetype LOCAL -path

/u01/app/oracle/product/12.1.0.2.4/Home_EE_2 -oraclebase /u01/app/oracle




rhpsh01.trivadistraining.com: Adding export file system for image "12cR1_EE_PSU4_c1"

...

rhpch02.trivadistraining.com: Mounting file system...

rhpch02.trivadistraining.com: Creating local storage ...

rhpch02.trivadistraining.com: Creating local ACFS file system ...

rhpch02.trivadistraining.com: Starting local ACFS file system ...

rhpch02.trivadistraining.com: Making a local copy ...

...

Multi Cluster Architecture - Mixed Provisioning


RHP Server Cluster

ASM Volume 1-MGMTDB

RHP

Server

ACFS SnapACFS Mount

Golden

Image

Working

Copy

for NFS

ACFS Snap

Working

Copy

for Local

Copy

RHP Client Cluster

RHP

Client Node 1

NFS Mount

Node 2

NFS MountLocal Copy Local Copy



Repository

RHP Metadata Repository: GHSUSER@-MGMTDB


SQL> select table_name from dba_tables where owner='GHSUSER' order by 1;

TABLE_NAME

------------------------------

HOLDER

IMAGE_ROLES

IMGS

IMGSRS

IMGSRS_IMAGES

IMGSRS_USERS

PARENT_CHILD_ROLE

ROLEIMPL_M_PRIVLIST

ROLES

SITES

SWHOMES

USERS

USER_ROLES

WCOPY_ROLES

14 rows selected.

SQL> show pdbs

CON_ID CON_NAME OPEN MODE RESTRICTED

---------- ------------------------------ ---------- ----------

3 RHPS_CLUSTER READ WRITE NO




TABLE_NAME

------------------------------

HOLDER

IMAGE_ROLES

IMGS

IMGSRS

IMGSRS_IMAGES

IMGSRS_USERS

PARENT_CHILD_ROLE

ROLEIMPL_M_PRIVLIST

ROLES

SITES

SWHOMES

USERS

USER_ROLES

WCOPY_ROLES

14 rows selected.

ORACLE says you

don't need to

backup the GIMR.

SQL> show pdbs


---------- ------------------------------ ---------- ----------





TABLE_NAME

------------------------------

HOLDER

IMAGE_ROLES

IMGS

IMGSRS

IMGSRS_IMAGES

IMGSRS_USERS

PARENT_CHILD_ROLE

ROLEIMPL_M_PRIVLIST

ROLES

SITES

SWHOMES

USERS

USER_ROLES

WCOPY_ROLES

14 rows selected.

ORACLE says you

don't need to

backup the GIMR.

If you use RHP, my

recommandation

is to do it!

SQL> show pdbs


---------- ------------------------------ ---------- ----------




Conclusions

RHP Documentation


12c Documentation:

– https://docs.oracle.com/database/121/CWADD/rapidhome.htm#CWADD92402

– https://docs.oracle.com/database/121/RILIN/racrhp.htm

OTN Private Database Cloud Home (whitepaper and video):

– http://www.oracle.com/technetwork/database/database-cloud/private/index.html

Best MOS Note:

– ODA (Oracle Database Appliance): How To Setup a Rapid Home Provisioning

(RHP) Server (Doc ID 2054804.1)

https://docs.oracle.com/database/121/CWADD/rapidhome.htm#CWADD92402

https://docs.oracle.com/database/121/RILIN/racrhp.htm

http://www.oracle.com/technetwork/database/database-cloud/private/index.html

Conclusions


Ease of patching

Standardized installations

Free for standalone clusters

Private-Cloud ready

Nice features

Thin documentation

Pricey option for multi-clusters

No GI_HOME Provisioning

It is not free from bugs (not rock-solid)

Embrace it or live without it?


What's your question?

Ludovico CaldaraOracle ACE, Senior Oracle Consultant

Trivadis SA

09.12.2015 Rapid Home Provisioning60

Technology

Rapid Home Provisioning