REMINDER

Check in on the COLLABORATE mobile app

Best practices for building and using templates for Oracle’s VCA

Prepared by: Mike Gangler Secure-24

Using templates for rapid deployment on Oracle’s VCA

Session ID#: 582

@mjgangler

Safe Harbor Statement

■  Our discussion today may include information about our business and experience that may be considered forward looking or highlight examples of our relationships to other organizations. Our current judgment about future plans or results reflects our current opinions about the topics presented and are subject to change as risks and opportunities are met.

■  We thank you in advance for understanding that all financial and customer information is presented for the purpose of this discussion only and may not be used for any other purposes.

About Michael J. Gangler

Oracle    Technology  since  1987    Started  with  Oracle  Version  5.1c  

Senior  Database  Specialist  –  Secure-­‐24,  LLC    Database  experience  with  FOCUS,  IMS  DB/DC,  DB2,  Sybase,  and  MSSQL,  and  MySQL  databases  as  well  as  Oracle  experience.    

mjgangler  

Mgangler  

mjgangler@gmail.com    

Secure-24 Company Profile

Secure-­‐24  is  a  leading  provider  of  managed  hos7ng,  enterprise  cloud  compu7ng  and  IT  outsourcing.  As  an  Oracle  Pla7num  Partner,  Secure-­‐24  delivers  full  technical  support  of  Oracle  EPM  applica7ons  with  proven  methodology  and  demonstrated  successes  in  infrastructure,  management,  upgrades,  migra7ons  and  support  engagements.

FOUNDED

HEADQUARTERS

OPERATION  CENTERS

DATA  CENTERS

Secure-­‐24  was  founded  in  2001  and  since  then  

has  grown  to  450  employees  and  has  

received  recogniTon  as  one  of  Computerworld’s  Best  Places  to  Work  in  IT    

Secure-­‐24  is  headquartered  in  

Southfield,  MI  

Serving  customers  around  the  globe,  Secure-­‐24  has  2  

OperaTon  Centers  in  Michigan,  1  in  Nevada  and  

1  in  Hyderabad  India.  

Secure-­‐24  has  3  data  centers  in  Michigan,  1  in  

Nevada,  plus  several  global  partnerships.  We  only  

choose  the  safest  locaTons  for  our  data  centers.    

Upcoming User Group Events

■  Western Michigan Oracle User Group – May 6, 2015 – Grand Rapids, Mi. ▪  http://www.wmoug.org/wmoug/

■  Great Lakes Oracle Conference – May 19, 20, 2015 – Cleveland, Ohio ▪  https://www.neooug.org/gloc/

■  ODTUG – KSCOPE – June 21 – June 25 – Hollywood, FLA ▪  http://kscope15.com/

■  Michigan Oracle User Summit – November 18 – Livonia, MI. ▪  http://mous.us

AGENDA

①  Oracle’s Virtual Compute Appliance Overview

②  Oracle VM Features and Architecture

③  Building Templates and Best Practices ④  Summary

⑤  Demo (If Time)

Copyright  ©  2014,  Oracle  and/or  its  affiliates.  All  rights  reserved.    |  

Oracle’s Virtual Compute Appliance Overview Oracle VM Portfolio

Overview

•  The  Oracle’s  Virtual  Compute  Appliance  is  an  engineered  system  for  quickly  deploying  Oracle  VM  environments  

•  It  is  a  converged  infrastructure  system  containing  compute,  storage,  and  network  resources,  all  automaTcally  discovered  and  configured  

•  The  Virtual  Compute  Appliance  is  designed  for  robustness,  resiliency,  and  for  applicability  to  a  wide  range  of  VM  applicaTons  

•  The  combinaTon  of  infrastructure  and  management  enables  faster  VM  deployment,  faster  Tme-­‐to-­‐value,  lower  management  cost  and  higher  ROI  

8

Oracle Engineered Systems Unlock Business Potential Converged Infrastructure Systems Unlock Time and Resources

Tradi&onal  Infrastructure   Converged  Infrastructure  

§  Lengthy integration §  Hundreds of connections §  Exponential complexity

§  Factory integrated §  Simple connections §  Designed for reliability

and ease of management

Copyright  ©  2014,  Oracle  and/or  its  affiliates.  All  rights  reserved.    |  

Oracle VM Features and Architecture Oracle VM Portfolio

SuperCluster  

Oracle’s Engineered Systems Portfolio Leadership in the converged infrastructure market

Database  Appliance   Exaly&cs  

Big  Data  Appliance  Exalogic  Exadata  

Oracle’s  Virtual    Compute  Appliance  

NEW!  

Oracle VM Server Virtualization and Management

Oracle VM Manager & Enterprise Manager ▪  Manage hundreds- or thousands of servers

▪  Central Java management server

—  Web browser-based management console

▪  Advanced virtualization management including Dynamic Resource Scheduling (DRS), HA, Dynamic Power Management…

Oracle VM Server for x86 ▪  Installs on “bare-metal” servers in about a minute

▪  Guest operating systems:

—  Solaris on x86, Linux, & Windows

—  Support for paravirtualized- and hardware-virtualized kernels & drivers

Oracle VM 3 Deployment Architecture

Oracle  VM  Manager  •  Browser  UI  •  Manage  mulTple  server  pools  •  Create,  configure,  clone,  share,  boot,  

migrate  VMs  •  Convert  other  virtual  machine  formats  

Storage  Repository  

Networks Separate… •  Guest •  HA •  Live Migration •  Storage •  Management

Shared Storage Repositories •  NFS, Fibre Channel, iSCSI •  Support heterogeneous configurations •  Share storage between multiple pools and clusters. •  Ability to share raw device between VMs

Oracle  Storage   Partner  Storage  

Virtual Machines •  Oracle Solaris •  Oracle Linux •  Red Hat Enterprise Linux •  Centos •  SuSE SLES •  Microsoft Windows

Oracle VM Servers •  x86 •  SPARC *

Server  Pool  2  

Server  pools  •  HA  groups  •  Resource  groups  •  Live  MigraTon  groups  

Server  Pool  2  

Server  Pool  1  

Get Infrastructure Faster, Get Applications Faster

■ Only Oracle can speed both infrastructure and application deployment ■ Virtual Compute Appliance:

Power-on to fully configured applications in 1-2 hours ■ Other converged

infrastructure: Days or weeks

Full  Enterprise  ApplicaTon  

Stack  

Hardware  • Servers  • Storage  • Network  

VMs  

1  hour  with  VCA  

Minutes  -­‐  2  hours  

The Virtual Compute Appliance

■  Pre-built, ready to use with minimal setup ■  Automatic Discovery and installation of components ■  Removes the integration risk of deployment ■  Integrated apps provisioning with pre-built templates ■  Fully virtualized system with built in software defined

networking for ultimate flexibility

From Power on to production in about an hour

Oracle Sun X4-2 Servers Oracle ZFS Z3-ES Storage Appliance •  Redundant controllers, RAID storage

•  Oracle Fabric Interconnect F1-15 •  Oracle Switch ES1-24 •  Oracle Sun Data Center Infiniband Switch 36 •  Oracle Sun Data Center Infiniband Switch 36 •  Oracle Fabric Interconnect F1-15

Oracle’s Virtual Compute Appliance X4-2 Hardware Specifications Overview

Fabric Interconnect

Fabric Interconnect

Compute Nodes

Compute Nodes

Mgmt Nodes

Management Storage

InfiniBand Expansion

Ethernet Switch

Oracle  Sun  X4-­‐2  Servers  •   2  to  25  nodes  •   CPU:  Up  to  400  cores  /  800  threads  aggregate  •   Memory:  Up  to  6.4TB  aggregate  •   Only  3  cables  per  server,  fully  redundant  

Oracle  Sun  X4-­‐2  Servers  

Netw

orking M

anagement

Four  4x10GbE  

40Gb/s  Server-­‐to-­‐Server  

Network  

Storage  

InfiniBand Expansion

Oracle’s Virtual Compute Appliance X4-2 Software Overview

Server Virtualization

and Guest OSes

Server Virtualization

Oracle  VM  Server  Virtualiza&on  • All  major  x86  operaTng  systems  

• Oracle  Linux    • Oracle  Solaris  

• Microsoh  Windows  

Virtual  Compute  Appliance  controller  •   Oracle  VM  Manager  

•   Oracle  SDN  Networking

Automation & Management •   Oracle  Fabric  Manager  

*  Refer  to  documenta/on  for  addi/onal  Guest  OS  support  informa/on    

Guest OS*

Oracle’s Virtual Compute Appliance •  Enables operation of the system as one unit, not individual servers

•  Add compute by automatically discovering, installing, and adding servers

•  Web-based central front end mgmt console

•  End-to-end automation and orchestration

•  Software Defined Networking (SDN) automates set-up (leveraging Oracle Fabric Interconnect)

•  Handles installation, upgrade, and HA behind the scenes

•  Dynamic resource management

•  Unique full stack: rapid application deployment with Oracle VM Assemblies

•  Fits easily into existing data centers

•  Run any x86-based OS and application without modifications

•  Use Oracle or 3rd party storage

Easy.

18

Initial User Experience: Hardware Provisioning

Ø  Ready to create VMs and deploy assemblies in about an hour

•  Power on the rack(s)

•  Appliance auto-configures and auto-provisions [~45 minutes – more if full rack]

-  Discovers and provisions compute nodes

-  Configures internal storage, NFS shares, iSCSI LUNs

-  Creates server pool, and Oracle VM storage repository

•  Log in to configure management IP/Hostname [~5 minutes]

Ø  Simple expansion

•  Physically install new compute node and turn it on

•  Appliance auto-provisions new node, making it ready to use

Fast.  

Virtual Compute Appliance Components Storage

§  Internal,  included  storage  as  “system  disk”  §  OperaTonal  storage  required  for  storing  

management  sohware    

§  “System  disk”:    1  x  Oracle  ZFS  Z3-­‐ES  Storage  Appliance    §  HA  controllers  2  x  1U  controller  /  heads  §  2U  disk  tray  (24  spindles)  §  About  6TB  of  user-­‐space  available    

§  External  storage:  §  New  or  exisTng  Oracle  or  third-­‐party  storage  §  NFS  or  iSCSI  direct  from  the  guest  VMs  

Use with Existing or New External Storage NFS or iSCSI from the Guest VMs

External  connecTvity  

• 16  (up  to  52*)  10Ge  ports  

• FC*  ports  included      

Oracle’s  Virtual  Compute  Appliance  

*Planned  for  future  support  

Oracle ZFS Storage Appliance

■  High-throughput for 1000s of VMs ■  Optimized for IOPS, throughput, and file sharing workloads ■  High-availability with up to 2.6PBytes capacity ■  Powerful DTrace storage analytics

▪  Visual and interactive ▪  Manage workloads down to the VM level

■  Co-engineered with Oracle Virtual Compute Appliance, Oracle Database, and Oracle Apps ▪  Reduced risk ▪  Reduced complexity ▪  Lower TCO

■  The performance of Flash with the cost of Disk

Storage Expansion for Oracle Virtual Compute Appliance Environments

DTrace  Storage  Analy&cs  

ZFS  Storage  Appliance  

■  When was the first IOUG-Alive ?

■  What Version of Oracle Did I start with on IBM VM machine ?

Quick Jeopardy Break

Building Templates and Best Practices

Template hints / experience from the Trenches

■  Determine OVM Templates / Oracle Template Architecture and flow

■  Building Oracle Software Stack

■  Oracle Database Template Building

Template Building Best Practices

Template Usage Starting Points

■  There is still a need for guidance

▪  A subset of general Oracle VM best practices

▪  More things to NOT do, rather than new things to do

■  “Keep it simple” and “it’s already done for you” are organizing principles

▪  VCA discovers and names servers, creates and names pools and networks

▪  Don’t undo these manually: keep the names and objects created for you

■  Network and storage separation are already done

▪  Different networks so no need for VLANs to separate VM traffic from mgmt

▪  Private and public VM networks can be done with or without VLANs

Template Types

■  Implementation of 2 Types of Templates –

▪  OVM templates

—  JDE Templates - Smaller/typical Databases

—  Machine / Storage creation (Only) – For Larger JDE Environments and non-JDE Environments

▪  Database templates —  DBCA – using Template Clones – Larger JDE environments and non-

JDE Environments

Best Practices with Virtual Compute Appliance and Oracle VM

■  Best Practices is not just about physical infrastructure

■  Best Practice with the Virtual Compute Appliance (and Oracle VM in general) is to make use of pre-built virtual machine templates

■  Or: simple case, cloning “golden” VMs

■  Create a standardized, repeatable model for deployment with self-contained appliance virtual machines

▪  Eliminate effort, reduce configuration errors

■  Oracle VM and the Virtual Compute Appliance support this with templates, assemblies and fast VM clones

Rapid Infrastructure AND Application Deployment

•  Create VMs manually from ISO images or (better) from ready-to-run Oracle VM Templates/Assemblies •  Simple example: Oracle Linux or Solaris VM [~1 minute] •  Complex example: Oracle RAC cluster with 16 nodes [~45

minutes]

DB  

WebLogic  Server  

Deployment  Policies  Configura&on  Metadata  

SOA_PROD_1

Oracle  VM  Assembly  Produc&on  Environment:    SOA_PROD_1

VM  

VM  

VM  

VM  

VM  

VM  

Server  Pool  1  

Deployed:  Produc&on  Environment    SOA_PROD_1  

VCA  

Deploy  

Management  nodes  

Pre-­‐installed,  pre-­‐configured,  ready  to  run  VMs  containing  applicaTons  

Download  

Application Templates & Assemblies

DB  

WebLogic  Server  

Deployment  Policies  ConfiguraTon  Metadata  

SOA_PROD_1

Oracle  VM  Assembly  ProducTon  Environment:    SOA_PROD_1

VM  

VM  

VM  

VM  

VM  

VM  

Deploy  

Deploy  applicaTon  into  Oracle  VM  Manager  as  ‘Golden  Image’  

• Clone,  iniTalize,  and  start-­‐up  instance  • Up  and  running  in  hours  vs.  days  or  weeks  with  liole  risk  

Oracle  VM  Servers  

Storage  Repository  

Server  Pool  2  

Deployed:  ProducTon  Environment    SOA_PROD_1    

Guest  AddiTons  • Allows  direct  integraTon  between  guest  sohware  and  virtualizaTon  layer  

• Assists  in  orchestraTon  of  complex,  mulT-­‐VM  deployments  

OVF-­‐based  

3  

■  Oracle recommends that you use the Software Stack in the existing Templates

▪  Issues:

—  Most of it is RAC Based

—  No Standard Template

■  Use your standard OS/Load/ Template (i.e. OL6, RHEL6, etc.)

■  Install Oracle software using runInstaller.

■  Package this Oracle Software Stack in a RPM or Tar file for each software version/stack

▪  Yes this may require multiple RPM’s or Tar Files…….

Oracle Template Architecture / Flow

■  Using Standard Oracle 12c VM Template Requires deploycluster with options for new database

▪  NOTE – From the Oracle Appliance

■  Disable RAC Portion of The Oracle Kernel (Oracle 12c VM Template)

▪  Cd $ORACLE_HOME/rdbms/lib

▪  Make –f ins_rdbms_mk rac off – Disable RAC

▪  Make –f ins_Rdbms_mk ioracle – Linking Oracle

Binaries

■  Need separate Oracle install for Standard Edition.

▪  No Available VM templates for Standard Edition

Software Stack Lessons Learned

■  Create a Standard Database (General Purpose Template)

▪  Modify with desired memory / Init.ora Parms

▪  Modify File Locations, sizes

▪  Any other items for skeleton type DB

▪  Add variable by using {Var}

■  Create Template from existing database

▪  Dbca –silent –createTemplateFromDB –sourceDB C15LV

sysDBAUserName sys – SysDBAPassword Change_on_install –

templateName c15lv_template

■  Create Clone Template (This will contain the actual DB)

▪  Dbca –silent –createcloneTemplate –sourceDB C15LV –

sysDBAUserName sys – sysDBAPassword Change_on_install –

templatename C15LV_clone

▪  Creates a .ctl, .dbc and .dbf files

Oracle Template Lessons Learned

Summary

■  Deployment pieces: ▪  OVM Template for OLE6 ▪  Oracle Software RPM or Tar Files ▪  Linux packaging for Mount points (Virtual) - OVM ▪  Script to run dbca with templates

■  Inputs required ▪  Oracle Version ▪  Standard or Enterprise License ▪  Database name

■  Deployed through the following ▪  DBAAS – Grid Control (Option #1) ▪  “Service-Now” Software (Option #2) ▪  Other provisioning tools (Option #3)

36  

Deployment Summary

37  

Setting yourself up for Success Partner with your Infrastructure and Operation Teams: ■  Security Policies

■  Long Term Backups (i.e., 7 year offsite backups)

■  OS Patching (i.e., ShellShock)

■  File System Layouts

■  Life Cycle Automation

Setting yourself up for Success

Design your templates to take advantage of ZFS Clones and Snapshots: ■  Rapid database software patching

■  Refresh database environments in minutes

Managing and Monitoring: ■  Include OEM Agent client side rpm to auto register

■  Configuration Management (i.e., Change Authentication)

■  Trust and Verify (i.e., SLA requirements, Performance Benchmarks)

■  Decide if you want to use 1 template for database and OS or Separate Duties

■  Make it easy to use and Deploy

■  Using Templates allows you to standardize databases and have a repeatable process.

■  Can be deployed by EM12C or 3rd Party applications (i.e. Service Now)

■  Keep it Simple !!!

■  Consider OVCA for your future VM Needs

Summary

■  www.oracle.com/technetwork/server-storage/vm/documentation/dbracovm-deploycluster-tool-197303.pdf

■  Docs.oracle.com/cd/E17559_01/em.111/e16599/appdx_creating_db_templates.htm

■  www.oracle.com/technetwork/systems/hands-on-labs/deploy-rac-ovm-cluster-2101019.html

■  Docs.oracle.com/cdB28359_01/server.111/b28310/create002.html ■  www.oracle.com/technetwork/server-storage/vm/027000.pdf ■  Blogs from Wim Coekaerts: ■  https://blogs.oracle.com/wim/entry/

oracle_vm_template_config_script

Template References

• Virtual Compute Appliance public home page:

http://oracle.com/vca

• Virtual Compute Appliance public documentation page:

http://www.oracle.com/technetwork/server-storage/engineered-

systems/virtual-compute-docs-2082161.html

• Youtube video https://www.youtube.com/watch?v=Zt9sftetV_s

■  www.ioug.org - Content and other template presentations

■  Alvaro Alvaro Miranda Aguilera - kikitux@gmail.com - Slides / Template

Template References

Demo

Questions?

 Mike  Gangler    Michael.gangler@secure-­‐24.com    (248)  784-­‐1021  x306        

mjgangler  

mjgangler@gmail.com  

hops://mjgangler.wordpress.com/  

Please complete the session evaluation We appreciate your feedback and insight

Paper # 582

Best Practices using templates with Oracle’s VCA

Mike Gangler

You may complete the session evaluation either on paper or online via the mobile app