Large-Scale Patch Automation for the Cloud-Generation · PDF fileOverview: Patch Automation Solution Traditional Estate Multi-Tenant Engineered Systems adds adds Plug/unplug Container

Large-Scale Patch Automation for theCloud-Generation DBAs

Pankaj ChandiramaniPrincipal Product Manager , Oracle

Sean ConnollySoftware Development Director , Oracle

Steven MeredithEM Service Manager , Boeing

Copyright © 2015, Oracle and/or its affiliates. All rights reserved.

Pankaj ChandiramaniPrincipal Product Manager , Oracle

Sean ConnollySoftware Development Director , Oracle

Steven MeredithEM Service Manager , Boeing

Safe Harbor StatementThe following is intended to outline our general product direction. It is intended forinformation purposes only, and may not be incorporated into any contract. It is not acommitment to deliver any material, code, or functionality, and should not be relied uponin making purchasing decisions. The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the sole discretion of Oracle.


The following is intended to outline our general product direction. It is intended forinformation purposes only, and may not be incorporated into any contract. It is not acommitment to deliver any material, code, or functionality, and should not be relied uponin making purchasing decisions. The development, release, and timing of any features orfunctionality described for Oracle’s products remains at the sole discretion of Oracle.

3

AgendaKey Challenges/Trends from IOUG survey

Data Center Evolution

Patch Automation via Enterprise Manager

Customer Story : Boeing

Use Cases / Demos

Q&A

1

2

3


Key Challenges/Trends from IOUG survey


Patch Automation via Enterprise Manager

Customer Story : Boeing

Use Cases / Demos

Q&A

4

5

4

6

Top Challenges and Trends impacting DBASource: 2015 IOUG Survey on Database Manageability

Technology Innovationslike Cloud

Security ,Governance and

Compliance

Managing growingnumber of databasewith same resources

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. 5

Common Challenge :Keeping databases up to date with patch levels.This has increased by 30% from previous study.


SilosPlatform

Consolidation

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Complex InfrastructureConsolidation

Engineered System

Consolidation

** On Premise Private Cloud

Overview: Patch Automation SolutionEngineered SystemsMulti-TenantTraditional Estate

adds… adds…

Plug/unplug

Container DB Patching

Continuous Drift andConfiguration Auditing forPDB’s

Extending Patching beyondthe Database software

Patch the database grid

• Automated Patching via PatchPlans

• Advice/recommend patchesbased on configuration

• Minimize Downtime, identifyissues with pre requisite check

• Patch Templates andCompliance Standards

• EMCLI Support

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | 7

adds…

Continuous Drift andConfiguration Auditing forPDB’s Patch storage grid

Self Service maintenance

Simple Subscription using “Gold-Image”

Real time Patch Tracking whichhelps in real time compliance

Cloud

• Automated Patching via PatchPlans

• Advice/recommend patchesbased on configuration

• Minimize Downtime, identifyissues with pre requisite check

• Patch Templates andCompliance Standards

• EMCLI Support

Patch InfiniBand network

Patch recommendations forthe Quarterly Full StackDownload Patch.

Comprehensive dashboardof the maintenance statusand needs.

Patch Automation for Traditional Estate


Customer Story :Boeing


Information Technology | Project Name

Company and Presenter Background

BOEING – Founded in 1916▪ Designs, assembles and support commercial jetliners, defense systems, satellites and

launch vehicles

▪ Integrates large-scale systems; develop networking technology and network-centric solutions▪ Data centers spread across the US and global workforce

Steve Meredith – Boeing EM Service Focal▪ 20 years as an Oracle DBA, 27 years in IT

▪ EM service manager for the past 5 years

▪ Experience with EM 10g, 11g, and 12c

Copyright © 2015 Boeing. All rights reserved. Steven Meredith, 12/17/2015 | 10

BOEING – Founded in 1916▪ Designs, assembles and support commercial jetliners, defense systems, satellites and

launch vehicles

▪ Integrates large-scale systems; develop networking technology and network-centric solutions▪ Data centers spread across the US and global workforce

Steve Meredith – Boeing EM Service Focal▪ 20 years as an Oracle DBA, 27 years in IT

▪ EM service manager for the past 5 years

▪ Experience with EM 10g, 11g, and 12c


EM Management Environment

Large number of managed targets and their versions:▪ EM version 12.1.0.4▪ Managed targets for database, cluster, and middleware

Deployment configuration for EM:▪ Each installation – 2 node RAC database with 3 OMS servers▪ All communication thru F5 SLB’s – Using LTM and GTM configurations▪ DR Design – Active/Active configuration with fail-over

▪ Design calls for both nodes to run in the same server set on DR action– During fail over Critical Prod runs on 2 OMS nodes – NP runs on 1


Large number of managed targets and their versions:▪ EM version 12.1.0.4▪ Managed targets for database, cluster, and middleware

Deployment configuration for EM:▪ Each installation – 2 node RAC database with 3 OMS servers▪ All communication thru F5 SLB’s – Using LTM and GTM configurations▪ DR Design – Active/Active configuration with fail-over

▪ Design calls for both nodes to run in the same server set on DR action– During fail over Critical Prod runs on 2 OMS nodes – NP runs on 1


Patch Automation

Patch automation for database consolidation environments▪ Scope: Consolidation RAC database clusters▪ PSU patching required quarterly for all consumers▪ Customers span all business units within Boeing

Challenges▪ Patch schedule consolidation to maximize scalability▪ Process design to meet patching requirements for clustered databases▪ Operational discipline to maintain healthy and accurate target configurations


Patch automation for database consolidation environments▪ Scope: Consolidation RAC database clusters▪ PSU patching required quarterly for all consumers▪ Customers span all business units within Boeing

Challenges▪ Patch schedule consolidation to maximize scalability▪ Process design to meet patching requirements for clustered databases▪ Operational discipline to maintain healthy and accurate target configurations


Patch Plan Screen Shot

This plan patched 27 3-nodecluster databases (81 instances)while leaving 9 cluster db’s on theprevious home


This plan patched 27 3-nodecluster databases (81 instances)while leaving 9 cluster db’s on theprevious home


Patch Automation

Benefits▪ Significant Labor reduction but short of initial goal

– Some customers not able to support unified patch schedules▪ Enhanced productivity for patching focals▪ Decreased patch cycle times▪ Improved validation▪ Configuration changes consistently deployed and maintained within oracle homes▪ COTS vendor support for emergent patching changes▪ Consistent patching process


Benefits▪ Significant Labor reduction but short of initial goal

– Some customers not able to support unified patch schedules▪ Enhanced productivity for patching focals▪ Decreased patch cycle times▪ Improved validation▪ Configuration changes consistently deployed and maintained within oracle homes▪ COTS vendor support for emergent patching changes▪ Consistent patching process


Patch Automation

Key Tips/Take Away’s▪ Understand the features and limitations of the product▪ Analyze your environment and determine how automation will fit

– Deployment patterns and standardization are key factors in scalability

– Also evaluate organizational discipline in maintaining EM target health and configuration

▪ Set realistic goals– Consider phased implementation

▪ Have a backup patching plan▪ Get continuous and strong management support▪ Communicate successes, challenges and sometimes failures


Key Tips/Take Away’s▪ Understand the features and limitations of the product▪ Analyze your environment and determine how automation will fit

– Deployment patterns and standardization are key factors in scalability

– Also evaluate organizational discipline in maintaining EM target health and configuration

▪ Set realistic goals– Consider phased implementation

▪ Have a backup patching plan▪ Get continuous and strong management support▪ Communicate successes, challenges and sometimes failures


Patch Automation within our Internal Cloud

In-place patching selected for all hosts▪ Limits server white space for product hosting

▪ Greatly reduces resource utilization on the virtualized infrastructure▪ Allows increased scaling and consolidation for patch job creation

▪ Simplifies home selection for future automation

Working on self-service patching thru a web interface▪ Patch automation will occur at the host level

▪ Limit virtual hosts to single versions of database homes

▪ Utilize EMCLI to execute command line based patching


In-place patching selected for all hosts▪ Limits server white space for product hosting

▪ Greatly reduces resource utilization on the virtualized infrastructure▪ Allows increased scaling and consolidation for patch job creation

▪ Simplifies home selection for future automation

Working on self-service patching thru a web interface▪ Patch automation will occur at the host level

▪ Limit virtual hosts to single versions of database homes

▪ Utilize EMCLI to execute command line based patching

Summary : Patch Automation for Traditional Estate• Simplified Patching process using Patch Plans

• Support for disconnected datacenters (No connectivity to My Oracle Support)• Proactive patch recommendations for Oracle recommended patches (including CPU,PSU..)• Perform pre-flight dependency and impact analysis• Push Button Patching via Operators


• Simplified Patching process using Patch Plans

• Support for disconnected datacenters (No connectivity to My Oracle Support)• Proactive patch recommendations for Oracle recommended patches (including CPU,PSU..)• Perform pre-flight dependency and impact analysis• Push Button Patching via Operators

Patch Automation for Multi-tenant Database


Patch Automation for Multi-Tenant Databases

• Patch one - Patch all : A new paradigms forrapid patching and upgrades where Patchingone CDB results in patching all of its manyPDB’s.

• Plug/Un-plug for patching the Oracle version• Continuous Drift and Configuration Auditing

for PDB’s


• Patch one - Patch all : A new paradigms forrapid patching and upgrades where Patchingone CDB results in patching all of its manyPDB’s.

• Plug/Un-plug for patching the Oracle version• Continuous Drift and Configuration Auditing

for PDB’s

Unplug/plug for patching the Oracle versionThe multitenant architecture supports plugging a PDB into a CDB whose Oracle

Database software version differs from that of the CDB from which it wasunplugged.

Patch Automation for Multi-Tenant Databases

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |

Pre-Patched Container Database

20

Container Database

Sales RetailSales

Patch Automation for DBaaS (Private Cloud)


• Self service maintenance for Database Cloudvia Database Fleet Maintenance

• Primary maintenance mode for DBaaSdeployed via EM

• Simple Subscription model that works using“Gold-Image”

• Real time patch tracking helps in maintaining astandardized cloud environment .

Patch Automation for DBaaS (Private Cloud)


• Self service maintenance for Database Cloudvia Database Fleet Maintenance

• Primary maintenance mode for DBaaSdeployed via EM

• Simple Subscription model that works using“Gold-Image”

• Real time patch tracking helps in maintaining astandardized cloud environment .

Process1. Admin manages images of both GI and DB Homes2. Database Pools subscribe to DB and GI images3. New images automatically get deployed to servers

in the pool as new Oracle home4. Self Service users or Admin can choose to migrate

DBs over to the new home

End UsersSelf service maintenance for Database Cloud

11.2.0.3 DB Home

11.2.0.3 GI Home

11.2.0.4 DB Home

11.2.0.4 GI Home

Database Fleet Maintenance


Process1. Admin manages images of both GI and DB Homes2. Database Pools subscribe to DB and GI images3. New images automatically get deployed to servers

in the pool as new Oracle home4. Self Service users or Admin can choose to migrate

DBs over to the new home 11.2.0.3 GI Home 11.2.0.4 GI Home

Image Library

Benefits:– Scale: Subscription based, automated deployment

and at mass scale– Reduced Downtime: Out of place patching and

upgrade– Isolation & Flexibility: Users to move to new

software version on their termsAdmin

Demo – Fleet Maintenance


Demo – Fleet Maintenance

Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 34






Patch Automation for Engineered Systems


Engineered Systems – Patch ManagementPatch Automation for the infrastructure stack

Compute NodesExalogic Base ImageOracle Compute Control PlaneCloud Service EnginesSun Network QDR InfiniBandGateway Switch (NM2-GW)Oracle ZFS StorageSun Datacenter InfiniBandSwitch 36 (NM2-36p)


EM 13.1+EM 12c EM 13.1

ExalyticsExadataCompute NodesStorage ServerCellsInfiniBandNetwork Switches

Compute NodesOracle Exalytics BaseImageBIOS/ILOM firmware Oracle BI

Exalogic

Compute NodesExalogic Base ImageOracle Compute Control PlaneCloud Service EnginesSun Network QDR InfiniBandGateway Switch (NM2-GW)Oracle ZFS StorageSun Datacenter InfiniBandSwitch 36 (NM2-36p)

Operating System

Exadata System Patch ManagementExtending patching beyond the Database software

Database GridDatabase Servers•Oracle GI / RDBMS•Firmware / OS


InfiniBand NetworkSwitches Storage Grid

Exadata StorageServers

Supports application of the complete system patch – Quarterly Full StackPatch Download (QFSPD)

Patch Automation for Engineered Systems

•Comprehensive overview of the maintenance status andneeds.•Proactive patch recommendations for the Quarterly FullStack Download Patch (QFSDP)•Supports auto patch download and ability to patch either inrolling and non rolling modes.•Granular step level status tracking with real time updates ,Log monitoring and aggregation, supporting quick filing ofsupport issues with pre-packaged log dumps.•Automation either at finer level on selective parts (2/7storage server cells) or coarse level of the completecomponent (all storage servers cells)


•Comprehensive overview of the maintenance status andneeds.•Proactive patch recommendations for the Quarterly FullStack Download Patch (QFSDP)•Supports auto patch download and ability to patch either inrolling and non rolling modes.•Granular step level status tracking with real time updates ,Log monitoring and aggregation, supporting quick filing ofsupport issues with pre-packaged log dumps.•Automation either at finer level on selective parts (2/7storage server cells) or coarse level of the completecomponent (all storage servers cells)

Demo - Exadata Patch Automation


Demo - Exadata Patch Automation

SummaryTraditional Estate•Automate time-consuming and errorprone Patching operation using PatchPlans .

•Advice/recommend patches basedon configuration

•Minimize Downtime, identify issueswith pre requisite check

•Patch Templates and ComplianceStandards

Muti-tenant•Patching one container databaseresults in patching all of its manypluggable databases.

•Plug-Unplug

•Continuous Drift and ConfigurationAuditing for PDB’s

SalesDev

SalesDev 1


Traditional Estate•Automate time-consuming and errorprone Patching operation using PatchPlans .

•Advice/recommend patches basedon configuration

•Minimize Downtime, identify issueswith pre requisite check

•Patch Templates and ComplianceStandards

Muti-tenant•Patching one container databaseresults in patching all of its manypluggable databases.

•Plug-Unplug

•Continuous Drift and ConfigurationAuditing for PDB’s

Clouds•Seamless “single pane of glass”management across clouds both onpremise and public

•Self Service maintenance

•Simple Subscription using “Gold-Image”

Engineered Systems• Consolidate and automate thecomplete lifecycle management onExadata platform

•Exadata system patching includingdatabase servers

46

Learn More


Learn MoreOn Oracle Technology NetworkEnterprise Manager-Lifecycle Management Page

47

Join the ConversationLearn more at : oracle.com/enterprisemanager



Session Description

Over the last few years, Oracle Enterprise Manager has become the control center fordatabase as a service. It leverages various underlying technologies including multitenantand storage snapshot to offer consolidation planning, rapid provisioning, monitoring,and cloud governance. The innovations in this area continue at a rapid pace with OracleEnterprise Manager Database Consolidation Workbench, hybrid cloud migration, andcontinuous data refresh for DevOps. In this session, attendees learn about theseinnovations and hear successful case studies from other customers.


Over the last few years, Oracle Enterprise Manager has become the control center fordatabase as a service. It leverages various underlying technologies including multitenantand storage snapshot to offer consolidation planning, rapid provisioning, monitoring,and cloud governance. The innovations in this area continue at a rapid pace with OracleEnterprise Manager Database Consolidation Workbench, hybrid cloud migration, andcontinuous data refresh for DevOps. In this session, attendees learn about theseinnovations and hear successful case studies from other customers.

51

Documents

Large-Scale Patch Automation for the Cloud-Generation · PDF fileOverview: Patch Automation Solution Traditional Estate Multi-Tenant Engineered Systems adds adds Plug/unplug Container