Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1
DBA’s new favorite: Lifecycle Management with Enterprise Manager 12c
Hari Srinivasan Product Management, Oracle
Todd Bacon Lead Database Infrastructure, GE Oil n Gas
Vaithianathan Soundararajan DBA, Nationwide Insurance
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 2
Description
Session: CON9586
Title: DBA’s New Favorite: Database Lifecycle Management with
Enterprise Manager 12c
Description: Enterprise Manager Database Lifecycle Management
features automate day-to-day tasks for DBAs across hundreds or
thousands of databases. In this session you will learn about customers
who run Enterprise Manager 12c in production and use features like
automated discovery, provisioning, patching, change management and
compliance.
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 3
Safe Harbor
The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated into
any contract. It is not a commitment to deliver any material, code, or
functionality, and should not be relied upon in making purchasing
decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole
discretion of Oracle.
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 4
Program Agenda
Challenges & Business Impact
Enterprise Manager Lifecycle
Management Solution
– Faster and Standardized Deployments
– Manage Databases at Scale
– Reduce Downtime
Customer Testimonials
Demo & Wrap Up
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 5
Top 12 Database Administrative Challenges IOUG Survey (2012)
Diagnose Performance
IOUG 2012 Survey - Between Big Data to Databases in Cloud
47%
44%
Tune SQLs
39%
Patch to Current Levels
31%
Manual Repetitive Tasks 31%
Manage Large No. of Databases
29%
Handle Security Threats
28%
Resource & Capacity Planning
24%
Promoting Database Changes
21%
Tracking System Configurations
20%
Provisioning Systems
17%
Metering & Chargeback Reporting
20%
Rapid Growing Database Structures
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 6
Top 12 Database Administrative Challenges Lifecycle Management Challenges
IOUG 2012 Survey - Between Big Data to Databases in Cloud
Diagnose Performance
47%
44%
Tune SQLs
39%
Patch to Current levels
31%
Manual Repetitive Tasks 31%
Manage Large No. of Databases
29%
Handle Security Threats
28%
Resource & Capacity Planning
24%
Promoting Database Changes
21%
Tracking System Configurations
20%
Provisioning Systems
17%
Metering & Chargeback Reporting
20%
Rapid Growing Database Structures
28%
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 7
Can traditional approaches solve the problem ?
Manual
Lack end-to-end automation of complete stack,
such as RAC
Lack integration between Provisioning,
Configuration Management and Compliance
Can’t keep pace with evolving database
technologies such as, Multitenant option
Scripts
(Point) Products
Enterprises need a comprehensive, integrated Lifecycle Management Solution
X
X
X
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 8
Lifecycle Management Solution Requirements For Cloud-scale Operations
FASTER & STANDARDIZED
DEPLOYMENTS
REDUCE
DOWNTIME
MANAGE DATABASES AT
SCALE
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 9
Lifecycle Management Solution Requirements Faster & Standardized Deployments
FASTER & STANDARDIZED
DEPLOYMENTS
REDUCE
DOWNTIME MANAGE DATABASES AT
SCALE
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 10
Faster & Standardized Deployment Key Asks
1. Standardized, repeatable software deployments
2. Fast data cloning leveraging pluggable
databases and storage copy on write
3. Self-Service enablement
46% of the administrators do not consistently use
automated methods for provisioning IOUG Survey, 2013
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 11
Standardizing Deployments Profiles and Lock Downs Together
Provisioning Profile
Gold image with specific patches,
configuration, etc
Stored and versioned in Software Library
Clear separation of Designer and Operator roles
Lock Down
Inputs to Deployment Procedure that cannot
be edited by Operators
Used together guarantees standard deployment of
new databases
Deployment Procedure
Profile
Lock Down Inputs
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 12
Multitenant Database Provisioning EM enabled fast, flexible copy and snapshot of 12c Pluggable Databases
Create CDBs with
multiple PDBs
Unplug and plug full
data and application
Useful for
Upgrade Testing
Functional Testing
Agile development
Storage efficient
snapshots within a
container database
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 13
Features
Rapid and space efficient cloning of large databases
Support various storage vendors and configurations (Netapp, ZFS)
“Time travel” capability to restore and access past data from snapshots
Benefits
Agile provisioning (minutes to clone TB sized database)
Over 90% storage savings (KBs of additional space for cloning TB sized database)
Reduced administrative overhead from integrated lifecycle management
Snap Clone – Database Cloning in Minutes
NAME SSN SALARY
AGUILAR 203-33-3234 40,000
BENSON 323-22-2943 60,000
Test Master Database
NAME SSN SALARY
MILLER 112-23-4567 40,000
SMITH 111-22-3333 60,000
Masking & Sub setting
Production Database
010110011
101001010
000111010 Functional Copies – User can create multiple copies for functional testing without consuming space
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 14
Self-Service Enablement
Out-of-box console with customization and RESTFul API support
Provision dedicated databases, PDBs, Schemas and Clones based on pre-defined service catalog
Intelligent placement algorithm to find best destination based on load or configuration
Role based access control on service templates and software pools
Governance using policies for quota, retirement, and chargeback/showback
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 15
0
50
100
150
200
250
Deploy Application Services 10X Faster Multi-Customer Study By Crimson Consulting
DB DB+WLS
Full App Stack
Hours
Oracle DBA, telecommunications firm
“ ” With Oracle Enterprise Manager 12c we cut the
time required to provision our RAC systems in half.
“ Standardized builds based on Enterprise Manager
templates are a massive plus…you get fewer
errors, lower downtime, fewer infrastructure issues,
and faster application development. ” Oracle DBA, telecommunications firm
“ I can give a set of business resources to a
business segment and they can be responsible for
the capacity that they stand up. ” Infrastructure team manager, computer tech firm
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 16
Lifecycle Management Solution Requirements Manage Databases at Scale
FASTER & STANDARDIZED
DEPLOYMENTS
REDUCE
DOWNTIME MANAGE DATABASES
AT SCALE
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 17
Manage at Scale Key Asks
1. Keep track of fast moving assets and
relationships
2. Track changes and compliance violations
3. Prevent drifts from IT standards
25% of the environments have more than 100 databases
IOUG Survey, 2013
56% use manual methods for configuration compliance
IOUG Survey, 2013
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 18
Tracking Databases and Related Components
Auto Discovery finds databases regardless of
creation method:
Manual methods such as DBCA
Provisioned by Enterprise Manager
Automated discovery of relationships, e.g:
RAC databases and Clusterware
Pluggable and Container database
Topology Viewer to perform dependency and
impact analysis
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 19
Simplified Adhoc Reporting
Powerful adhoc search based on configuration values,
target properties, relationships, e.g:
Find all databases with sga_target greater than 5GB
and hosting E-Business Suite on Exadata
Search queries based on Mgmt$ Views can be used
from BI Publisher for reporting to non-EM users
Saved Searches can be accessed and leveraged from
EMCLI, e.g:
emcli get_targets -config_search="Databases on Exadata" –target_name="exa%“
Configuration Search
Integrated
BI Publisher
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 20
Efficient Drift Tracking Finding the ‘needle in the haystack’
1-1 and 1-n comparison across
Dev, test, Prod, DR
environments
Comparison of entire stack, e.g:
Exadata database machine
(database, grid infrastructure,
compute node, storage)
Comparison Templates to control
what’s compared and how
Automatic drift detection and
notification
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 21
Comprehensive Compliance Reporting
Real-time change detection for critical files and
objects
Automated reporting of compliance against Oracle
Best Practices and internal standards covering:
Exadata
RAC, Single Instance, Pluggable databases
Underlying OS and related Applications
Can be mapped to CIS, PCI or other frameworks
Compliance Management with Dashboard maintains
and displays up to date compliance score
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 22
Introducing …
Change Activity Planner Plan, Track and Monitor Change Activities in Real Time
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 23
Tracking Rollout with Change Activity Planner Visibility into long running processes
Track long running change activity
involving multiple people or teams
Ideal for rolling out changes over time
by multiple users
Graphically create plans including
dependency and sequences
Tasks assigned based on target
ownership to individual administrators
Automated status update based on
patch deployment, compliance rollout.
Access support both as a Manager
and a DBA
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 24
Change Activity Plans- Define Process flows
• Create Change Activity Plan with
Tasks Groups and Tasks
• Define dependencies, sequencing,
e.g: Do it in Test/QA env then move it
to Production post approvals.
• Orchestrate from EM (Jobs, Patch
plans, DPs..) or outside EM
• Associate targets – Groups, LOBs,
query based on Configuration
attributes while creating tasks
• Automatic task assignments based on
target ownership
• Flexible scheduling allows you to
define start time and the effective
duration of the plan
Create - Tasks, Tasks Groups with dependency & sequencing
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 25
Change Activity Plans: Separation of views…
• Monitor status across
all plans, quickly
identify plans that need
attention
• Track individual plans
and their tasks
• Handle assignments
and ownership
changes
• Track Progress
• Generate Reports for
Management
Reporting
Manager’s View
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 26
• Identify and Manage
all tasks posted
• Quickly get to top
tasks, tasks that need
attention
• Allows
acknowledgement
and other human
flows
• Complete action for
standards tasks like
patching, compliance
rollouts, etc.. From
within EM.
• Add Comments and
review Audit trail
Change Activity Plans: Separation of views DBA’s View
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 27
Todd Bacon Lead Database Administrator General Electric Oil and Gas
Todd Bacon Lead Administrator Infrastructure Group General Electric, Oil & Gas
Lifecycle Management with Oracle Enterprise Manager 12c
29 GE Title or job number
9/24/2013
Measurement & Control Subsea Systems Global Services Drilling & Surface Turbomachinery
GE Oil & Gas overview Employees: ~39,000 Operating in more than 130 countries
•Drilling risers
•Blow-out preventers
•Electric submersible pumps
•LWD & wireline tools
•Surface wellheads & flow control
•Logging services
• Asset condition monitoring, control, sensing & inspection solutions
• Optimization & diagnostic software
• Control & safety relief valves
• Blowers, compressors, flow & NG Pipeline Solutions
• Fuel dispensers & payment terminals
• Fuel control & retail systems
• CNG compression
•Subsea trees & wellheads
•Subsea power & processing
•Controls
•Manifolds
•Flexible risers
•Flow lines
•Specialty connectors & pipes
•Floating production systems
•Transactional outage services
•Contractual services
•Conversions, modifications, & upgrades
•Remote monitoring & diagnostics
•Gas & steam turbines
•Axial, centrifugal & reciprocating compressors
•Reactors & heat exchangers
•Radial & hot gas expanders
•Pumps, valves & fuel gas systems
•Control panels
•Industrial modules
A portfolio that spans from upstream to downstream,
with service & measurement & control solutions at our core
PII Pipeline Solutions a GE - Al Shaheen JV
29
Old landscape
Setup • 1600 + agents
• 1 load balancer
• 3 OMS
• all server V440’s
Planned HA Architecture
Setup • All new hardware
• 1600 + agents
• 1 load balancer
• 3 OMS – DL380s
• 2 server RAC –
DL580s
Actual HA Architecture
Setup • Business Delayering
• 1600 + agents Split
between 4 businesses
• 1 load balancer per
business
• 3 OMS – DL380s using
unique ports
• 2 server RAC –
DL580s with unique
dbs per business
What does this mean Small issues are Magnified
Downtime management
Capacity Planning
Standards
Total Cost of Ownership
Opportunities…
Downtime Management Reactive VS Proactive
Manual process
Long weekends
Human error
Capacity Planning Shared Data centers
Shared Hardware
Shared Databases
Ownership
Opportunities
Standards Hosts
Databases
Total Cost of Ownership Shared Data centers
Shared Hardware
Shared Databases
Ownership
OEM12c Comes to the rescue!
OEM12c Downtime Management
Patching and Upgrades!
Automated Database Patching
• RAC DB patch
• Standalone DB patch
Automate Agent patching/upgrades
• Agent upgrades
• Agent patches
OEM12c Capacity Planning
Proof of concept Database….DBaaS!
Database creation
• DBA control the environment
• Eliminates requests
• DB created in 35 minutes
OEM12c Capacity Planning
Compliance Standards
Templates
• Framework
• Production/Development
• Different Target Types
Summary
OEM12c can help with
Downtime management: Automated Patching!
Capacity Planning: DBaaS/Chargeback
Standards: Compliance libraries
Total Cost of Ownership: Better visibility over all!
Summary
Lessons learned!
Hard work at the beginning is required!
Foundation! Foundation! Foundation!
Team work!
Much more to come!
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 42
Lifecycle Management Solution Requirements Reduce Downtime
FASTER & STANDARDIZED
DEPLOYMENTS MANAGE DATABASES AT
SCALE
REDUCE
DOWNTIME
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 43
Reduce Downtime Key Asks
1. Reduce risk of changes through pre-flight checks
2. Apply multiple changes at the same time
3. Minimize downtime during the change process
59% experience extended downtime owing to manual patching
IOUG Survey, 2013
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 44
Predictable Patching with Pre-flight Checks
Comprehensive real time sanity and conflict checks
prior to patch deployment
Patch conflict checking:
Among patches within the patch plan
Between patches in plan and current inventory
Optional post check pause saves valuable
maintenance window time by performing checks
ahead of time
Target availability OPatch and OUI checks Inventory Sanity
- Locks, Access System space Cluster verification - cluvfy, srvctl Config sqlplus access Patch Conflicts …
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 45
Simplified Mass Patch Deployment Apply multiple patches in a single downtime window
Patch Plan wizard guides admin through choosing
patches, how to deploy them and to which targets
Add patches to Patch plan using:
Recommended Patches ( CPU/PSU, Security)
Manually using MOS Search
Patch Template used to mass deploy set of patches in a
consistent and approved manner.
Integrated with Change Activity Planner to datacenter
rollout tracking
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 46
Rolling Real Application Cluster patching
• Near zero Downtime Rolling Patch Orchestration across RACs
• Patch support Grid Infrastructure (Clusterware) bundles, applying the patch to both GI
and RAC OH one node at a time or on all nodes simultaneously
• Supports database version 10.2.0.x and onwards
• Including Database 12c Pluggable Databases, Clusterware and ASM
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 47
Minimum Downtime, Out-of-Place Patching
Apply patch to a clone of the current Oracle Home
before switching database instance
Instances can be migrated together or individually
based on business needs
Technique enables:
Deployment of patch before the downtime window
Troubleshooting during non-downtime windows
Switchback after migrate, in case of issues
N
o D
ow
nti
me
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 48
Mass and Automated Database Upgrades Automation in Scale
Upgrade Standalone, RAC, and Data guard (Primary-
Standby) Databases from older versions to higher versions
(supports DB12c)
RAC Database Upgrades:
Full stack upgrade covering Grid Infrastructure and RAC DBs
Flexibly upgrade to suit the operational and testing needs (GI
only, Few RAC DBs or All RAC DBs)
Minimize downtime by upgrading software and Database
separately
Comprehensive pre-requisite checks including RAC checks,
cluster verify (CVU) checks , can be updated directly from MOS
Integrated back up and restore policies
Rolling Upgrade using Transient logical standby for Data
Guard based Primary and Standby Databases
Support upgrading multiple standby environments Oracle Data Guard
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 49
Vaithianathan Soundararajan Database Administrator Nationwide Insurance
Database Lifecycle
Management
with Oracle Enterprise
Manager 12c
Vaithianathan Soundararajan
About Nationwide
Founded in 1926
$22.4 Billion in Revenue
$168 Billion in Assets
Fortune 100 Company
33,000 Employees/Associates
#1 Writer of farm owner insurance
#1 provider of public-sector retirement plans
OEM 12c Overview
4 Management Servers
(OMS) spread across 2
data centers
Repository (OMR) 2
node RAC cluster with
DataGuard to another 2
node RAC cluster
293 Agents
218 Linux
75 Solaris
5600 Monitored Targets
1300 Database
Challenges in 2013 and beyond 2013
Currency – Each Oracle DB will receive yearly security patch.
Compliance - Each database will be evaluated quarterly against the security template.
Gold Copy Provisioning - Quicker deployment of Oracle databases.
Patching.
Future
• Currency – Bi-annual and eventually quarterly.
• Compliance-Stricter tracking of violations to include trending and remediation
• Provisioning - Quicker deployment of Oracle databases
• Gold Copy Provisioning
• Cloud Management pack with self service provisioning.
• Patching-High priority security patches applied across the company in a timely fashion.
Problem 1 : Provisioning
Do more with less
Increase demand for Dev. Databases with shorter
timeframes
Provision Oracle Binary/Database
Comparison
Manual Method – 135 Min
Identify a Database Version (include latest Patch Set Update and one-off Patches) – 30 mins.
Download and Ftp Binary zip file to the Host or NAS mount and unzip files – 45 mins.
Run Oracle Software Prerequisite checks – 15 mins.
Run Installer and install Software – 45 mins.
Enterprise Manager 12c – 20 Min
Create Gold Image in Software
Library (Gold Copies of Oracle
Software were kept in a virtual
server) for every version – 15
mins./image ( 1 Time Effort )
Use Custom profile/procedure to
provision Oracle Software – 20
mins.
600% Savings!
14 Database Gold Images
Provisioning Gold Images
Database Software Deployed in 15:42
Problem 2 : Patching
Software currency : Database Version should be
current with periodic patching to latest patchset
Ever expanding complexity of Database environment
(Real Application Clusters (RAC), RAC 1 Node,
Veritas Clustering)
Patching Oracle Database
Manual Method – 1.5 Hrs/DB
Identify a Database Patch
Download and Ftp Patch zip file to the Host or central location and unzip files – 20 ~ 30 mins.
Run Prerequisite (Upgrade Opatch, conflict check etc.) – 15 ~ 20 mins.
Blackout Targets, Stop Listener, Stop Database(s) – 30 mins.
Apply Patch – 20 mins.
Enterprise Manager 12c – 40 mins.
Identify a Database Patch and Create Patch Plan – 10 mins.
Run Analyze (OEM 12c Patching Procedure runs prerequisite checks such as Credentials setttings, Upgrades Opatch, checks for patch conflicts etc.,) – 10 mins.
Deploy (Apply Patch) ~ 20 mins.
Yearly Patch (Includes a PSU and one-off/merge/Overlay patches)
Savings increase with more databases
Successful Patch deployment
Patch Plans
Problem 3 : Compliance
Increased scrutiny on security compliance
with quarterly review and remediation
Compliance Compliance framework incorporated into existing OEM infrastructure
After Setup – compliance evaluations require no additional maintenance occur daily.
Ability to send notifications when new compliance violations are created.
Visibility of compliance results for entire system and on each target’s home page.
Manage Compliance
Out of the Box Compliance Standards
Custom Compliance Standards
Compliance Standard Rules
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 65
Demo Lifecycle Management
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 66
Oracle DB Lifecycle Management Solution
Proven, Faster ROI
Complete Lifecycle Management
• Provisioning & Cloning
• Patch Automation
• Upgrades
• Configuration Management
• Compliance Management
• Change Management
Enabler of Private
Database Cloud
Cloud Foundation
140% ROI over 3 years
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 67
Q & A
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 68
Resources
Lifecycle Management on OTN
http://tinyurl.com/em12lcm
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 69
Graphic Section Divider
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 70