1 | © 2011 Oracle Corporation – Proprietary and Confidential
2 | © 2011 Oracle Corporation – Proprietary and Confidential
SPARC SuperCluster Backup / Recovery, Disaster Recovery and Archiving
Dean Halbeisen
3 | © 2011 Oracle Corporation – Proprietary and Confidential
Agenda
• Oracle Optimized Solution for Oracle Secure
Backup (Updates)
• SPARC SuperCluster Backup and Recovery
• SPARC SuperCluster Disaster Recovery
• SPARC SuperCluster Archiving
• SPARC SuperCluster Backup and Recovery
with Archiving
• Conclusion
4 | © 2011 Oracle Corporation – Proprietary and Confidential
Oracle Optimized Solution For Oracle Secure
Backup Solution Overview
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
Oracle Optimized Solution for Oracle Secure Backup Solution Overview
Oracle Software
Oracle Hardware
Oracle Enterprise
Manager Ops
Center
Oracle Secure Backup
Oracle Solaris / Oracle Enterprise Linux
Sun x86 Servers SPARC T4 Servers Oracle Storage
Oracle Services
Installation / Support Services
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
Oracle Optimized Solution for Oracle Secure Backup Architecture Overview
Storage
Archive
Manager
Data Management Tier Oracle Secure Backup
Media Servers
SPARC and X86 Options
Storage Tier Oracle Disk
Oracle Tape
Oracle Key Manager
Administration Tier Oracle Secure Backup
Administration Servers
SPARC and X86 Options
Client Tier Exadata
SPARC SuperCluster
Oracle Optimized Solutions
SPARC T-Series Sun Fire X-Series Or
SPARC T-Series Sun Fire X-Series Or
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
Tape / Encryption Management Systems Optional Systems for Tape / Encryption Management
• Does not have to be an Oracle rack, but all systems must be installed externally
• Oracle Secure Backup administrative and media servers
• StorageTek Automated Cartridge System Library Software (ACSLS)
• Oracle Key Manager
• Infiniband and Fibre Channel switches
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
Exadata Expansion Storage Expanding SPARC SuperCluster Storage
• Must be an Exadata Expansion Rack!!!
• The Oracle Exadata Storage Expansion Rack is ideal for storing massive
amounts of structured and unstructured data including historical relational
data; backups of Oracle Exadata Database Machine; weblogs; documents,
images, LOBs and XML files
• Full Rack with 18 Oracle Exadata Storage Servers delivering up to 6.75 TB
of Oracle Exadata Smart Flash Cache, 432 TB of raw disk storage, and 216
CPU Cores for SQL processing in storage
• Half Rack with 9 Oracle Exadata Storage Servers delivering 3.4 TB of Oracle
Exadata Smart Flash Cache, 216 TB of raw disk storage, and 108 CPU
Cores for SQL processing in storage
• Quarter Rack with 4 Oracle Exadata Storage Servers delivering 1.5 TB of
Oracle Exadata Smart Flash Cache, 96 TB of raw disk storage, and 48 CPU
Cores for SQL processing in storage
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
S7420
S7320 S7120
S7420
7320
Entry cluster-capable
Up to 96×1T or 2T 7,200 RPM SAS disks
or 300GB or 600GB 15,000 RPM SAS disks
Up to 8×512G read/16×18G write flash
Active-active clustering for H/A
Sun ZFS Storage 7320
What you get: • High availability cluster option • 2 CPUs (4 cores per CPU) per controller • Up to 4TB/system of read flash cache
Value: Entry level modular scalability and high availability up to 192TB for accelerated business application performance
Uses: Use for general purpose file sharing, virtualization, disaster recovery, test, QA, streaming workloads such as video/media
ZFS Storage Appliances
• Up to 288 GB of write flash cache • Up to 72 GB DRAM per controller
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
S7420
S7320 S7120
S7420
7420
Expandable cluster-capable Up to 576×1T or 2T 7,200 RPM SAS disks
or 300GB or 600GB 15,000 RPM SAS disks
Up to 8×512G read/96×18G write flash
Active-active clustering for H/A
Sun ZFS Storage 7420
What you get: • Up to 1.15 PB HDD capacity, up to 64 CPU cores/system • Up to 1TB/system DRAM cache • Up to 4TB/system read flash cache • Up to 1.7TB write flash cache • Up 120Gb/s Ethernet bandwidth connectivity
Value: Modular scalability and high availability up to 1.15 PB for accelerated business application performance
Uses: Consolidation of virtualization environments requiring multiple data services, heterogeneous file sharing , back up, disaster recovery, and bulk storage
ZFS Storage Appliances
11
SPARC SuperCluster Backup and Recovery Oracle Optimized Solution for Oracle Secure Backup
SPARC SuperCluster Tape / Encryption Management Systems StorageTek SL3000 Tape Library ZFS Storage Appliance
RMAN B/R RMAN B/R RMAN B/R
RMAN
Migration to Tape
RMAN
Migration to Tape
RMAN
Migration to Tape
3rd Party
NDMP B/R
3rd Party
NDMP B/R
Infiniband Infiniband Fibre Channel
Fibre Channel
Fibre Channel
Infiniband
Infiniband Infiniband
12 | © 2011 Oracle Corporation – Proprietary and Confidential
SPARC SuperCluster
Backup and Recovery
13
Challenges of Today’s Backup and Recovery
Challenge Results
RMAN aware of all
copies
• Double handling of backup data by the DB domain
Natural Disaster • Data Loss
Organizational
Failure
• Data access loss; possibly data loss
Information Attack • Data corruption or loss
Human Error • Data loss or data access loss
14
• Backups to be done with third party NDMP and or ZFS snapshot backups
• Operating systems from all T4 systems domains
• Application storage – home directories, binaries, logs, etc.
• Administration storage – home directories, scripts, logs, system logs,
etc.
• Overall system configuration – fabrics, 7320, fiber channel switches, etc.
• Backups to be done with RMAN to disk or RMAN to tape through OSB
• Databases, both local and remote
SPARC SuperCluster Backup and Recovery What Needs to be Protected
© 2011 Oracle Corporation Oracle Confidential
15
SPARC SuperCluster Backup and Recovery Base Backup Solution
Primary Site Secondary Site
SPARC SuperCluster
SPARC SuperCluster
Active Data Guard Replication For Databases
ZFS Storage Appliance Replication For Applications, Domain Backups
16
• Frequent snapshots, single file restores from snapshot copies on internal drives, ZFS send to
internal 7320 for fast backups and recovery, replication to remote sites as required
• No bare metal restores from ZFS snapshots, system must be restored with BI scripts, then
customer configurations restored with ZFS snapshot restores
SPARC SuperCluster Backup and Recovery Operating systems from all T4 Systems Domains
SPARC SuperCluster Tape / Encryption Management Systems StorageTek SL3000 Tape Library
3rd Party
NDMP B/R
3rd Party
NDMP B/R
Fibre Channel Infiniband
Infiniband Infiniband
ZFS
Snapshot B/R
17
• Frequent snapshots and replication to remote sites as required, single file restores
from snapshot copies or full restores from 3rd party NDMP backups
• Multiple projects and shares used to provide more granular backups and restores
SPARC SuperCluster Backup and Recovery Applications, Domain Backups, System Configurations
© 2011 Oracle Corporation Oracle Confidential
SPARC SuperCluster Tape / Encryption Management Systems StorageTek SL3000 Tape Library
3rd Party
NDMP B/R
3rd Party
NDMP B/R
Fibre Channel Infiniband
Infiniband Infiniband ZFS
Snapshot B/R
18
Fastest Time to Recovery Database Backup Targets for SPARC SuperCluster
ZFS Storage Appliance
Tape Storage SPARC SuperCluster Exadata Storage
Expansion Storage
Fast – Up to over 20TB/hr. Flexible – Up to over 8TB/hr. Economical – Up to over 8TB/hr.
19
Disk-To-Disk-To-Tape for Databases Using RMAN backup backupset with Exadata Expansion Storage
RMAN B/R
Exadata Expansion Storage SPARC SuperCluster
RMAN Migration
StorageTek SL3000 Tape Library
DR Restores
RMAN Migration
20
Disk-To-Disk-To-Tape for Databases Using RMAN backup backupset with External ZFSSA
RMAN B/R
ZFS Storage Appliance SPARC SuperCluster
RMAN Migration
StorageTek SL3000 Tape Library
DR Restores
RMAN Migration
21
Disk-To-Disk-To-Tape for Databases Using NDMP Backups of ZFSSA RMAN Backups
RMAN B/R
ZFS Storage Appliance SPARC SuperCluster StorageTek SL3000
Tape Library
NDMP DR Restores
NDMP DR Backups
22
Example Configurations (Details) SPARC SuperCluster Data Protection
Half Rack Full Rack
Oracle Secure Backup Administrative Servers 2 x T4-1 8GB RAM 2 x T4-1 8GB RAM
Oracle Secure Backup Media Servers 2 x T4-1 32GB RAM 2 x T4-1 32GB RAM
ACSLS Server 1 x ACSLS Server 1 x ACSLS Server
Oracle Key Manager Appliances 2 x Oracle Key Manager Appliances 2 x Oracle Key Manager Appliances
Oracle Tape Analytics Server 1 x Oracle Tape Analytics Server 1 x Oracle Tape Analytics Server
Exadata Storage Expansion Rack 1 x Exadata Storage Expansion Rack
4 x Exadata Expansion Storage Cell
1 x Exadata Storage Expansion Rack
8 x Exadata Expansion Storage Cell
ZFS Storage Appliance 1 x 7320 Cluster with 2 ROSSD
2 x Expansion Trays with 1 WOSSD
1 x 7420 Cluster with 2 ROSSD
4 x Expansion Trays with 1 WOSSD
Tape Drives
4 x T10000C (preferred)
-or-
7 x LTO 5
8 x T10000C (preferred)
-or-
14 x LTO 5
Tape Library 1 x SL500 or SL3000 1 x SL500 or SL3000
Switching 1 x 36 port Infiniband Switch 1 x 36 port Infiniband Switch
23
SPARC SuperCluster
Disaster Recovery
24
Challenges of Today’s Disaster Recovery
Challenge Results
Natural Disaster • Data Loss, business continuance
Organizational
Failure
• Data access loss; possibly data loss
Information Attack • Data corruption or loss
Human Error • Data loss or data access loss
25
SPARC SuperCluster Disaster Recovery What Needs to be Recovered on Recovery Site
© 2011 Oracle Corporation Oracle Confidential
System Component Single Pair
Domain Configurations – restored in BI process ✓ ✗
Operating systems from all T4 systems domains ✓ ✗
Application storage – home directories, binaries, logs ✓ ✗
Administration storage – home directories, scripts, logs ✓ ✗
Overall system configuration – fabrics, 7320 ✓ ✗
Databases – Restore with RMAN or Active Data Guard ✓ ✓
26
Disaster Recovery Configuration Remote Site Replication
Primary Site Secondary Site
SPARC SuperCluster
SPARC SuperCluster
Active Data Guard Replication For Databases
ZFS Storage Appliance Replication For Applications, Domain Backups
27
• Normal MAA best practices for Active Data Guard to replicate
and recover databases on remote sites
SPARC SuperCluster Disaster Recovery Databases
© 2011 Oracle Corporation Oracle Confidential
SPARC SuperCluster
SPARC SuperCluster
Active Data Guard Replication For Databases
28
• Frequent snapshots and replication to remote sites as required, single file restores from snapshot
copies, ZFS send copies made to internal 7320
• No bare metal restores, operating system must be operational enough to restore from remote
replicated snapshots or local snapshot copies, remote copies not required to recover application
SPARC SuperCluster Disaster Recovery Operating systems from all T4 Systems Domains
SPARC SuperCluster
SPARC SuperCluster
ZFS Storage Appliance Replication Domain Backups
ZFS
Snapshot B/R
ZFS
Snapshot B/R
29
• Frequent snapshots and replication to remote sites, single file restores from snapshot copies or
full restores from 3rd party NDMP backups
• Multiple projects and shares used to enable higher performance and to provide more granular
backups and restores, remote copies are generally not required to recover the application
SPARC SuperCluster Disaster Recovery Applications, Domain Backups, System Configurations
© 2011 Oracle Corporation Oracle Confidential
SPARC SuperCluster
SPARC SuperCluster
ZFS Storage Appliance Replication For Applications
ZFS
Snapshot B/R
ZFS
Snapshot B/R
30
• Operating systems from T4 Domains are reinstalled with a bootable image, then restored with 3rd
party NDMP or ZFS snapshot backups
• Application, Administrative and Configuration storage restored with NDMP backups of 7320
through Oracle Secure Backup from tape
• Databases restored with RMAN backups on external ZFSSA or with NDMP backups of external
ZFSSA (two step restore) through Oracle Secure Backup from tape
SPARC SuperCluster Disaster Recovery Single Site Recovery
SPARC SuperCluster Tape / Encryption Management Systems StorageTek SL3000 Tape Library ZFS Storage Appliance
RMAN B/R RMAN B/R RMAN B/R
3rd Party
NDMP B/R
3rd Party
NDMP B/R
Infiniband Infiniband Fibre Channel
Fibre Channel Infiniband
31
Disaster Recovery Configuration With Backup and Recovery Systems
SPARC SuperCluster
SPARC SuperCluster
Active Data Guard Replication For Databases
ZFS Storage Appliance Replication For Applications
Application Users
Primary Site Secondary Site
2 x 1GbE ports in IPMP configuration on 7320
10GbE ports on Database Domains
ZFS Storage Appliance
StorageTek SL3000 Tape Library
ZFS Storage Appliance
StorageTek SL3000 Tape Library
No Replication
2 x 1GbE ports in IPMP configuration on 7320
10GbE ports on Database Domains
No Replication
32
SPARC SuperCluster
Archiving
33
• Application data through ECM connections for Optimized Solutions on
SPARC SuperCluster
• Siebel CRM with Marketing
• PeopleSoft HCM
• E-Business Suite
• JDEdwards
• The archiving system could also provide a nearly bottomless storage for
RMAN backups, ZFS file system backups and system logs
SPARC SuperCluster Archiving What Could be Archived
34
• 2 X T4 servers for SAMFS
• 1 X or more 2500M2’s
• Tape infrastructure – ACSLS, SL3000, T10000C tape drives, Oracle Key
Manager and FC switch
SPARC SuperCluster Archiving Optimized Solution for Life Cycle Management Architecture
Oracle Key Manager
SL3000 or SL8500 Tape Library
ACSLS
T10000C Tape Drives
SPARC SuperCluster
Infiniband
Fibre Channel
Archiving Infrastructure -
SAMFS
35
• The SuperCluster uses NFS to access the archiving system
• New data or hot data would be located in the disk cache on the 2500M2,
data archived on disk on the ZFSSA 7420 (NFS) and long term archived
data on tape
SPARC SuperCluster Archiving How it works
SPARC T4
SPARC T4
SPARC T4
SPARC T4
Archiving
Servers
NFS Shares
Infiniband
2500M2
2501
Tier 1 Storage
7420
7420
Tier 2 Storage
SL3000
T10000C
Tier 3 Storage
NFS IPoIB
SuperCluster
ECM
RMAN
LOGS
ZFS SS
36 | © 2011 Oracle Corporation – Proprietary and Confidential
SPARC SuperCluster
Backup and Recovery with Archiving
37 | © 2011 Oracle Corporation – Proprietary and Confidential
• Brings together both “bolt-on” infrastructure solutions
• Oracle Optimized Solution for Oracle Secure Backup
• Oracle Optimized Solution for Archiving ***In planning***
SPARC SuperCluster Backup and Recovery with Archiving Oracle Optimized Solutions for Oracle Secure Backup and Archiving Brought Together
Oracle Key Manager
SL3000 or SL8500 Tape Library
ACSLS
T4-1 OSB FC/IPoIB Media Server
T4-1 OSB Admin Server
T10000C Tape Drives
SuperCluster
Infiniband
Fibre Channel
Archiving Infrastructure -
SAMFS
ZFS Storage
Appliance
38 | © 2011 Oracle Corporation – Proprietary and Confidential
SPARC SuperCluster Backup and Recovery with Archiving How it works – Proposal ( Easy to Deploy Now )
SPARC T4
SPARC T4
Archiving
Servers
NFS Shares
Infiniband
2500M2
2501
Tier 1 Storage
7420
7420
Tier 2 Storage
SL3000
T10000C
Tier 3 Storage
NFS IPoIB
ECM
RMAN
LOGS
SPARC T4
SPARC T4
OSB Media
Servers
SPARC T4
SPARC T4
SuperCluster
ExaStorage
ExaStorage
ExaStorage
ExaStorage
7420
7420
ZFSSA
SL3000
T10000C
Tier 3 Storage
Infiniband
ExaStorage
ExaStorage
ExaStorage
ExaStorage
ZFS SS
39 | © 2011 Oracle Corporation – Proprietary and Confidential
SPARC SuperCluster Backup and Recovery with Archiving How it works – Proposal (with LDOMS and containers)
SPARC T4
SPARC T4
Archiving
/ OSB Media
Servers
NFS Shares
Infiniband
2500M2
2501
Tier 1 Storage
7420
7420
Tier 2 Storage
SL3000
T10000C
Tier 3 Storage
NFS IPoIB
ECM
RMAN
LOGS
SPARC T4
SPARC T4
SuperCluster
ExaStorage
ExaStorage
ExaStorage
ExaStorage
ExaStorage
ExaStorage
ExaStorage
ExaStorage
ZFS SS
40 | © 2011 Oracle Corporation – Proprietary and Confidential
SPARC SuperCluster
Conclusion
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
Oracle Optimized Solution For Oracle
Secure Backup with SPARC SuperCluster
• Materials that will be updated
• Solution playbook, solution cheat sheet
• Solution business and technical white papers
• Solution business and technical presentations
• Solution bill of materials to be specialized to individual solutions
• New Materials for SPARC SuperCluster
• Solution playbook, solution cheat sheet
• Solution implementation guide
• Solution technical presentation
• Solution specific bill of materials
• ACS installation offerings
42 | © 2011 Oracle Corporation – Proprietary and Confidential
Q&A
43 | © 2011 Oracle Corporation – Proprietary and Confidential
44 | © 2011 Oracle Corporation – Proprietary and Confidential