22
1 EMC CONFIDENTIAL—INTERNAL USE ONLY Game-Changing, Next- Generation Backup and Recovery with Data De-duplication Doug Wilkes Systems Engineer EMC Corporation

Game-Changing, Next-Generation Backup and Recovery with Data De-duplication

  • Upload
    sera

  • View
    34

  • Download
    0

Embed Size (px)

DESCRIPTION

Game-Changing, Next-Generation Backup and Recovery with Data De-duplication. Doug Wilkes Systems Engineer EMC Corporation. Avamar VM. Operating System. Avamar Overview. AVAMAR SOFTWARE. - PowerPoint PPT Presentation

Citation preview

Page 1: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

1EMC CONFIDENTIAL—INTERNAL USE ONLY

Game-Changing, Next-Generation Backup and Recovery with Data De-duplication

Doug WilkesSystems EngineerEMC Corporation

Page 2: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

2EMC CONFIDENTIAL—INTERNAL USE ONLY

AVAMAR SOFTWARE

Avamar Overview

Reduces the size of backup data at the source, enabling fast, daily full backups across existing physical and virtual infrastructure

– Reduces daily backup times by up to 10x reduction

– Reduces daily network bandwidth impact by up to 500x

De-duplicates across sites and servers for maximum efficiency

– Reduces total disk backup storage by up to 50x

Cost-effectively store full backups on disk for extended period of time – reducing/ eliminating reliance on tape

Ideal for protecting VMware environments, remote offices, and data centers constrained backup windows or limited bandwidth

Revolutionizes backup with global, source data de-duplication

AVAMAR VIRTUAL EDITION FOR VMware

Avamar VM

Operating System

AVAMAR DATA STORE

Agent-only or deployed on qualified, industry standard servers

Fully integrated software/ hardware solution

Avamar server deployed as a virtual appliance

Page 3: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

3EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar: How it Works

Global, Source Data De-duplication

At the source—De-duplication before data is transported across the network

At the target—Assures coordinated de-duplication across sites, servers, and over time

Granular—Small, variable-length sub-file segments guarantee most effective de-duplication

Send and store each atom only once

EMC Avamar backup repository

…up to 500 times daily data reduction

Break data into atom (sub-file, variable-length segments of data)

O H

O

HH

O

HH

O

HH

O

HH

O

HH

Page 4: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

4EMC CONFIDENTIAL—INTERNAL USE ONLY

Remote Site 1 Duplicate Instance

Data already backed up, so only unique IDs stored (20 byte pointers)

DataCenter

A B C D

De-duplication Server (stored backup data)

Only unique data segments are backed up

E

E

AB

CD

First InstanceRemote Site 2 Modified Instance

New data segment identified and backed up

Avamar: How it Works

Simple Example of Global, Source Data De-duplication

Page 5: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

5EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar’s Innovative Architecture

Redundant Array of Independent Nodes (RAIN) architecture

– Each server node with internal disk storage and CPU

– Provides high availability and fault tolerance across nodes

Grid architecture for online scalability and performance

Daily integrity checks for Avamar server and data recoverability

RAID protection from disk failures

Available for Avamar software and Avamar Data Store

Avamar Server

Parity across storage nodes

Verified checkpoint

Utility andspare node

U.S. Patent No. 6,826,711

Page 6: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

6EMC CONFIDENTIAL—INTERNAL USE ONLY

- 6

EMC Avamar for VMWare BackupFile Level Recovery without the cost/complexity

Avamar

Avamar makes backup to disk more economical

Traditional Backup vs. EMC AvamarTotal Cumulative Storage - 10TB MS Office file data

(Traditional = weekly fulls + daily incrementals; EMC Avamar = daily fulls)

16

32

48

64

80

96

112

128

144

160

176

192

8

1624

3240

4856

6472

80

8896

5.55.35.14.94.74.44.24.03.83.63.43.20

20

40

60

80

100

120

140

160

180

200

1 2 3 4 5 6 7 8 9 10 11 12

Weeks

Cu

mu

lati

ve

TB

Traditional BackupTraditional Backup with Compression (2:1)EMC Avamar

Traditional Backup

Traditional Backup w/Compression (2:1)

EMC Avamar

Traditional Backup v. EMC AvamarCumulative Media Required

4 weeks 8 weeks

Tremendous backup process improvements– 90% reduction in VMDK backup storage requirements– 10x improvement in backup times– De-dupe at source enables higher consolidation

Page 7: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

7EMC CONFIDENTIAL—INTERNAL USE ONLY

Virtualization Changes Server, Application, and Information Paradigm… Backup Must Evolve to Deliver Even Greater Consolidation and Value

Virtual Server A

Virtual Server B

Virtual Server C

100%

80%

40%

0%

60%

20%

CP

U U

tiliz

atio

nC

PU

Util

izat

ion

NEW PARADIGMVirtual Environment: High overall server utilization and little bandwidth for backup

OLD PARADIGMPhysical Environment: Low overall server

utilization and plenty of bandwidth for backup

VMware Backup Challenges

100%

80%

40%

0%

60%

20%

CP

U U

tiliz

atio

nC

PU

Util

izat

ion

Server A Server B Server C

Shared Physical Resources

20 percent resource utilization 80 percent resource utilization

Page 8: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

8EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar’s Optimized Backup for VMware Infrastructure

Optimal location: Reduces data at the source– Duplicate data never traverses congested shared resources– Data backed up is reduced from ~200 percent to ~2 percent of primary weekly– Significantly reduces contention for shared resources– De-duplicates within and across virtual machines and/or VMDK (virtual machine disk

format) files

Optimal granularity: Sub-file, variable-length segments– VMDK is one large file; any changes cause an incremental/full traditional backup– Fixed-length segment de-duplication fails due to frame offset– Sub-file, variable-length segment de-duplication finds changes anywhere in VMDK– Dramatically reduces the amount of data moved during daily backups– Significantly reduces daily backup time

Ideal for the protection of VMware environments– Enables fast, secure backups over existing virtual infrastructure– Permits greater server consolidation and maximum value from VMware

Avamar De-duplicates at the Optimal Location and Level of Granularity

Page 9: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

9EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar Products for VMware Infrastructure

Flexible, Fast, Efficient, and Reliable Backup and Recovery

AVAMAR SERVER BACKUP PRODUCTS

AVAMAR CLIENT BACKUP PRODUCTS

Guest VCB

Service Console

Avamar Software Avamar Virtual Edition

Avamar Data Store

Avamar VM

OS

Hardware

ESX Server

DiskNICMemoryCPU

Avamar VM

OS

App

OSx86 Architecture

VMware Virtualization Layer

DiskNICMemoryCPU

App

OS

App

OS

Hardware

VMware

DiskNICMemoryCPU

AppAppApp

OS OSOS

AvamarServer

ESXServer

AvamarAgents

PhysicalServer

Virtual Machines

App

OS

App

OS

App

OS

ESX Server

SANStorage

SNAPSHOT

SNAPSHOT

SNAPSHOT

VCB proxy serverwith Avamar agent

MOUNT

CentralizedData Mover

AvamarServer

Avamaragents

Page 10: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

10EMC CONFIDENTIAL—INTERNAL USE ONLY

Up to 95 percent reduction in data moved

Up to 90 percent reduction in backup times

Up to 50 percent reduction in disk impact

Up to 95 percent reduction in NIC usage

Up to 80 percent reduction in CPU usage

Up to 50 percent reduction in memory usage

All backups are stored as “virtual full backups,” ready for immediate restore

Maintains effective consolidation ratios without overtaxing CPU utilization

Avamar’s Optimized Backup for VMware Infrastructure

Avamar Efficiently Protects Virtual Machines

x86 Architecture

VMware Virtualization Layer

Traditional moves ~200% weekly

Avamar moves ~2% weekly

x86 Architecture

VMware Virtualization Layer

DiskNICMemoryCPU

Application

Operating System

Application

Operating System

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

AppOS

DiskNICMemoryCPU

Page 11: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

11EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar Virtual Edition for VMware

Avamar Server Software Deployed as a Virtual Appliance

Industry’s first de-duplication virtual appliance for backup, recovery, and disaster recovery

Leverages existing ESX servers and storage – Can utilize existing iSCSI, SAN or DAS disk storage

Replication (of applications and storage) eliminates shipping tapes

– Replicate between virtual Avamar servers and physical Avamar servers

Facilitates rapid, cost-effective deployment and return on investment

Supports VMotion for deployment flexibility

Up to two Avamar Virtual Edition virtual appliances per ESX server for scalability

Avamar VM

Operating System

Hardware

ESX Server

DiskNICMemoryCPU

Avamar VM

Operating System

Application

Operating System

Page 12: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

12EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar Products for VMware Infrastructure

VMware Data Center with Guest-Level Backup

Remote Offices without VMwareRemote Offices with VMware

VMware Data Center with VMware Consolidated Backup

Avamar agent moves data to Avamar Virtual Edition for VMware; data is then replicated to the corporate data center

Avamar agent moves data to a physical Avamar Single Node server; data is then replicated to the corporate data center, OR an Avamar agent can back up directly to the data center over the WAN

WAN

LAN/SAN SAN

VCB Proxy Server

(ENCRYPTED) (ENCRYPTED)

(ENCRYPTED)

Hardware

ESX Server

DiskNICMemoryCPU

Avamar VM

Operating System

Application

Operating System

x86 Architecture

VMware Virtualization Layer

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

DiskNICMemoryCPU

x86 Architecture

VMware Virtualization Layer

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

DiskNICMemoryCPU

x86 Architecture

VMware Virtualization Layer

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

DiskNICMemoryCPU

x86 Architecture

VMware Virtualization Layer

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

DiskNICMemoryCPU

x86 Architecture

VMware Virtualization Layer

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

DiskNICMemoryCPU

x86 Architecture

VMware Virtualization Layer

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

DiskNICMemoryCPU

Page 13: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

13EMC CONFIDENTIAL—INTERNAL USE ONLY

Avamar with Replication Manager

Page 14: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

14EMC CONFIDENTIAL—INTERNAL USE ONLY

Backing up VMware Infrastructure

Before Avamar Data center re-design focused on server consolidation

and virtualization

Concern about traditional, tape-based backup in VMware environment

Backup windows strained; physical resources overburdened

With Avamar Deployed agents within virtual machines

95 percent reduction in data moved

90 percent reduction in backup times

Major reductions in NIC, CPU, and memory usage

Centralized management and control

“Avamar provides a huge time and cost savings for backup of multiple virtual machines.”

With Avamar, we can centrally manage all of our backups, and we also gain the ability to rapidly restore data down to the file level.”

— Curtis Damhof, Network Manager, St. Peter’s

Health Care Services

St. Peter’s Hospital

Page 15: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

15EMC CONFIDENTIAL—INTERNAL USE ONLY

Backing Up VMware Infrastructure

Before Avamar Struggling to meet backup, recovery, and reliability goals across

extended enterprise

Lengthy backup windows caused by increasing data volumes threatening network performance

Expanding existing backup solution would require –-second master server, 2 additional tape silos, 16 new LTO tape drives

With Avamar Backup for VMware (24 ESX Servers, 332 virtual clients)

Avamar agents installed in VM Guests

Eliminated physical tape management

Reduced backup and recovery administrative burden

Backup performance increased tenfold

Backup network traffic reduced by 95 percent

Global Industrial Manufacturer

“Avamar was much less expensive than our other backup and recovery options. But it also provides us faster data restores, more backup capacity, and scalability to meet future data protection needs”

— Company Spokesman, Global Industrial

Manufacturer

Page 16: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

16EMC CONFIDENTIAL—INTERNAL USE ONLY

Backing Up VMware Infrastructure

Before Avamar Growing VMware environment struggles to meet backup

window

Daily tape backup and offsite tape shipments – risky, slow recovery

Unable to quickly replicate data via WAN for disaster recovery

With Avamar Global de-duplication effective within and across VMDK

files

Over 70% reduction in first backup and average of 99.7% thereafter

Compared to traditional alternatives, testing showed: – Avamar moved 1/5th of the data that Symantec PureDisk moved– Avamar moved 190% less data than traditional tape backup software

Fortune 20 Healthcare Supplier

Page 17: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

17EMC CONFIDENTIAL—INTERNAL USE ONLY

Remote Office/Branch Office Backup

Before Avamar Strain developing and deploying a coherent IT strategy

for over 250 sites, 100,000 employees– Lacked consistent IT infrastructure– Cumbersome tape backup solution was overextending staff and

overtaxing virtual machines

Escalating capital and operation costs

With Avamar Deployed from templates within a virtual application pack

Reduced backup time by 75% or more, slashed cycle time for offsite data replication

Minimized impact on network bandwidth

Reduced storage costs by eliminating tape backup and slashing storage requirements

A Global Pharmaceutical Company

“When we compared the total cost of ownership of EMC Avamar to that of traditional backup, we found that EMC Avamar costs less yet provides exponentially better data protection and service levels.”

— Head of Storage Services

Page 18: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

18EMC CONFIDENTIAL—INTERNAL USE ONLY

Global Telecom Manufacturer – Real World Test Results

Guest Backups Using EMC Avamar

Server TypePrimary Data

Protected (MB)

Backup Data Moved by

Avamar (MB)Backup

Time (min)

Avamar Data Reduction

Factor

Backup Data Commonality Identified by

Avamar

Web Server 16,679 33 4.2 505:1 99.8%

Application Server 1 5,658 36 3.1 157:1 99.4%

Application Server 2 4,352 25 6.5 174:1 99.4%

Code Control Server 7,786 27 7.5 288:1 99.7%

Application Server 3 59,936 30 8.3 1998:1 99.9%

Averages 625:1 99.6%

Note: In this example, backups performed over 10-day period and average results for each server shown below; Avamar performed daily fulls. Avamar agents installed on Windows and Linux OS. The VMware environment contained both ESX 2.5.X and 3.0.1.

Page 19: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

19EMC CONFIDENTIAL—INTERNAL USE ONLY

EMC Avamar – Real World VMware Test Results

Avamar Guest vs. Avamar VMDK Backup Results

Additional Takeaways:

• Average backup data commonality identified by EMC Avamar:• Avamar Guest backups = 99.6%

• Avamar VMDK backups = 97.9%

• Therefore, Guest backups moved just .004 while VMDK moved .021 (Guest backup was 5x more efficient in this example)

• Avamar Guest and VMDK backups are both extremely efficient!

Page 20: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication
Page 21: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication

21EMC CONFIDENTIAL—INTERNAL USE ONLY

Contact EMC at 1-866-362-1500 to learn more about EMC solutions or contact your Velocity Reseller today

Register for EMC World at http://www.emcworld.com/ – May 18-21, 2009– Orlando Florida

Register for VMWorld at http://www.vmworld.com/community/conferences/2009/ – August 31- September 3rd 2009– San Francisco CA

Visit the EMC Avamar solutions pages on http://www.emc.com

Take the Next Step—Additional Resources

Page 22: Game-Changing, Next-Generation Backup and Recovery with  Data De-duplication