46
Jeff Barr Rules for Backup and Disaster Recovery in the Cloud Chief Evangelist

AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Embed Size (px)

Citation preview

Page 1: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Jeff Barr

Rules for Backup and Disaster Recovery in the Cloud

Chief Evangelist

Page 2: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Agenda

• Prologue The need for Backup and DR

• Rules Backup and DR with AWS

• Customer Reference Ausenco and NZ Post

Page 3: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

The need for Backup and DR

Page 4: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Some “natural” examples….

after Brisbane Floods – January 13th 2011 Coronation Drive, Milton, QLD.…

Photos: http://www.abc.net.au/news/specials/qld-floods/

Page 5: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Some “natural” examples….

after Brisbane Floods – January 13th 2011 Coronation Drive, Milton, QLD.…

Photos: http://www.abc.net.au/news/specials/qld-floods/

Page 6: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Some “natural” examples….

after Brisbane Floods – January 13th 2011 Coronation Drive, Milton, QLD.…

Photos: http://www.abc.net.au/news/specials/qld-floods/

Page 7: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Some “natural” examples….

Christchurch Earthquake - Feb 22nd 2011 Manchester & Glouchester Street, Christchurch....

Photos: http://www.abc.net.au/news/specials/christchurch-quake/

Page 9: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

What about “human-made” examples….

“Everything fails, all the time” Werner Vogels, CTO, Amazon.com

Page 10: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Backup and DR with AWS

Drivers for Backup and DR with AWS

Page 11: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Business and Technical Drivers with AWS….

Reduce costs

Slash DR budgets by up to 50%

Consolidate sites

Eliminate the need to run a secondary site

Reduce on-premises

Eliminate 30%+ of on-premises physical equipment

Remove aging technologies

Eliminate tape for backup and

archive

Page 12: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

The fundamental economic model…

Utility, on-demand datacenter

Primary Site Routers

Firewalls

Network

Application Licenses

Operating Systems

Hypervisor

Servers

SAN

Primary Storage

Backup

Archive

AWS Routers

Firewalls

Network

Application Licenses

Operating Systems

Hypervisor

Servers

SAN

Snapshot Storage

Backup

Archive

Secondary site costs

Page 13: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

You can have different DR solutions

• Easy to integrate existing vendors with DR on AWS

• Approach: One vendor/hybrid/multiple vendors

• One region/multi-regions (if you need geo-diversity)

• Different DR Architectures

Backup & Restore Pilot light

Warm standby in AWS

Multi-site solution in AWS & on-

premises

Page 14: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Assets will sit on a spectrum of technical complexity…

DR & business continuity

Rebuild when required from offsite backup

Run hot-hot configuration with

auto-failover

Recovery Time Objective

(RTO) How quickly you need this asset to be recovered?

e.g. 1min? 15min? 1hr? 4hrs? 1day?

Recovery Point Objective

(RPO) How ‘fresh’ the recovery must be for the asset?

e.g. zero data loss, 15mins out of date?

Page 15: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Backup and DR with AWS

Backup and Storage Options

Page 16: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Simple Storage Service Highly scalable object storage

1 byte to 5TB in size

99.999999999% durability

Elastic Block Store High performance block storage device

1GB to 1TB in size

Mount as drives to instances with

snapshot/cloning functionalities

Glacier Long term object archive

Extremely low cost per gigabyte

99.999999999% durability

Storage Options

Very fast ‘instance’ disks

Slow, rare access Fast web object storage

Page 17: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Storage Gateway – Connect On-Prem with the AWS Cloud

1. Local, low-latency access to the most frequently used files while storing all data in Amazon S3 (Cached-Volumes) Or 2. Scheduled off-site backups to Amazon S3 for on-premises data (Stored-Volumes)

Page 18: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Cost ($/GB/month)

Performance Durability

Amazon S3 0.095

Amazon Glacier 0.01

AWS Storage Gateway 0.095

(+ 125/GW)

Amazon EBS 0.10

Amazon EBS (PIOPS) 0.125

*AWS Oregon pricing

Storage Options

Page 19: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Backup and DR with AWS

Backup and DR Rules

Page 20: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

1. My backup should be accessible

1. My backup should be able to scale

1. My backup should be safe

2. My backup should work with a DR policy

3. Someone should care about it

Backup Rules

Page 21: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

VPN

Public / AWS Direct Connect

AWS Import/Export

z

Backup Rules – My backup should be accessible

Page 22: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

GW-Cached volumes

GW-stored volumes

“Warm” storage

“Cold”

Backup Rules – My backup should be accessible

Page 23: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Access both via SDKs and via third-party software

S3 Glacier

Internet Web

Services API

HTTP(S)

Via SDK Via 3rd parties

Page 24: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

• “Infinite” scale with Amazon S3 and Amazon Glacier

• Scale to multiple regions

• Seamless

• No need to provision

• Cost tiers (cheaper at scale)

Backup Rules – My backup should be able to scale

Page 25: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

• SSL Endpoints (Amazon S3 and Amazon Glacier)

• Signed API calls

• Store encrypted files

• Server-side encryption

• Multiple copies across different data centers

• Local/cloud with AWS Storage Gateway

Backup Rules – My backup should be safe

Page 26: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Backup Rules – My backup should work with a DR policy

Page 27: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

• Clear ownership

• Permissions with IAM: Users, groups roles

• Logs

• AWS support

Backup Rules – Someone should care about it

Page 28: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Pilot light

Stopped instances

Page 29: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Pilot light

Running instances

Page 30: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Backup and DR with AWS

A “Backup/Restore” & “Pilot Light” reference…

Page 33: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Makhteshim Agan Industries on AWS

Page 34: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

About Us

34

• Makhteshim Agan is the world's leader in branded off-patent crop protection solutions. This is how we help solve one of the world's greatest challenges, a sustainable and secure food supply.

• Sales on 2013 – close to 3 Billion US $ to around 105 countries

• About 40 Subsidiaries around the glob

• Each subsidiary has its own IT infrastructure

• Centralized applications and data consolidation is done at MA headquarters.

Page 35: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Our Main Challenges (before AWS)

35

Large number of subsidiaries, each uses it’s own on premises infrastructure • Physical Security

• Stable power (UPS and generators)

• Air Conditioning

• Hardware maintenance

• Server redundancy

• Reliable access

• Backup and disaster recovery

• Setup takes long time

Page 36: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

The Conclusion

36

• Move to a public cloud other than on premises

• AWS was the natural choice decision

• Find a strong AWS partner to work with

• Emind Systems, an AWS Advanced Consulting Partner

• Cloud Architects

• DevOps & deployment team

• 24/7 Cloud Operation team

Page 37: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

The Solution

37

• Secured cloud environment

• Multiple VPC across multiple regions

• Secure access over VPN

• Windows & Linux servers

• Full backup to the cloud

• Quick recovery

• Seamless expansion

• Always available, always accessible

• Flexible cost model

• Backup to cloud is fast

Page 38: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

MA is whole more flexible now

38

• All new small subsidiaries are deployed on AWS

• Hand-in-hand with Emind’s team

• Constantly adding more services and application to the cloud

• Just in time deployment of AD-HOC global projects and services

Page 39: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

• ASX200 company

• Head office in Brisbane

• 29 Offices in 19 countries

• 3500 Employees

Ausenco Offices

Page 40: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

The Result

• Low effort

• Incremental rollout

• Cloud migration

• Efficient, effective usage of bandwidth

• Application/database servers

• Regionalised deployment

Page 41: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Backup and DR with AWS

The new HA/DR continuum…

Page 42: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

The new HA/DR continuum…

DR with High Availability

Page 43: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

App DR with Standby

The new HA/DR continuum…

Page 44: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Reducing Costs

• AWS cost reduction (e.g, S3 cost reduction on Apr 2nd 2013)

• Reduced redundancy (Amazon S3)

• Retention policy

• Hot/warm/cool/cold backup

• Reserved capacity/tiers

0–1 TB 0.095 0.076

1–50 TB 0.080 0.064

50–500 TB 0.070 0.056

500–1,000 TB 0.065 0.052

1–5 PB 0.060 0.048

5+ PB 0.055 0.037

Amazon S3 Standard

$/GB/Month

Reduced $/GB/Month

Page 46: AWS Summit Tel Aviv - Enterprise Track - Backup and Disaster Recovery

Thank You!

@jeffbarr