35
PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage Mark O’Connell Distinguished Engineer EMC

Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

Embed Size (px)

Citation preview

Page 1: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

PRESENTATION TITLE GOES HERE

Next Generation Data Centers: Hyperconverged Architectures Impact On Storage

Mark O’Connell Distinguished Engineer

EMC

Page 2: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

2 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Abstract

A modern data center typically contains a number of specialized storage systems which provide centralized storage for a large collection of data center applications. These specialized systems were designed and implemented as a solution to the problems of scalable storage, 24x7 data access, centralized data protection, centralized disaster protection strategies, and more. While these issues remain in the data center environment, new applications, new workload profiles, and the changing economics of computing have introduced new demands on the storage system which drive towards new architectures, and ultimately towards a hyperconverged architecture. After reviewing what a hyperconverged architecture is and the building blocks in use in such architectures, there will be some predictions for the future of such architectures.

Page 3: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

3 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Learning Objectives What is a hyperconverged architecture How hyperconverged architectures differ from traditional architectures What technologies are being used to build hyperconverged architectures What workloads are appropriate for hyperconverged architectures

Page 4: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

4 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Definition

Hyper-convergence (hyperconvergence) is a type of infrastructure system with a software-centric architecture that tightly integrates compute, storage, networking and virtualization resources and other technologies from scratch in a commodity hardware box supported by a single vendor

http://searchvirtualstorage.techtarget.com/definition/hyper-convergence

Page 5: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

5 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Converged vs Hyperconverged

Converged infrastructures Multi-protocol NAS boxes Combined block/file with iSCSI

Hyperconverged SW defined Client and server run together

Page 6: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

6 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Why Hyperconverged

If it’s so good, why haven’t we been

using it all along?

Page 7: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

7 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Classical architecture

Source: http://www.snia.org/education/storage_networking_primer/san/what_san

Page 8: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

8 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Classical architecture

Source: http://www.snia.org/education/storage_networking_primer/san/what_san

Page 9: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

9 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Classical architecture

Speed limited Scaling SPs expensive Inefficient at small scale DR makes overall utilization worse

Page 10: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

10 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out storage architecture

Commodity nodes, commodity drives Failure impact? Need to go faster?

Page 11: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

11 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

2002 2008 2014 2011 2007

Page 12: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

12 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out systems: Internal architecture

12

Acc Stor A S A S A S A S A S ETH/IB

Page 13: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

13 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out systems: Expansion

13

Acc Stor A S A S A S A S A S

A S A S A S A S A S A S

ETH/IB

Page 14: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

14 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out systems: 2nd expansion

14

A S A S A S A S A S A S

Acc Stor A S A S A S A S A S

A S A S A S A S A S A S

ETH/IB

Page 15: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

15 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

There’s more than just storage

Source: http://www.snia.org/education/storage_networking_primer/san/what_san

Page 16: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

16 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Evolution of the application platform

16

Page 17: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

17 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Evolution of the application platform

17

Page 18: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

18 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app app app app app app app

Virtualized application farm

18

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

VM VM VM VM VM VM VM VM VM VM VM VM

Page 19: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

19 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app

Virtualized application farm

19

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

VM VM VM VM VM VM

Storage

Page 20: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

20 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app

Application farms with Scale-out storage

20

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

VM VM VM VM VM VM A S A S A S

A S A S A S

A S A S A S

Application farm Scale-out storage

Page 21: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

21 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app

Why two server farms? Hyperconverge!

21

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

VM VM VM VM VM VM A S A S A S

A S A S A S

A S A S A S

Application farm Scale-out storage

Page 22: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

22 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Early Hyperconverged system

22

ETH/IB

Task HDFS Task HDFS Task HDFS

Task HDFS Task HDFS Task HDFS

Task HDFS Task HDFS Task HDFS

Scale-out storage

JVM JVM JVM

JVM JVM JVM

JVM JVM JVM

Page 23: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

23 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems: Elasticity

Elasticity in scaling overall environment

4U 60 DISKS

2U 4 NODES

MIXED BLOCK

2U 4 NODES

2U 4 NODES

4U 60 DISKS

4U 60 DISKS

4U 60 DISKS

4U 60 DISKS

2U 4 NODES

DENSE BLOCK

APP BLOCKS

HIGHER IOP

LOWER IOP

Page 24: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

24 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems App management

ETH/IB

A S A S A S

A S A S A S

A S A S A S

Page 25: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

25 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems: Storage provisioning

Application frameworks will provision for apps Drive adoption of standard provisioning mechanisms Pure service architecture for storage

Page 26: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

26 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems: Hybrid cloud enablement

Apps are now a self-describing bundle Storage is a dynamically bound service Enable movement on-prem/off-prem

Page 27: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

27 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Summary

Hyperconvergence is the result of ongoing industry trends Hyperconvergence will drive

Application management frameworks Standardized provisioning Hybrid cloud

27

Page 28: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

28 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Questions?

Page 29: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

29 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Backup slides

Page 30: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

30 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

What’s coming?

Scale and multi-sized building blocks Elasticity of building systems

App management Containers Kubernetes etc More complex app farms

OpenStack, containers, provisioning – standard provisioning Service architecture across B, F, O Hybrid cloud bridge? 30

Page 31: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

31 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved. 31

A Stor A S A S A S A S A S

Acc S A S A S A S A S A S ETH/IB

Page 32: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

32 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved. 32

app

A Stor

app

A S

app

A S

app

A S

app

A S

app

A S

app

Acc S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

ETH/IB

Page 33: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

33 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

2002 2008 2014 2011 2007

Page 34: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

34 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

2002 2008 2014 2011 2007

Page 35: Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next Generation Data Centers: Hyperconverged Architectures Impact On Storage . Mark

35 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems