Next Generation Data Centers: Hyperconverged Architectures ... · PRESENTATION TITLE GOES HERE Next...

Preview:

Citation preview

PRESENTATION TITLE GOES HERE

Next Generation Data Centers: Hyperconverged Architectures Impact On Storage

Mark O’Connell Distinguished Engineer

EMC

2 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Abstract

A modern data center typically contains a number of specialized storage systems which provide centralized storage for a large collection of data center applications. These specialized systems were designed and implemented as a solution to the problems of scalable storage, 24x7 data access, centralized data protection, centralized disaster protection strategies, and more. While these issues remain in the data center environment, new applications, new workload profiles, and the changing economics of computing have introduced new demands on the storage system which drive towards new architectures, and ultimately towards a hyperconverged architecture. After reviewing what a hyperconverged architecture is and the building blocks in use in such architectures, there will be some predictions for the future of such architectures.

3 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Learning Objectives What is a hyperconverged architecture How hyperconverged architectures differ from traditional architectures What technologies are being used to build hyperconverged architectures What workloads are appropriate for hyperconverged architectures

4 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Definition

Hyper-convergence (hyperconvergence) is a type of infrastructure system with a software-centric architecture that tightly integrates compute, storage, networking and virtualization resources and other technologies from scratch in a commodity hardware box supported by a single vendor

http://searchvirtualstorage.techtarget.com/definition/hyper-convergence

5 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Converged vs Hyperconverged

Converged infrastructures Multi-protocol NAS boxes Combined block/file with iSCSI

Hyperconverged SW defined Client and server run together

6 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Why Hyperconverged

If it’s so good, why haven’t we been

using it all along?

7 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Classical architecture

Source: http://www.snia.org/education/storage_networking_primer/san/what_san

8 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Classical architecture

Source: http://www.snia.org/education/storage_networking_primer/san/what_san

9 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Classical architecture

Speed limited Scaling SPs expensive Inefficient at small scale DR makes overall utilization worse

10 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out storage architecture

Commodity nodes, commodity drives Failure impact? Need to go faster?

11 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

2002 2008 2014 2011 2007

12 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out systems: Internal architecture

12

Acc Stor A S A S A S A S A S ETH/IB

13 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out systems: Expansion

13

Acc Stor A S A S A S A S A S

A S A S A S A S A S A S

ETH/IB

14 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Scale-out systems: 2nd expansion

14

A S A S A S A S A S A S

Acc Stor A S A S A S A S A S

A S A S A S A S A S A S

ETH/IB

15 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

There’s more than just storage

Source: http://www.snia.org/education/storage_networking_primer/san/what_san

16 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Evolution of the application platform

16

17 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Evolution of the application platform

17

18 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app app app app app app app

Virtualized application farm

18

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

VM VM VM VM VM VM VM VM VM VM VM VM

19 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app

Virtualized application farm

19

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

VM VM VM VM VM VM

Storage

20 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app

Application farms with Scale-out storage

20

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

VM VM VM VM VM VM A S A S A S

A S A S A S

A S A S A S

Application farm Scale-out storage

21 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

app

VM

app

VM

app

VM

app

VM

app

VM

app

VM

app app app app app app

Why two server farms? Hyperconverge!

21

app

VM

app

VM

app

VM

ETH/IB

app

VM

app

VM

app

VM

VM VM VM VM VM VM A S A S A S

A S A S A S

A S A S A S

Application farm Scale-out storage

22 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Early Hyperconverged system

22

ETH/IB

Task HDFS Task HDFS Task HDFS

Task HDFS Task HDFS Task HDFS

Task HDFS Task HDFS Task HDFS

Scale-out storage

JVM JVM JVM

JVM JVM JVM

JVM JVM JVM

23 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems: Elasticity

Elasticity in scaling overall environment

4U 60 DISKS

2U 4 NODES

MIXED BLOCK

2U 4 NODES

2U 4 NODES

4U 60 DISKS

4U 60 DISKS

4U 60 DISKS

4U 60 DISKS

2U 4 NODES

DENSE BLOCK

APP BLOCKS

HIGHER IOP

LOWER IOP

24 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems App management

ETH/IB

A S A S A S

A S A S A S

A S A S A S

25 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems: Storage provisioning

Application frameworks will provision for apps Drive adoption of standard provisioning mechanisms Pure service architecture for storage

26 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Effects of Hyperconverged systems: Hybrid cloud enablement

Apps are now a self-describing bundle Storage is a dynamically bound service Enable movement on-prem/off-prem

27 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Summary

Hyperconvergence is the result of ongoing industry trends Hyperconvergence will drive

Application management frameworks Standardized provisioning Hybrid cloud

27

28 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Questions?

29 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Backup slides

30 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

What’s coming?

Scale and multi-sized building blocks Elasticity of building systems

App management Containers Kubernetes etc More complex app farms

OpenStack, containers, provisioning – standard provisioning Service architecture across B, F, O Hybrid cloud bridge? 30

31 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved. 31

A Stor A S A S A S A S A S

Acc S A S A S A S A S A S ETH/IB

32 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved. 32

app

A Stor

app

A S

app

A S

app

A S

app

A S

app

A S

app

Acc S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

app

A S

ETH/IB

33 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

2002 2008 2014 2011 2007

34 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

2002 2008 2014 2011 2007

35 2015 Data Storage Innovation Conference. © EMC. All Rights Reserved.

Enterprise scale-out systems

Recommended