14
1 © Copyright 2016 EMC Corporation. All rights reserved. SCALEIO IN AN OPENSTACK ENVIRONMENT JASON STURGEON & RANDY BIAS

Using ScaleIO in an OpenStack Environment

Embed Size (px)

Citation preview

Page 1: Using ScaleIO in an OpenStack Environment

1© Copyright 2016 EMC Corporation. All rights reserved.

SCALEIO INAN OPENSTACK ENVIRONMENTJASON STURGEON & RANDY BIAS

Page 2: Using ScaleIO in an OpenStack Environment

2© Copyright 2016 EMC Corporation. All rights reserved.

• Role: ScaleIO Product Manager• Mission: Drive ScaleIO integration with OpenStack &

Partners • 20 years in tech• Big tech geek and love helping people build clouds• Contact info

– Twitter: @osaddict – Email: [email protected]

JASON STURGEON

Page 3: Using ScaleIO in an OpenStack Environment

3© Copyright 2016 EMC Corporation. All rights reserved.

WHAT IS EMC SCALEIO?

ScaleIO agent(minimal footprint)

• Installs on industry-standard x86 servers that run databases, hypervisors, or any other applications

• Aggregates application servers’ local disks• Add storage and/or compute on the fly

Software that uses application servers to create an elastic, scalable, and resilient Server SAN at a fraction of the cost and complexity of traditional SANs

Page 4: Using ScaleIO in an OpenStack Environment

4EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY

MIX AND MATCH OS, HYPERVISORS, PLATFORMS, AND MEDIA IN THE SAME SCALEIO SYSTEM!

INFRASTRUCTURE AGNOSTIC

HYPERVISORSOPERATINGSYSTEM

CLOUD MEDIA

SSDs

HDDs

PCIe Flash

Page 5: Using ScaleIO in an OpenStack Environment

5© Copyright 2016 EMC Corporation. All rights reserved.

SCALEIO LOGICAL ARCHITECTUREApplication(s)

SDC: ScaleIO Data Client

SDS: ScaleIO Data Server

MDM: Metadata Manager

C

S

PRESENTATION LAYERScaleIO Data Client (SDC)

DATA SERVERScaleIO Data Server (SDS)

ScaleIO Metadata Manager (MDM)

Page 6: Using ScaleIO in an OpenStack Environment

6© Copyright 2016 EMC Corporation. All rights reserved.

• ScaleIO integrated with OpenStack since Havana• Upstreamed since Liberty• Plugins for Mirantis Fuel,

Charms for Canonical, & Ansible / Puppet scripts

SCALEIO & OPENSTACK

Page 7: Using ScaleIO in an OpenStack Environment

7© Copyright 2016 EMC Corporation. All rights reserved.

• Cinder driver interfaces between ScaleIO and OpenStack– Presents volumes to OpenStack as block

devices available for storage• Nova driver handles compute and

instance volume-related operations• ScaleIO driver executes volume

operations by communicating with the backend ScaleIO components through the ScaleIO REST Gateway

SCALEIO – BLOCK SERVICES

SDC

SDS

MDM

Applications(NOVA)

Cinder Volume

GATEWAY

Driver

Rest API

Commodity Platform

Page 8: Using ScaleIO in an OpenStack Environment

8© Copyright 2016 EMC Corporation. All rights reserved.

• Full support of QoS– QoS support previously, but using Extra Specs

• Support for Consistency Groups• Option to bring existing ScaleIO volumes

under OpenStack management– As well as remove from OpenStack managment

OPENSTACK MITAKAEMC SCALEIO NEW FEATURES

Page 9: Using ScaleIO in an OpenStack Environment

9© Copyright 2016 EMC Corporation. All rights reserved.

• 1 Oracle VM– 64G RAM & 16 vCPUs

• 1 Load Generation Client VM– Running Swingbench tool

• Demo flow– FIO load -> Live Migrate– 20 User DB load -> Live Migrate– 200 User DB load -> Live Migrate

ORACLE RUNNING IN OPENSTACK W/SCALEIO

Page 10: Using ScaleIO in an OpenStack Environment

10© Copyright 2016 EMC Corporation. All rights reserved.

• Storage Side– 7 Cisco C240 M4SX hosts

• CPU: 2xE5-2680 v3 @ 2.5GHz• RAM: 128G or 256G depending on

node– Storage

• 3 Toshiba 400GB SSDs each• Mix of either 6 or 10 900GB

HDDS– Not used in Demo, but available as

slower tier

WHAT’S THE HARDWARE UNDER THE HOOD?• Compute Side

– Same 7 Cisco C240 M4SX hosts• AKA Hyper-Converged

– 1 Server that is only a client• AKA 2-layer

Page 11: Using ScaleIO in an OpenStack Environment

11© Copyright 2016 EMC Corporation. All rights reserved.

• Database– Oracle Version 12.1.0.2.0

• OpenStack Version– Liberty 12.0.1

• Operating System– CentOS Linux 7.2.1511– Kernel 3.10.0-327.13.1.el7.x86_64

• Storage Software– ScaleIO 2.0.0.0

WHAT’S THE SOFTWARE UNDER THE HOOD?

Page 12: Using ScaleIO in an OpenStack Environment

12© Copyright 2016 EMC Corporation. All rights reserved.

app app app app app

10G Ethernet

C S S

app

S C CC S S C C S

CONNECTIONS AND ROLES

MM Mapp

C S

app

C

c1 c3c2 c8c7c6c5c4

3

CISCO NEXUS N5548P 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32

STAT

ID

Cisco Nexus 5548Each node connects with• 2 Intel 10GbE NICs

Page 13: Using ScaleIO in an OpenStack Environment

13© Copyright 2016 EMC Corporation. All rights reserved.

DEMO

Page 14: Using ScaleIO in an OpenStack Environment

14© Copyright 2016 EMC Corporation. All rights reserved.

Don’t wait• OpenStack deployments can take time

– Get comfortable with the scale-out storage now• ScaleIO is useful in building any cloud• One click download with no limits: Search ”Download ScaleIO”• Try out our plugins and give use feedback: Chad’s Blog• Check out recent reviews on storagereview.com• Other Sessions:

– “Swisscom in Production with OpenStack and Cloud Foundry” – 4:40pm– “Optimizing SDS for OpenStack” feat. EMC & Mirantis – Thursday 11:00am– Check out the ScaleIO / Ceph live bakeoff session from Tokyo Summit

• OpenStack session on Ceph vs ScaleIO• Shorter video: http://www.emc.com/scaleiocephbattle