RED HAT STORAGEPORTFOLIO OVERVIEW

Andrew HatfieldPractice Lead – Cloud Storage and Big DataMILCIS – November 2015

THE RED HAT STORAGE MISSION

To offer a unified, open software-defined storage portfolio that delivers a range of data

services for next generation workloads thereby accelerating the transition to modern IT

infrastructures.

Traditional StorageComplex proprietary silos

Open, Software-Defined StorageStandardized, unified, open platforms

Custom GUI

Proprietary Software

ProprietaryHardware

StandardComputersand DisksSt

anda

rdH

ardw

are

Ope

n So

urce

Soft

war

e

Ceph Gluster +++

Control Plane (API, GUI)

ADMIN USER

THE FUTURE OF STORAGE

ADMIN

USER

ADMIN

USER

ADMIN

USER

Custom GUI

Proprietary Software

ProprietaryHardware

Custom GUI

Proprietary Software

ProprietaryHardware

WHY BOTHER?

PROPRIETARYHARDWARE

HARDWARE-BASED INTELLIGENCE

SCALE-UPARCHITECTURE

CLOSED DEVELOPMENT PROCESS

Common, off-the-shelf hardwareLower cost, standardized supply chain

Scale-out architectureIncreased operational flexibility

Software-based intelligenceMore programmability, agility, and control

Open development processMore flexible, well-integrated technology

Open Software-Defined Storage is a fundamental reimagining of how storage infrastructure works.

It provides substantial economic and operational advantages, and it has quickly become ideally suited for a growing number of use cases.

TODAY EMERGING FUTURE

CloudInfrastructure

CloudNative Apps

Analytics

Hyper-Convergence

Containers

???

???

THE JOURNEY

THE RED HAT STORAGEPORTFOLIO

THE RED HAT STORAGE PORTFOLIO

Cephmanagement

OP

EN S

OU

RC

ESO

FTW

AR

E

Glustermanagement

Cephdata services

Glusterdata services

STA

ND

AR

DH

AR

DW

AR

E

Share-nothing, scale-out architecture provides durability and adapts to changing demands

Self-managing and self-healing features reduce operational overhead

Standards-based interfaces and full APIs ease integration with applications and systems

Supported by theexperts at Red Hat

Powerful distributed storage for the cloud and beyond

● VM Storage with OpenStack Cinder, Glance & Nova

● Object storage for tenant apps

Built from the ground up as a next-generation storage system, based on years of research and suitable for powering infrastructure platforms

TARGET USE CASES

Rich Media and Archival● S3-compatible object storage

Highly tunable, extensible, and configurable, with policy-based control and no single point of failure

Offers mature interfaces for block and object storage for the enterprise

OVERVIEW:RED HAT CEPH STORAGE

Cloud Infrastructure

Customer Highlight: CiscoCisco uses Red Hat Ceph Storage to deliver storage for next-generation cloud services

Nimble file storage for petabyte-scale workloads

● Machine analytics with Splunk● Big data analytics with Hadoop

TARGET USE CASES

Enterprise File Sharing● Media Streaming● Active Archives

Analytics

Enterprise Virtualization

OVERVIEW:RED HAT GLUSTER STORAGE

Purpose-built as a scale-out file store with a straightforward architecture suitable for public, private, and hybrid cloud

Simple to install and configure, with a minimal hardware footprint

Offers mature NFS, SMB and HDFS interfaces for enterprise use

Customer Highlight: IntuitIntuit uses Red Hat Gluster Storage to provide flexible, cost-effective storage for their industry-leading financial offerings. Rich Media & Archival

GROWING INNOVATION COMMUNITIES

● Over 11M downloads in the last 12 months

● Increased development velocity, authorship, and discussion has resulted in rapid feature expansion.

● Contributions from Intel, SanDisk, SUSE,and DTAG.

● Presenting Ceph Days in cities around the world and quarterly virtual Ceph Developer Summit events.

78 AUTHORS/mo

1500 COMMITS/mo

258 POSTERS/mo

41 AUTHORS/mo

259 COMMITS/mo

166 POSTERS/mo

SanDisk sells the InfiniFlash storage arrays, designed for use with Red Hat Ceph Storage. Optimizations contributed by SanDisk deliver high performance which allow Ceph customers to service new workloads.

Our relationship includes:

● Engineering and product collaboration

● Community thought leadership

PARTNER SOLUTIONS

All-flash arrays, optimized for Ceph

Supermicro's Red Hat Ceph Storage optimized solutions offer durable, software-defined, scale-out storage platforms in 1U/2U/4U form factors and are designed to maximize performance, density, and capacity

Customer can expect to see:

● Reference architectures, validated for

performance, density, and capacity

● Whitepapers and datasheets that support

Red Hat Storage solutions

Systems designed with storage in mind

Through silicon innovation and software optimization, Intel pushes the envelope on open, software-defined storage. A key contributor, Intel recently donated significant hardware to the Ceph project.

Intel development efforts have included:

● SSD and performance optimizations

● CephFS development

Accelerating software-defined storage

RED HAT STORAGETARGET WORKLOADS

DBaaS

VMWare

Hyper-convergence

OpenStack

Enterprisefile sharing

Analytics

Sync andshare

Objectstorage

CAPACITY PERFORMANCE

NEX

T-G

ENTR

AD

ITIO

NA

L

DIFFERENT KINDS OF STORAGE

ANALYTICSBig Data analytics with Hadoop

CLOUD INFRASTRUCTURE

RICH MEDIAAND ARCHIVAL

SYNC ANDSHARE

ENTERPRISEVIRTUALIZATION

Machine data analytics with Splunk

Virtual machine storage with OpenStack

Object storage for tenant applications

Cost-effective storage for rich media streaming

Active archives

File sync and share with ownCloud

Storage for conventional virtualization with RHEV

FOCUSED SET OF USE CASES

In-place Hadoop analytics in a POSIX compatible environment

HADOOP MAP REDUCE FRAMEWORK

● Allows the Hortonworks Data Platform 2.1 to be deployed on Red Hat Gluster Storage

● Hadoop tools can operate on data in-place● Access to the Hadoop ecosystem of tools● Access to non-Hadoop analytics tools● Consistent operating model: Hadoop can run directly

on Red Hat Gluster Storage nodes

● Flexible, unified enterprise big data repository● Better analytics (Hadoop and non-Hadoop)● Familiar POSIX-compatible file system and tools● Start small, scale as big data needs grow● Multi-volume support (HDFS is single-volume)● Unified management (Hortonworks HDP Ambari

and Red Hat Gluster Storage)

FEATURES

BIG DATA ANALYTICS

Hadoop DistributedFile System

Red Hat GlusterStorage Cluster

BENEFITS

High-performance, scale-out, online cold storage for Splunk Enterprise

Hot/warm data optimized for performance

10s of TB on Splunk server DAS

Cold optimized for cost, capacity and elasticity

Red Hat Storage Server on commodity x86 servers

● Multiple ingest options using NFS & FUSE● Expand storage pools without incurring downtime● Support for both clustered and non-clustered

configurations

● Run high speed indexing and search onSplunk’s cold data store

● Pay as you grow economics for Splunk cold data● Reduce ingestion time for data with

standard protocols● “Always online”, fast, disk-based storage pools

provide constant access to historical data

MACHINE DATA ANALYTICS

FEATURES BENEFITS

The most widely deployed 1 technology for OpenStack storage

● Full integration with Nova, Cinder and Glance● Single storage for images and ephemeral and

persistent volumes● Copy-on-write provisioning● Swift-compatible object storage gateway● Full integration with Red Hat Enterprise Linux

OpenStack Platform

● Provides both volume storage andobject storage for tenant applications

● Reduces provisioning time for new virtual machines● No data transfer of images between storage and

compute nodes required● Unified installation experience with Red Hat

Enterprise Linux OpenStack Platform

VIRTUAL MACHINE STORAGE

CEPH BLOCK DEVICE(RBD)

Keystone API Swift API Cinder APIGlance

APINovaAPI

CEPH OBJECT GATEWAY(RGW)

CEPH STORAGE CLUSTER(RADOS)

Hypervisor

OPENSTACK

1 http://superuser.openstack.org/articles/openstack-users-share-how-their-deployments-stack-up

FEATURES BENEFITS

Unstructured data storage for distributed, cloud-native applications

● Compatibility with S3 and Swift APIs● Fully-configurable replicated or erasure coded

storage backends● Cache tiering pools● Multi-site failover

● Supports broad ecosystem of tools and applications built for the S3 API

● Provides a modern hot/warm/cold storage topology that offers cost-efficient performance

● Advanced durability at optimal price

CEPH OBJECT GATEWAY(RGW)

APP APP APP APP

CEPH OBJECT GATEWAY(RGW)

RED HAT CEPH STORAGE CLUSTER

S3 API

OPENSTACK

S3 APIS3 APIS3 API

FEATURES BENEFITS

STORAGE FOR TENANT APPLICATIONS

Massively-scalable, flexible, and cost-effective storage for image, video, and audio content

Unstructured image, video,and audio content

● Support for multi-petabyte storage clusters on commodity hardware

● Erasure coding and replication for capacity-optimized or performance-optimized pools

● Support for standard file & object protocols● Snapshots and replication capabilities for high

availability and disaster recovery

● Provides massive and linear scalability in on-premise or cloud environments

● Offers robust data protection with an optimal blend of price & performance

● Standard protocols allow access to broadcast content anywhere, on any device

● Cost-effective, high performance storage for on-demand rich media content

RICH MEDIA

Red Hat GlusterStorage Cluster

Red Hat CephStorage Cluster

FEATURES BENEFITS

Open source, capacity-optimized archival storage on commodity hardware

Unstructuredfile data

● Cache tiering to enable "temperature"-based storage

● Erasure coding to support archive and cold storage use cases

● Support for industry-standard file and object access protocols

● Store data based on its access frequency● Store data on premise or in a public or hybrid cloud● Achieve durability while reducing raw capacity

requirements and limiting cost● Deploy on industry-standard hardware

ACTIVE ARCHIVES

Red Hat GlusterStorage Cluster

Red Hat CephStorage Cluster

Unstructuredobject data

Volumebackups

FEATURES BENEFITS

Powerful, software-defined, scale-out, on-premise storage for file sync and share with ownCloud

Webbrowser

● Secure file sync and share with enterprise-grade auditing and accounting

● Combined solution of Red Hat Gluster Storage, ownCloud, HP ProLiant SL4550 Gen 8 servers

● Deployed on-premise, managed by internal IT● Access sync and share data from mobile devices,

desktop systems, web browsers

● Secure collaboration with consumer-grade ease of use

● Lower risk by storing data on-premise● Conform to corporate data security and

compliance polices ● Lower total cost of ownership with standard,

high-density servers and open source

FILE SYNC AND SHARE

OWNCLOUD ENTERPRISE EDITION

Mobileapplication

DesktopOS

RED HAT GLUSTER STORAGE

FEATURES BENEFITS

The Journey to Software-Defined Storage INTERNAL ONLY22

Scalable, reliable storage forRed Hat Enterprise Virtualization

● Reliably store virtual machine images in a distributed Red Hat Gluster Storage volume

● Manage storage through the RHEV-M console● Deploy on standard hardware of choice● Seamlessly grow and shrink storage

infrastructure when demand changes

● Reduce operational complexities by eliminating dependency on complex and expensive SAN infrastructures

● Deploy efficiently on less expensive, easier to provision, standard hardware

● Achieve centralized visibility and control of server and storage infrastructure

ENTERPRISE VIRTUALIZATION

FEATURES BENEFITS

RED HAT STORAGEFUTURE WORKLOADS

USE CASES:TODAY AND FUTURE

CURRENT USE CASES TARGET USE CASES

ANALYTICS

Big Data analytics● Storage plug-in for

Hortonworks Data Platform

Big Data analytics● Persistent back-end for

Spark

Machine data analytics● Online cold storage for

IT operations data with Splunk

Machine data analytics● Storage for ELK, Solr

CURRENT USE CASES TARGET USE CASES

OPENSTACK

Virtual machine storage● Volume, ephemeral, and

image storage with Cinder, Nova, and Glance

Database storage● Storage for databases

with Trove

Object storage for tenant applications● Swift-compatible storage

for cloud applications

Storage back-end for Manila● Shared file system-as-a-

service for tenants

USE CASES:TODAY AND FUTURE

CURRENT USE CASES TARGET USE CASES

RICH MEDIA AND ARCHIVAL

Rich media streaming● Cost-effective storage for

rich media streaming

Active archives● Cost-effective online storage

for active archives

Compliant archives● Scalable, cost-effective

storage for compliance and regulatory needs

USE CASES:TODAY AND FUTURE

CURRENT USE CASES TARGET USE CASES

ENTERPRISE SYNC AND SHARE

Enterprise sync and share● Storage for Dropbox-style

shared folders (file backend)

Enterprise sync and share● Storage for shared folders

(object backend)

USE CASES:TODAY AND FUTURE

CURRENT USE CASES TARGET USE CASES

ENTERPRISE VIRTUALIZATION

Conventional virtualization storage● Integrated storage for Red Hat

Enterprise Virtualization(with separate compute and storage clusters)

Hyper-converged architectures● Hyper-converged

architectures

USE CASES:TODAY AND FUTURE