16
RED HAT CEPH STORAGE OVERVIEW Cesar Pinto Account Manager [email protected]

RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

Embed Size (px)

Citation preview

Page 1: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

RED HAT CEPH STORAGEOVERVIEW

Cesar PintoAccount [email protected]

Page 2: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

PROPRIETARYHARDWARE

WHY OPEN SOFTWARE-DEFINED STORAGE?

SCALE-UPARCHITECTURE

HARDWARE-BASED INTELLIGENCE

CLOSED DEVELOPMENT PROCESS

Common, off-the-shelf hardwareLower cost, standardized supply chain

Scale-out architectureIncreased operational flexibility

Software-based intelligenceMore programmability, agility, and control

Open development processMore flexible, well-integrated technology

Page 3: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

THE FUTURE OF STORAGETraditional StorageComplex proprietary silos

Open Software Defined StorageStandardized, unified, open platforms

USER

ADMIN

USER

ADMIN

Custom GUI

Proprietary Software

Custom GUI

Proprietary Software

ProprietaryHardware

ProprietaryHardware

StandardComputersand DisksC

omm

odit

yH

ardw

are

Ope

n So

urce

Soft

war

e

Ceph Gluster +++

Control Plane (API, GUI)

ADMIN USER

Page 4: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

THE JOURNEY

Open Software-Defined Storage is a fundamental reimagining of how storage infrastructure works.

It provides substantial economic and operational advantages, and it has quickly become ideally suited for a growing number of use cases.

TODAY EMERGING FUTURE

CloudInfrastructure

CloudNative Apps

Analytics

Hyper-Convergence

Containers

???

???

Page 5: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

To offer a unified, open software-defined storage portfolio that delivers a range of data services for next generation workloads thereby accelerating the transition to modern

IT infrastructures.

THE RED HAT STORAGE MISSION

Page 6: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

TODAY’S PORTFOLIO:OPTIMIZED POINT SOLUTIONS

Cephmanagement

OP

EN S

OU

RC

ESO

FTW

AR

E

Glustermanagement

Cephdata services

Glusterdata services

PR

OP

RIE

TAR

YSO

FTW

AR

E

Share-nothing, scale-out architecture provides durability and adapts to changing demands

Self-managing and self-healing features reduce operational overhead

Standards-based interfaces and full APIs ease integration with applications and systems

Supported by the expertsat Red Hat

Page 7: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

DIFFERENT KINDS OF STORAGE

DBaaS

VMWare

Hyper-convergence

OpenStack

Enterprisefile sharing

Analytics

Sync andshare

Objectstorage

CAPACITY PERFORMANCE

NEX

T-G

ENTR

AD

ITIO

NA

L

Page 8: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

RED HAT STORAGETARGET WORKLOADS

ANALYTICSBig Data analytics with Hadoop

CLOUDINFRASTRUCTURE

RICH MEDIA ANDARCHIVAL

ENTERPRISESYNC AND SHARE

ENTERPRISEVIRTUALIZATION

Machine data analytics with Splunk

Virtual machine storage with OpenStack

Object storage for tenant applications

Cost-effective storage for rich media streaming

Storage for active archives

File sync and share with ownCloud

Storage for conventional virtualization with Red Hat Enterprise Virtualization

Page 9: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

RED HAT CEPH STORAGE

Page 10: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

OVERVIEW:RED HAT CEPH STORAGE

Powerful distributed storage for the cloud and beyond

OpenStack

Built from the ground up as a next-generation storage system, based on years of research and suitable for powering infrastructure platforms

TARGET USE CASES

● Cinder, Glance & Nova● Object storage for tenant apps

Object Storage for Applications● S3-compatible API

Highly tunable, extensible, and configurable

Offers mature interfaces for block and object storage for the enterprise

Customer Highlight: CiscoCisco uses Red Hat Ceph Storage to deliver storage for next-generation cloud services

Page 11: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

TRADITIONAL STORAGEIS INFLEXIBLE

Using traditional, proprietary storage appliances:● Capacity is purchased one large appliance at a time

» Requires large investment, disruptive “forklift” upgrades

● Hardware is specialized and expensive» Cost and capacity do not scale evenly

Traditional storage appliances are not likelyto be deployed and managed by cloud builders

STORAGE APPLIANCE

COMPUTENODE

Page 12: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

STORAGE SHOULD SCALEWITH COMPUTE

Using standard, readily-available servers:● Capacity can be purchased incrementally

» Saves money and increases efficiency

● One vendor can provide both storage and compute nodes» Increases purchasing power

Storage can be deployed by cloud builders● Instead of faraway storage admins in different departments

COMPUTENODE

STORAGENODE

Page 13: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

STORAGE FOR OPENSTACK

CEPH BLOCK DEVICE(RBD)

Keystone API Swift API Cinder API GlanceAPI

NovaAPI

CEPH OBJECT GATEWAY(RGW)

CEPH STORAGE CLUSTER(RADOS)

Hypervisor

OPENSTACK

● Full integration with Nova, Cinder and Glance● Single storage for images and ephemeral and

persistent volumes● Copy-on-write provisioning● Swift-compatible object storage gateway● Full integration with Red Hat Enterprise Linux

OpenStack Platform

● Provides both volume storage and object storage for tenant applications

● Reduces provisioning time for new virtual machines

● No data transfer of images between storage and compute nodes required

● Unified installation experience with Red Hat Enterprise Linux OpenStack Platform

FEATURES BENEFITS

The most widely deployed1

technology for OpenStack storage

1 http://superuser.openstack.org/articles/openstack-user-survey-insights-november-2014

Page 14: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

WEB-SCALE OBJECT STORAGEFOR APPLICATIONS

CEPH BLOCK DEVICE(RBD)

S3-compatible, on-premise cloud storage with uncompromised cost and performance

APP SERVER

FEATURES BENEFITS

APP SERVER APP SERVER APP SERVER

CEPH OBJECT GATEWAY(RGW)

CEPH STORAGE CLUSTER(RADOS)

S3 API

WEB APPLICATION

S3 APIS3 APIS3 API

● Compatibility with S3 APIs● Fully-configurable replicated storage backend● Pluggable erasure coded storage backend● Cache tiering pools● Multi-site failover

● Supports broad ecosystem of tools and applications built for the S3 API

● Provides a modern hot/warm/cold storage topology that offers cost-efficient performance

● Advanced durability at optimal price● Delivers a foundation for the next generation of

cloud-native applications using object storage

Page 15: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

ROADMAP:RED HAT CEPH STORAGE

TODAY (v1.2) 6-9M (“Stockwell”) FUTURE (“Tufnell” and Beyond)

Ceph FIrefly

Ceph Hammer

MG

MT

CO

RE

OB

JEC

T

● Off-line installer● GUI management

● Erasure coding● Cache tiering● RADOS read-affinity

● User and bucket quotas

● Foreman/puppet installer● CLI :: Calamari API parity● Multi-user and multi-cluster

● OSD w/SSD optimization● More robust rebalancing● Improved repair process● Local and pyramid

erasure codes

● Improved read IOPS● Faster booting from clones

● S3 object versioning● Bucket sharing

● New UI● Alerting

● Performance Consistency

● Guided Repair● New Backing Store

● iSCSI● Mirroring

● NFS● Active/Active multi-site

MG

MT

CO

RE

BLO

CK

OB

JEC

T

MG

MT

CO

RE

BLO

CK

OB

JEC

T

Page 16: RED HAT CEPH STORAGE OVERVIEW - Meetupfiles.meetup.com/8910652/RHS_RHC_Overview.pdf · RED HAT CEPH STORAGE OVERVIEW Cesar Pinto ... CAPACITY PERFORMANCE N E X T-G E N T R A D I T

THANK YOU