Ceph Status && Community Update

Ceph Day Amsterdam 2015

COMMUNITY

DEV

Hammer

Modules

Orchestration / Deployment

Release Cycle

QUESTIONS

AGENDA

2

COMMUNITY

Focused on being non-disruptive

RHEL / Fedora / CentOS coverage

Maintaining Ubuntu / SUSE coverage

Co-Existing with Gluster

Bi-directional learning is fun!

LIVING IN A POST-ACQUISITION

WORLD

4

CEPH DAYS

You’re here!

Turning up the heat

100% Community-focused

Upcoming

Amsterdam

Berlin

Beijing

5

METRICS

6

Bitergia Platform

New Quarterly View

Community-driven

Good growth

Code/Tracker/IRC/Lists

Continuing to evolve

USER COMMITTEE

7

Started after Dumpling

Current chair: Eric Mourgaya

Periodic meetings to discuss community matters

Most recently:

Release cadence

Contributor credits

Meetups

RADOS Gateway use cases

Discuss upcoming work

First steps towards broader governance

Google Summer of Code

8

Ceph project’s second year

Last year

Wireshark

Reliability Model

Work published on Ceph wiki

Get involved!

CentOS Storage SIG

9

Creating a collection of packages

http://wiki.centos.org/SpecialIntere

stGroup/Storage/Proposal

Easier to deploy CentOS as a

storage node

Early days

Packages for Ceph & Gluster

Get involved!

GOVERNANCE

10

We haven’t forgotten about you!

CEPH DEVELOPER SUMMIT

11

Quarterly developer summit

100% online (Blue Jeans / IRC)

Infernalis summit just completed

Videos on Ceph YouTube

channel

Next up: “J”

DEVELOPMENT

HAMMER STATUS

13

Coming soon!

Major Features:

cephfs: journal scavenger repair tool (John Spray)

crush: new and improved straw2 bucket type (Sage Weil, Christina Anderson, Xiaoxi Chen)

doc: improved guidance for CephFS early adopters (John Spray)

librbd: add per-image object map for improved performance (Jason Dillaman)

librbd: copy-on-read (Min Chen, Li Wang, Yunchuan Wen, Cheng Cheng)

librados: fadvise-style IO hints (Jianpeng Ma)

mds: many many snapshot-related fixes (Yan, Zheng)

mon: new ‘ceph osd df’ command (Mykola Golub)

mon: new ‘ceph pg ls …’ command (Xinxin Shu)

osd: improved performance for high-performance backends

osd: improved recovery behavior (Samuel Just)

osd: improved cache tier behavior with reads (ZhiqiangWang)

rgw: S3-compatible bucket versioning support (Yehuda Sadeh)

rgw: large bucket index sharding (Guang Yang, Yehuda Sadeh)

RDMA “xio” messenger support (Matt Benjamin, Vu Pham)

CephFS

14

Lots of hard work!

Dogfooding

Code

Src/mds: 366 commits, 19,417 lines added/removed

Src/client: 131 commits, 4289 lines

Src/tools/cephfs: 41 commits, 4179 lines

Ceph-qa-suite: 4842 added lines of FS-related python

Tracker

108 FS tickets resolved since Firefly (of which 97 were created

since Firefly)

83 ticket currently open for FS, of which 35 were created since

Firefly

31 feature tickets resolved

librados

15

Many more deployments/apps using direct librados

Native library for accessing RADOS

Librados.so shared library

C, C++, Python, Erlang, Haskell, PHP, Java (JNA)

Direct data path to storage nodes

Speaks native Ceph protocol with cluster

Exposes

Mutable objects

Rich per-object API and data model

Hides

Data distribution, migration, replication, failures

Making your intelligent nodes, intelligent-er!

Allows you to dynamically extend objects in RADOS

Examples

MD5 hash

Image thumbnail service

Log post-processing

Whatever you build!

Uses LUA

Ask Noah!

Copyright © 2013 by Inktank | Private and Confidential

Object Classes

16

DEPLOYMENT / ORCHESTRATION

17

Ceph-deploy in a good place

Chef / Puppet / Ansible / Salt / Juju

Docker is the up-and-comer

Ask Chris!

RELEASE CYCLE COMMS

18

Increased communication requested (user committee)

Alternating releases (ex: emperor vs firefly)

Product vs upstream church and state

THANK YOU!

Patrick McGarryDir Ceph Community

pmcgarry@

redhat.com

@scuttlemonkey