20
Ceph: de factor storage backend for OpenStack OpenStack in Action 4! Paris, 5 th December

OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Embed Size (px)

DESCRIPTION

Paris, 5th December 2013 : OpenStack in Action 4! organized by eNovance, brings together members of the OpenStack community.

Citation preview

Page 1: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Ceph:  de  factor  storage  backend  for  OpenStack  

OpenStack in Action 4! Paris, 5th December

Page 2: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Whoami  💥  Sébas9en  Han  💥  French  Cloud  Engineer  working  for  eNovance  💥  Daily  job  focused  on  Ceph  and  OpenStack  💥  Blogger    Personal  blog:  hGp://www.sebas9en-­‐han.fr/blog/  Company  blog:  hGp://techs.enovance.com/  

Worldwide  offices  coverage  We  design,  build  and  run  clouds  –  any9me  -­‐  anywhere  

Page 3: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Ceph  What  is  it?  

Page 4: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

The  project  

➜  Unified distributed storage system

➜  Started in 2006 as a PhD by Sage Weil

➜ Open source under LGPL license

➜ Written in C++

➜  Build the future of storage on commodity hardware

Page 5: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Key  features  

➜  Self managing/healing

➜  Self balancing  

➜  Painless scaling

➜  Data placement with CRUSH

Page 6: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Controlled  replica9on  under  scalable  hashing  

➜  Pseudo-random placement algorithm

➜  Statistically uniform distribution

➜  Rule-based configuration

Page 7: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Overview  

Page 8: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

State  of  the  integra9on  Including  best  Havana’s  addi9ons  

Page 9: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Why  is  Ceph  so  good?  

It unifies OpenStack components

Page 10: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Havana’s  addi9ons  ➜  Complete refactor of the Cinder driver:

•  Librados and librbd usage •  Flatten volumes created from snapshots •  Clone depth

➜  Cinder backup with a Ceph backend: •  backing up within the same Ceph pool (not recommended) •  backing up between different Ceph pools •  backing up between different Ceph clusters •  Support RBD stripes •  Differentials

➜  Nova Libvirt_image_type = rbd •  Directly boot all the VMs in Ceph •  Volume QoS

Page 11: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Today’s  Havana  integra9on  

Page 12: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Is  Havana  the  perfect  stack?  …  

Page 13: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Well, almost…

Page 14: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

What’s  missing?  

➜  Direct URL download for Nova •  Already on the pipe, probably for 2013.2.1

➜  Nova’s snapshots integration •  Ceph snapshot

https://github.com/jdurgin/nova/commits/havana-ephemeral-rbd

Page 15: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Icehouse  and  beyond  Future  

Page 16: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Tomorrow’s  integra9on  

Page 17: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Icehouse  roadmap  

➜  Implement “bricks” for RBD ➜  Re-implement snapshotting function to use RBD snapshot ➜  RBD on Nova bare metal ➜  Volume migration support ➜  RBD stripes support

«  J  »  poten9al  roadmap  ➜ Manila support

Page 18: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Ceph,  what’s  coming  up?  Roadmap  

Page 19: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Firefly  

➜  Tiering - cache pool overlay

➜  Erasure code

➜  Ceph OSD ZFS

➜  Full support of OpenStack Icehouse

Page 20: OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Many thanks!

Questions? Contact: [email protected] Twitter: @sebastien_han IRC: leseb