16
© 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved. Storage Visibility and Optimization A Story of Ceph

Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

Embed Size (px)

Citation preview

Page 1: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Storage Visibility and Optimization A Story of Ceph

Page 2: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Cloud/Big-data Winnovation Team

Alex Holden Damian Van Vuuren Ailing Zhang

Marc Solanas Matt Weeks Pengfei Zhang

Kai Zhang

Xinyuan Huang

Debo Dutta

Yathiraj Udupi

Page 3: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Why do we need storage visibility?

Page 4: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

OpenStack Storage

Openstack APIs

Cinder

????

Swift Glance

Page 5: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

The Storage Jungle

Page 6: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Why is visibility useful? Optimal object

distribution Failure detection

Make underlying configuration

easier

Performance tuning

Page 7: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Case Study: Ceph

Source: http://ceph.com/docs/master/architecture/

Page 8: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Case Study: Ceph

hash(“foo”) % 128 = 0x3f

“bar’ = 2

Page 9: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Visibility in Ceph

Page 10: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

The visibility we want in Ceph

Visual monitoring

Object distribution

OSD real time status

Visual management of

crush rules

Page 11: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

First Ceph Dashboard Within Horizon!!!

Page 12: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Ceph Horizon Panel Demo

Page 13: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Use case: Identify bottlenecks

Page 14: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Page 15: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Optimization Rebalance storage nodes dynamically

Preview changes (Future work)

Change configuration automatically (Future work)

Page 16: Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013 Cisco and/or its affiliates. All rights reserved. Cisco © 2013 Cisco and/or its

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Conclusion Reduce downtime

Increase storage performance

Provide analytics and historical data

More insights to follow!