Storage Visibility and Optimization - OpenStack Visibility and Optimization A Story of Ceph © 2013...

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Storage Visibility and Optimization A Story of Ceph

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Cloud/Big-data Winnovation Team

Alex Holden Damian Van Vuuren Ailing Zhang

Marc Solanas Matt Weeks Pengfei Zhang

Kai Zhang

Xinyuan Huang

Debo Dutta

Yathiraj Udupi

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Why do we need storage visibility?

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

OpenStack Storage

Openstack APIs

Cinder

????

Swift Glance

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

The Storage Jungle

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Why is visibility useful? Optimal object

distribution Failure detection

Make underlying configuration

easier

Performance tuning

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Case Study: Ceph

Source: http://ceph.com/docs/master/architecture/

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Case Study: Ceph

hash(“foo”) % 128 = 0x3f

“bar’ = 2

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Visibility in Ceph

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

The visibility we want in Ceph

Visual monitoring

Object distribution

OSD real time status

Visual management of

crush rules

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

First Ceph Dashboard Within Horizon!!!

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Ceph Horizon Panel Demo

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved.

Use case: Identify bottlenecks

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Optimization Rebalance storage nodes dynamically

Preview changes (Future work)

Change configuration automatically (Future work)

© 2013 Cisco and/or its affiliates. All rights reserved. Cisco

Confidential

Conclusion Reduce downtime

Increase storage performance

Provide analytics and historical data

More insights to follow!