17
© 2014 HGST, INC Open Ethernet drive architecture Introducing a new technology from HGST Christopher Squires Chief Architect Group

Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

Embed Size (px)

DESCRIPTION

Presented by Christopher Squires, HGST

Citation preview

Page 1: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC

Open Ethernet drive architectureIntroducing a new technology from HGST

Christopher SquiresChief Architect Group

Page 2: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 2

Forward Looking Statement

This presentation contains forward-looking statements that involve risks and uncertainties, including, but not limited to, the development and adoption of a new storage architecture and the potential introduction of products based on this architecture. Forward-looking statements should not be read as a guarantee of future performance or results, and will not necessarily be accurate indications of the times at, or by, which such performance or results will be achieved, if at all. Forward-looking statements are subject to risks and uncertainties that could cause actual performance or results to differ materially from those expressed in or suggested by the forward-looking statements.

Additional key risks and uncertainties include the impact of continued uncertainty and volatility in global economic conditions; actions by competitors, business conditions and growth in the various hard drive segments. More information about the other risks and uncertainties that could affect our business are listed in our filings with the Securities and Exchange Commission (the “SEC”) and available on the SEC’s website at www.sec.gov, including our Quarterly Report on Form 10-Q filed with the SEC on May 5, 2014, to which your attention is directed. We do not undertake any obligation to publicly update or revise any forward-looking statement, whether as a result of new information, future developments or otherwise, except as otherwise required by law.

Page 3: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 3

2008 2009 2010 2011 2012 2013 2014 20150

1000

2000

3000

4000

5000

6000

7000

8000

9000

Stored Data

Unstored

Data

Source: IDC, HGST

Data Created

Valuable Data is Being WastedE

xab

ytes

44 ZB of data creation in 2020

Useful data growing from 22% in 2013 to 37% in 2020

TB per IT pro increasing 8x from 2013 to 2020

Not News: Explosion in Data Growth

Page 4: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 4

Active is #1 requirement in storage

0 IOPs

High IOPs

High-value historical data

• The value of dataWhen data is more readily accessible, it’s value increases

• Traditional “tiers” of data are compacting

High-speed, low latency

Low-speed, higher latency

Archive must be accessible

• Affordable disk media solutions offer ideal price/performance

Spinning disk is NOT dead

Software-defined storage

Time (Days, Weeks, Months to Years)

Page 5: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 5

OPEN ETHERNET DRIVE ARCHITECTURE

A FOUNDATIONAL BUILDING BLOCK FOR THE SOFTWARE DEFINED DATA CENTER

Page 6: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 6

VENDOR-SPECIFIC ARCHITECTURES

CONFINE THE SCALE-OUT OF GROWING UNSTRUCTURED DATA

Page 7: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 7

Page 8: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 8

OPEN SOFTWAREHARDWARE

ENABLING DISTRIBUTION OF STORAGE SERVICES ACROSS YOUR INFRASTRUCTURE

ETHERNETDRIVEARCHITECTURE

A Drive Running Linux…Leverages the Linux ecosystem

A Drive with Ethernet…Connects storage directly into the data center fabric

A Drive with CPU & RAM…Runs storage services directly on the device

Page 9: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 9

DRAM

HDD ARM®

R/W Channel

Ethernet

32-bit ARM®

Standard 3.5” HDD form factor

Powerful, low-cost integrated SOC

Ethernet connectivity

Demonstrating 4TB, but technology can be applied to any 3.5” HDD or SSD

A look at the Demo Drive

Page 10: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 10

Integrated Demo: Enclosure Example

Reference Design

4U Enclosure

60 drive slots

Embedded switched fabric

Hot-swap components

Provides seamless integration into existing datacenter architectures

10Gbps Ethernet ports

Devices appear as Linux servers

Page 11: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 11

Photo Evidence

Page 12: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 12

Solutions running as demonstrations

Page 13: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 13

End to End Storage

Ultrastar 7K6000He8

10TB SMR

High Access. High Capacity.Low TCO.

6TB

5 / 4 / 2 TB7200 RPM

10TB

7200 RPM

8TB

6TB7200 RPM

Cool to Cold Storage Highest Areal DensityHighest Performance

Lowest PowerBest TCO

Page 14: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 14

HGST Code and Community

• Sign up for the Open Ethernet Developer Program- http://www.hgst.com/opendev

• We’re on Github- https://github.com/hgst

- First published code is libzbc

• Ceph Blueprint for Cold Storage- https://wiki.ceph.com/Planning/Blueprints/Submissions/Cold_Storage_Pools

- http://pad.ceph.com/p/GH-cold-storage-pools

Page 15: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 15

Other HGST code projects

• With expertise from HGST Research, opportunities for contribution include:

- Erasure coding approach that recovers from 2 failures

- First parity as standard row parity for efficiency

- Leveraging XOR functions to complement software-defined solutions

- Optimized bandwidth and access ratios for recovery

»Resulting in 50% reduction in data read when recovering from one erasure

- Other optimizations to Ceph

• Want to learn more? Let us know!

Page 16: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC 16HGST Confidential

Think HGST for efficient Ceph clusters

• HGST is happy to participate in the Ceph community

Patch contributions today, looking to contribute more

Exploration of optimizing Ceph services as close to the drive media as possible

Discussing solutions for software-defined scale-out storage in the data center

• HGST Ultrastar He6 hard drives great for Ceph today

49% lower power / TB, both 50% additional capacity and 38% lower weight / TB

• HGST Ultrastar He8 TB hard drives shipping Now!!!

Page 17: Ceph Day New York 2014: Ceph and the Open Ethernet Drive Architecture

© 2014 HGST, INC

Thank YouChristopher Squires

Chief Architect Group

[email protected]