Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage Key to Unstructured-Data Infrastructure
19 Sep.2012
Anil Vasudeva President & Chief Analyst
IMEX Research.com (408) 268-0800 (408) 489-0800 cell
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Harnessing Unstructured Data
2
Majority of data growth is being driven by unstructured data and billions of large objects
Information is at the center of New Wave of opportunity
80% of world’s data is unstructured driven by rise in Mobility devices, collaboration machine generated data.
Data Sources
Store/Access Infrastructure
Long Term Retention
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage - Goals
3
Sou
rce:
IBM
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
© 2010-11 IMEX Research, Copying.
4 4
Dat
a: IM
EX R
esea
rch
& Pa
nasa
s
Collaboration Information
Instantly available On Boot Ups
Commercial Mktg. Data
Medical Data Diagnostics
Rendered (Texture & Polygons) Stored Data-Very Read Intensive
Entertainment- Data Repository
Most Accessed Videos Very Read Intensive
Historical Data
Decision Support
Targets for Object Storage
Wall St/Financials/ Federal/State/CityData Geo-Resources Maps
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage - Fundamentals
• Object Storage: • Data repository of billions of Objects
• Key Architecture: • Separation of Metadata and Data
• Implementation Goals: • Flat Namespace • Infinite Scalability • Elasticity • Cost-efficiency • Data durability • Distributed System • No Single point of failure
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Tiers of Storage and Evolution
Primary (FC) Secondary (Tape)
$$$$ + Very Fast $ + Slow speed Storage 90’s
Higher capacity Higher performance
Structured and Unstructured Data Backup and Archive Data
$$$$ + Very Fast $$$ + Medium $$ + Medium $$ + Medium $ + Slow speed
Storage 2000
Primary(SAN) Secondary Primary (NAS) Secondary (NAS) Unstructured Files, Active Archives Snapshots, D2D BU and DR Tape BU Structured Data
Cloud NAS Cloud Backup/DR Cloud Archive Structured Data
$$$$ + Very Fast $$ + fast $ + Medium $ + Medium
Storage 2011+
Enterprise Object Storage Primary(SSD)
Sou
rce:
PA
nzur
a
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Three Types of Storage
7
HTTP, SOAP, Torrent, XCAM, CAS, Object, WebDev
Object & App VHD, DICOM, Cloud, APIs
File Based NFS,CIFS, AFP, pNFS
Block Based LUNs, VTL
Ethernet/DCB FCoE/iSCSI
Fibre Channel
Shared SAS
Front End Tiered Storage & Protocols
Multi-protocol/Unified Storage System Gateway
or Appliance
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object vs. Block based Storage
8
Block Based Protocol (SCSI, ATA)
Fixed-sized blocks
Mixed data & Metadata
Block-based Storage System
Object-based Storage System
Variable-sized Objects
Data & associated Metadata
Object storage Protocol (OSD,ReST etc.)
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Innovation: Next Generation Storage
Direct attached
Storage moved to the LAN
Storage distributed in the cloud
APPLICATION
FILE SYSTEM
CACHE
APPLICATION
CACHE
FILE SYSTEM
APPLICATION
ETHERNET
SSD
FILE SYSTEM
INTERNET FIBER
ETHERNET
LAST 20 YEARS NEXT 20 YEARS
Sour
ce:P
Anzu
ra
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Hierarchical vs Flat Storage Schema
10
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage Goals -1
11
• Reduce the cost and complexity of unstructured data storage infrastructure.
• Auto-manage unstructured data (documents, emails, presentations, audio files, messages..)
• Upload once, access from any geographic regions. (WORM)
• Unlimited File Size. Upload files of virtually any size
• Keep integrity of files intact, in flight. • Data Consistency: Changes made to a file in one
location immediately available at all locations
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage – Goals 2
12
• True Global Namespace: Leverage automated geo-positional routing for increased performance and consistency.
• Self-Healing Data Integrity - continuously conduct MD5 hash checks on the data and if a problem is detected, have the system repair the file automatically.
• Self-Provisioning: Provision your own storage as needed.
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage Positioning
13
DAS NAS
SAN
Object
Petabytes of Unstructured Data
Massive Archives that are Active
High
Low
256
App
Nod
es
Scal
e
Management Autonomic Manual 80TB/Admin
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Why Object Storage - 1
14
· Object-based storage supports shared tenancy. Objects have their own custom metadata functioning as fairly autonomous data instances - can carry access policies to support multi-tenancy - a big aspect of the relevance of object storage to public cloud infrastructures. · Object storage lends itself well to low-cost, grid like architectures. Object storage is well-suited to run on a loosely federated set of low-cost, industry-standard servers acting as nodes in a cluster. Cluster easy to expand by adding nodes - automated data layout rebalance the system to incorporate them. This drives the low acquisition cost and lower OPEX..
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Why Object Storage - 2
15
Object storage can support massive scalability. In both the total capacity within a system and the number of files or objects to be stored. Within specified policies system can sprawl nearly indefinitely. More metadata means more custom control over data. With file storage systems, you get file type, creation date, and last-accessed date. Object Storage.expands the Metadata and automatically and consistently tackles traditional storage challenges such as tiering, security, migration, redundancy, and deletion. Data is inherently WORM in most object systems. Saved object data is tagged with a unique identifier, guaranteeing the immutability of that object. To modify an object, you create a new, and keep versioning history - a natural fit for archiving and records management applications with guarantee that data has not been modified or tampered with.
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage - Implementation
16
In implementing object storage: • A unique identifier assigned to each piece of data • Identifier allows servers or users to get access to
Object without any knowledge of where data is physically stored.
• Data can be broken into chunks, stored anywhere worldwide, can move within a system and have multiple copies.
• Object tag ensures that right piece of data is returned and verifies integrity of that data.
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Market Sizing – Object Storage
17
2010 2020
25
Scale-Out
NAS
SAN
*Includes HW, SW, File System, Backup, High Availability & Management
Rev
enue
s $
Bill
ions
*
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Centralized Storage using Public/Private Cloud
Global File System (App Intelligence) R/W Perf ACL AD G.
CIFS/NFS G. Locking G.NS
Cloud Storage Controller (Unlimited Capacity)
Virt/Phy 10Gbps SSD Cache IOPS Replication Encryption RAID-DP Snapshots
G. Mgmt G. Dedup
Performance Protection
Global Local Efficient
London New York Tokyo
F5 Networks
Riverbed
Cleversafe
HDS
StorSimple
IBM Cloud
TwinStrata Nasuni
Data Direct Networks DreamHost
Rackspace
Gluster NetApp/ByCast Dell
Sour
ce:P
Anzu
ra
2012 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved.
Object Storage Key to Unstructured-Data Infrastructure
19 Sep.2012
Anil Vasudeva President & Chief Analyst
IMEX Research.com (408) 268-0800 (408) 489-0800 cell