IBM® Edge2013 - IBM Cloud Storage Architectures

7/27/2019 IBM Edge2013 - IBM Cloud Storage Architectures

1/43

2013 IBM Corporation

IBM Cloud Storage ArchitecturesSession 1138

Clodoaldo Barrera Chief Technical StrategistJune 2013


2/43


IBM Presentation Template Full Version

Edge 2013 Session 1138 IBM Cloud Storage Architectures


IBM Smarter Storage

Agenda

2

Cloud Background- Opportunity- Technology

IBM Product Portfolio

Future Directions


3/43





IBM Smarter Storage

3



Future Directions


4/43





Maximize Storage Utilization Storage adapts easily to unpredictable workloads Data is available anywhere, anytime

Automate Cloud Management Simple, fast, self-service provisioning Policy based data management, data moves to users automatically

Enable Robust Cloud Expansion Administrators manage far more capacity

Leverage existing storage systems

Leverage 100% o f Your Storage

Inc rease Prod uc t ivi ty

Enable New Bu siness Mod els

Cloud AgileIncrease Information Access and Improve ROI

4


5/43





Cloud Deployments grow in use

CGR 11-15

Public Cloud 25.0%Private Cloud 17.6%Non-Cloud -2.2%Total 2.6%

Cloud Opportunity

7%2012

PublicPrivateNon-Cloud

2015

PublicPrivateNon-Cloud

Spending on External Storage by Deployment Model


6/43





E f f i c i e n c y

T r an

sf or m

a t i on

Economics o f Comput ing a re Chang ing

Rethink IT

Reinvent Business

Rapidly deliver services

Integrate services across cloudenvironments

Increase efficiency

Faster time to market for new services

Focus on differentiated processes

Meet changing customer expectations,

real time access to technology

Cloud Computing changes ITs role in business

(Think private)

(Think public)

6


7/43 2013 IBM Corporation

IBM Presentation Template Full VersionEdge 2013 Session 1138 IBM Cloud Storage ArchitecturesEdge 2013 Session 1138 IBM Cloud Storage Architectures

Optimize Cloud Ready

Integrated virtualizationmanagement with ITservice deliveryprocessesElastic scalingPay for useSelf-serviceprovisioningSimplified deploymentwith virtual appliances

Consol ida te and Virtualize

Virtualization must becomestrategic across all platforms servers and storageMonitor the virtualizedenvironmentDiscovery, dependency andchange tracking

Auto mate and Manage

Automated provisioning / de-provisioningPool standardized virtualized

building blocksCapture and catalog virtualimages used in the data center Management of the virtualizedenvironment

App

OS

Image

App

OS

Image

App

OS

Image

App

OS

Image

Image Library

STANDARDIZATION

LIFE CYCLE MANAGEMENT

Building a cloud foundation fromEnterprise IT

7




88

Storage to match the requirements of the workload

Production Data

Cost and Scale to match workload

Availability and protection

Simplified administration

Archive and Retention

Policy-based data protection

Low long-term total costs

Easy migration and retrieval

Production Systems require Storage Optimization to

match scale, cost, and management objectives

Archive and Retention Systems requireLow Cost/Ease of Use to be effective instoring and protecting data throughout itsuseful life

TransactionProcessingand DatabaseHigh Transaction RatesHigh Quality of ServiceLow RPO, RTOResiliency and Security

Analytics and HighPerformanceComputingOperates on data copiesSequential accessHigh throughput

BusinessApplications

Web andCollaboration

Database orientedQuality of ServiceLow RPO, RTOLarge Memory FootprintResponsive Infrastructure

File OrientedReplicated dataThroughput-orientedScale Out CapableLower Quality of Service

Storage for Workload Optimized Systems

8




Storage in Clouds - Taxonomy

Transactioncapable

Generalpurpose

Cloud Service Storage Cloud- Public or private- Scale of tenants/users

StorageContainer

Service

BackupArchiveService

RecordsMgt

Service

Storage w/oApplication

Storage Cloud with Gateway/VPN/Web

API

Storage + ApplicationCompute Cloud

EmbeddedStorage

RemoteStorageService

LocalExternalStorage

Backup /Archive

Transactioncapable

Generalpurpose

StreamCollectService

StreamExportService

Compute Cloud- Public or private- Scale of tenants/users

Tools&

Enablers

9




Storage Classes for CloudStorag e Class

(as seen by Guest VM) Reqs Notes

Block - Transaction Attach to Hosted VMslow latency

high I/Ops, low capacity

Enterprise class attributes in performance and availabilityUsually fibre channel connected

More complex to manage with many limitations

Block - GeneralPurpose

Attach to Hosted VMsmedium latency

medium I/Ops, general purpose

General purpose, cost effective storageUsually NAS+Block Virtualization for cost, ease of management, and

scalability

Block - Ephemeral

Allocated to hosted VMs for durationof VM instancemedium latency

medium I/Ops, Typically boot images

Storage allocated as private to a VM, disappears when VM instanceis deleted.

Used for boot images or VM specific private disksCan be created by cloning boot image templates from service

catalogue

Storage for Analytics

Achieve performance and scalerequired to meet client expectations

May require unique hardware infrastructureMay require batch-oriented usage model

Network AttachedStorage

Attach to hosted VMs or over VPNmedium latencymedium I/Ops

NAS/FIle accesslarge capacity

For dedicated solutions multi-tenancy at the NAS storage device maynot be required

For shared solutions fine grained multi-tenancy is a key requirement

Fixed ContentObject Storage

Med - high latencyMed - low I/Ops

Local/WAN/Internet accessvery low cost

large capacity

Requires fine grained multi-tenancyREST API assumed as the carrier

Storage as seen by the virtual machine guest:Block storage: A virtual block disk provisioned to the guest VMNAS storage: A network mountable file system to the guest VMFixed content: A network mountable data store to the guest VM that is write once oriented

Each storage class could haveone or more tiers of storagebehind it.

10




Cloud Storage Classes

IBM Cloud Services & Storage Classes

Cloud Storage Platform Services

Cloud StorageManagement &

Security(provisioning,

monitoring,encryption,retention,

deletion, etc.)

Customer Workloads

Storage for hosted VMs

Smart Archive

Backup, Archive

XIV

Storage Technology for Cloud

SmartCloud Managed Backup

BlockBlockBlock FileBlock Block

Transactional Storage

SVC




Network Attached

Storage


General Purpose

HPC / Analytics

Web, Collab,Infratsructure

OLTP &Database

Business Apps

Block

Transactional

StorageContainer

Service

Block

Ephemeral

API

Object

Object Store TapeSONASFile Server

Target MarketSelection

Cloud ServiceDesign

Storage ServiceDesign

Storage ProductSelection

11




Cloud Storage Classes

Workload Example: Archive

Cloud Storage Platform Services

Cloud StorageManagement &

Security(provisioning,

monitoring,encryption,retention,

deletion, etc.)

Customer Workloads

Storage for hosted VMs

Smart Archive

Backup, Archive

BackupServices

BlockBlockBlock FileBlock Block





Network Attached

Storage


General Purpose

HPC / Analytics

Web, Collab,Infratsructure

OLTP &Database

Business Apps

Block

Transactional

StorageContainer

Service

Block

Ephemeral

API

Object

XIV

Storage Technology for Cloud

SVC Object Store TapeSONAS

File Server

12


13/43



13

An Abstracted Architecture Cloud Storage

Object APISnapshots User

Objects

Geo Replication Services

Object Storage

VM instances- With ephemeral storage- Mount persistent volumes

Dedicated Machines- e.g. for Analytics

Local Facility

Object API

Snapshots User Objects


Object Storage

Persistent Volumes- Implemented as virtual block

devices on a file system- IP connection to VM instances- Fault protected- Striping for better performance- Snapshots- Optional Disaster protection

Server/FS/Disk

User Portal

General VMs

Server/FS/Disk

Server/FS/Disk

Remote User - Specialty

Application- Gateway

A d m i n P o r t a

l

13


14/43



14

An Abstracted Architecture Transaction & Analytics


Objects


Object Storage



Local Facility

Object API

SnapshotsUser

Objects


Object Storage



Server/FS/Disk

User Portal

General VMs

SAN StorageTransaction VMs

SAN Storage Analytics Serversw/ SSDs


Application

- Gateway

A d m i n P o r t a

l

14


15/43



15

An Abstracted Architecture - Infrastructure NAS


Objects


Object Storage



Local Facility

Object API

SnapshotsUser

Objects


Object Storage



Server/FS/Disk

User Portal

General VMs


Application- Gateway

Server/FS/Disk

NAS export

Infrastructure NAS

A d m i n P o r t a

l

15


16/43



16

An Abstracted Architecture User Built NAS


Objects


Object Storage



Local Facility

Object API

SnapshotsUser

Objects


Object Storage



Server/FS/Disk

User Portal

General VMs


Application- Gatew ay

User Built NAS

NAS export

Server/FS/Disk

NAS export

Infrastructure NAS

A d m i n P o r t a

l

16


17/43



17

An Abstracted Architecture VDI


Objects


Object Storage



Local Facility

Object API

SnapshotsUser

Objects


Object Storage



Server/FS/Disk

User Portal

SAN Storage

SAN Storage


Application

- Gateway

A d m i n P o r t a

l

17

VDI Servers


18/43



Example Academic Institution Shared file and Compute Cloud

18


19/43



IBM Smarter Storage

19



Future Directions


20/43



Cloud capabilities built upon a common platform, with acommitment to open standards

2020

Common Open Standards Technology and Industry Ecosystem

DeployDesign

Business Process as a Service

Software as a Service

Platform as a Service

Infrastructure as a Service

Consume

Enables private/hybrid cloud servicedelivery and management

Cloud EnablementTechnologies

Secure and scalable cloud managedservices platform

Managed CloudServices

Pre-built Cloud SaaS businessapplications and solutions

Cloud BusinessSolutions


21/43



21

Enables private/hybrid cloud servicedelivery and management

Cloud EnablementTechnologies

Secure and scalable cloud managedservices platform

Managed CloudServices

IBM SmartCloud Storage is delivered through the IBMSmartCloud architecture

IBM Sm artCloud Storage is a family o f com prehens ive s torage offer ings

des igned to address c loud s torage needs for com pute , s torage , backup and archive

c louds in three deploym ent choices : priv ate, pu blic, managed


22/43


IBM Presentation Template Full VersionEdge 2013 Session 1138 IBM Cloud Storage Architectures

IBM SmartCloud Storage portfolio

Flex System V7000Storage Node

SmartCloud VirtualStorage Center

Tivoli Storage Manager for Virtual Environments

Storage and DataServices for Cloud

Compute Cloud Storage Cloud Backup Cloud Archive Cloud

SmartCloudStorage Access

Storwize V7000Unified and SONAS

with IBM ActiveCloud Engine TM


Tivoli StorageManager Suite for

Unified Recovery withFront-safe portal


SmartCloudManaged / Hosted

Tivoli StorageManager Suite for Unified Recovery

Archive with Front-safe portal


SmartCloud ContentManagement

SmartCloudEnterprise -object

storage

SmartCloudEnterprise -

persistent storage


storage


storage

SmartCloudManaged Backup

SmartCloudManaged / Hosted

Buildi t

(Private)

Runi t

(ManagedHosted)

Consumei t

(Public)

IBM SmartCloud Storage


23/43



23

Start Small and Grow Storwize Platform

Real-t ime Storag e Usage Analyt ics

Simp le, Rapid Development

IBM Storwize Platform Converting SVC from a Product to a Platform

Start Small & Scale-up

Use What You Have

IBM & non-IBM

Bui l t - in Exper t i se

Rapid Deployment

Buy Less S torage

Over 20,000 systems shipped in 2 years since inceptionOver $1B revenue in 24 months

Award winning storage platform: features, quality, reliability, support

PackagesIBM Storwize SVC(Software Appliance; No Storage)IBM Storwize 3K (Low-end)IBM Storwize 7K (Larger)

Priced OptionsIBM Storwize Real-time CompressionIBM Storwize Unified (File)IBM Storwize Metro / Global Mirror IBM Storwize External Virtualization

Embedded OptionsIBM PureSystemsBusiness Partner Solutions

powered by Storwizeembedded

Under ConsiderationIBM Storwize FlashIBM StorwizeObjectStor IBM StorwizeCloud


24/43



Integrated IBM Real-time Compression Improves efficiency with up to 80% reduction in physical

disk space required enabling up to 5x data in the samespace

High performance: works with active primary dataFour-way clustered systems

Increased capacity and throughput capabilitySupport for Fiber Channel Over Ethernet (FCoE) Supports next-generation converged data center

networking for block workloadsUpgrade Storwize V7000 block systems to Storwize V7000Unified

Enables greater consolidation and simplification

Integrated authentication server Simplify implementation by avoiding need to connect toexternal authentication server

OpenStack Nova-volume driver Simplifies storage management for enterprises using the

OpenStack cloud platform Also available for Storwize V7000 block systems

Imp rove sys tem capaci ty up to 5x wi th Real-t ime Com press ion & Enhance inves tm ents wi th b lock up grade and c lus ter ing

IBM Storwize V7000 Unified


25/43



A Smarter Infrastructure Solution PureFlex + Smarter Storage

IBM Smarter Storage

Client request: Businesses are looking to gain greater agility,efficiency, simplicity and control by consolidating their environments into integrated infrastructure

The Industry response: Consolidated VMware infrastructure

IBMs Smarter Answer: PureFlex PureFlex enables expert integrated virtual and

physical environments Simultaneous run and manage your choice of Server Virtualization

platforms (VMware, PowerVM, KVM and Hyper-V) as well as non-virtualized Microsoft, Linux and AIX workloads

All components are pre-integrated (Server,Storage, Network, Server Virtualization andmanagement)

Expert Integrated Smarter Storage is standard

25


26/43



Storage that is Integrated by DesignStorwize V7000 and Flex System Storage NodeLeverage existing storage while gaining advanced capabilities

Efficient by Design: Manage Cost andcapacity growth Decrease space requirements with Virtualization,

thin provisioning and now Real-TimeCompression.

Simplify Administration with simple GUI

Self Optimizing: Improve performance andproductivity Analyzes and adapts with automated

performance tuning Flash Optimized with EasyTier and SSD

Cloud Agile: Adaptive, automated and robuststorage infrastructure

*Some capabilities planned for future delivery

Expertise in Efficiency:Wizards guide tasks for increased

productivity

Expertise in Storage Optimization:Built-in tiering maximizes

performance and cost savings

Up to 80% storage compressionwithout any application

performance degradation

Client Value

Minimizes downtimefor backup, restore and replication

26


27/43



IBM PureFlexConfigurations that ease acquisition experience and match your needs

Express Standard Enterprise

Infrastructurefor Small andmidsizebusinesses. Mostaffordable entrypoint

Infrastructure for applicationservers withsupportingstorage andnetworking

Infrastructure for scalable clouddeployments.Redundancy for resilientoperation

Designed for Cloud - SmartCloud Entry included on Standard and Enterprise Designed for choice of architectures: IBM POWER7 and/or Intel x86 processors

within the same systems Designed for choice of OS: AIX, IBM i, Microsoft Windows , and Linux from Red Hat, SUSE Designed for choice of hypervisors: PowerVM, KVM, VMware, or Microsoft HyperV Designed for optimized data management and performance Designed for simplicity: Integrated, single system management across physical

and virtual resources

27


28/43



Reduce operational complexity withintegrated management for large andmulti-site XIV deployments

Multi-system Manager server Automate XIV provisioning for cloud

applications OpenStack Nova-volume driver

Enhanced integration with VMware andMicrosoft

VMware Site Recovery Manager (SRM) v4.1and v5.0

Microsoft System Center Virtual MachineManager

XIV Mobile Dashboard enhancements Support for IPsec and U.S. Government

(USGv6) certification

Higher sca labi l i ty and s imp l i f ied c lou d deploym ents through in tegra ted m anagement

IBM XIV Storage System Gen3for Enterprise Systems


29/43



Technical Leadership Through Integrated Cloud Technology Stack:STG and SWG Capabilities

Easily build and rapidly scalecloud environments

Deliver client value and ROIat a fraction of the time

Foundation

Orchestrate

Integrate

Automate

Consolidate and virtualize

Monitor the virtualized environment

Service orchestration

Integrated virtualizationmanagement

Simplified, centralized administration

Image lifecycle

management

Building modular solutions that progress incapability

29


30/43



30

Platform as a Service Technologies

Infrastructure as a Service Technologies

InfrastructurePlatform

Usage andAccounting

Availability andPerformance

Managementand Administration

Security andCompliance

ApplicationLifecycle

ApplicationResources

ApplicationEnvironments

ApplicationManagement

Integration

IBM SmartCloud Foundation

ORCHESTRATE

AUTOMATE

SmartCloud Provisioning

Automated provisioning designed for cloud with parallel scalability and integrated fault tolerance

Advanced image lifecyclemanagement and analytics

Standardized middleware and application deployments

SmartCloud EntryBasic cloud functions

including intuitive self service interface,administration, and infrastructure management designed for cloud

AUTOMATEOPTIMIZED

WORKLOADSSmartCloud Orchestrator

Advanced cloud delivery including serviceorchestration, runbook automation, monitoring, usageand accounting

Cloud Management

30


31/43



SAN

SmartCloud Virtual Storage Center Enables storage for cloud computing Easy to buy and deploy Pay-as-you-go pricing

SnapshotManagement

External StorageVirtualization

SAN and StorageResource Management

Ease of Use

ExpandedFlexibility

Automated DataProtection

SmartCloud Virtual Storage Center IB M

s hypervisor for s torage Right -t ier ing c an reduce the uni t co s t of s torage up to 50% wi thout inc reas ing c om plexi ty


32/43



IBM Storage Software Suite Smart Cloud Virtual Storage Center

Network

SVC, TPC, Flash Copy Manager

Virtual Server Environments Free IT from the cost and complexity of legacy

data management products Get ahead of runaway data growth and Big Data Be online quicker and access clones faster

Transform your backup infrastructure into aservice

Central Management andStorage hypervisor

Dramatically improve utilization of your physicalstorage assets

Deliver tier-1 service regardless of hardwarechoice

Balance workload, manage lease termination,improve datacenter performance

Optimize your people for the challenges of day-to-day operations

EMC Hitachi OracleHP Dell Fujitsu others

32


33/43



IBM Smarter Storage

33



Future Directions


34/43



Cloud IP Network

1GbE and 10GbE host interfacesWork load and data is evenly distributed acrossall nodes and disk pools, eliminating hot spots

All nodes continuously serve all files every node is the same (not failover pairs)

Near linear aggregate performanceand capacity scalingHealthy nodes take over workloadof failed nodeHigh speed, low latency (20 Gbps) privateInfiniband cluster data networkHigh density RAID controller and disk

expansion drawer (4U x 60 HDDs) Support for high-performance SASand high- capacity SATA HDDs

NFS, CIFS and other popular

network file protocols

...ManagementNode InterfaceNodes InterfaceNodes

Internal Network

...

StorageNode

Storage Pod

High DensityController

High Density Storage Array

StorageNode

Dual RAIDController

High DensityJBOD

Dual RAIDController

High DensityJBOD

StorageNode

Storage Pod

High DensityController

StorageNode

Dual RAIDController

High DensityJBOD

Dual RAIDController

High DensityJBOD

High Density Storage Array

IBM SONAS Architecture


35/43



Active Cloud Engine V7000 Unified and SONAS

...Managemen

t Node InterfaceNodes

InterfaceNodes

Internal Network

...

StorageNode

Storage Pod

HighDensity

Controller High Density Storage Array

StorageNode

Dual RAIDController

HighDensityJBOD

Dual RAIDController

HighDensityJBOD

StorageNode

Storage Pod

HighDensity

Controller

StorageNode

Dual RAIDController

HighDensityJBOD

Dual RAIDController

HighDensityJBODHigh Density Storage Array

Global Clouds All files appear to be local. Scan

billions of files in minutes

Files Move with the User Fast accessanywhere; no manual replication required

Policy Based Administration Manage multi-site clouds with less complexity

V7000 Unified (file) participates in a Global fileCloud

- Local storage hierarchy- Global file access- Centralized data protection and

distribution


36/43



Private Storage Cloud OfferingFor Private Enterprise and Service Providers

File data access on SONAS andStorwize V7000 Unified that support: Self-service portal designed

to speed storage provisioning, monitoringand reporting

Standards based object storeand API to support theimplementation of StorageCloud services

36

PRIVATESTORAGE CLOUD

TPC

Self-ServicePortal

SONAS / V7000-U


37/43



37

IBM SmartCloud Storage Access

Self-service Capacity provisioning, monitoring, reporting

Web-based access Simple GUI via Internet

Capacity elasticity Automated or policy-driven

Monitoring and reporting capability End-user and administrator

Service Class Gold, Silver, Bronze

Approval

Complete approval control process

Enables private cloud storage service


38/43



38

Enables private storage cloud in three simple steps

Step 1: Set up applianceCustomize settings, configure securityCreate user accounts, user groups

Step 2: Plan the cloud serviceRegister backend storageDefine cloud service levels

Step 3: Set up the cloudCreate storage resource pools

Enable cloud storage in a matter of minutes


39/43



39

Provision storage in a few clicks

Step 1: Provision storage containersCreate and manage storagecontainer in the cloud

Step 2: Fill in the required fieldsName of container Type, EnvironmentCapacityService profile

Step 3: Mount the container As an x drive on your desktop

End Users or Admins provision storage quickly


40/43



TPC

SONAS Storwize V7000 Unified

Authentication Server

IBM SmartCloud Storage Access

OR

Common NAS Stack

IBM Cloud Storage Portal

Required elements that mayalready exist at customer

Cloud Storage solution End to end cloud storage solution

Self service portal

40


41/43



41

Why IBM SmartCloud StorageAccess

First of a kind private self -service storage cloudsoftware

Powerful Centralized control with delegation Ability to assign, customize multiple storage

classes to balance performance and cost

Enables high QoS (Quality of Service) Quick response via automation Service classes

Architected to expand NFS/CIFS today Object storage near future*

Integration with Tivoli Usage and AccountingManager (TUAM)

Robust, Advanced Technology


42/43



The SmartCloud Storage family of offerings complement each other

Administrator SmartCloudVirtual StorageCenter

SmartCloud Storage Access - self-service portal for end users to store and access files onthe storage cloud

Automated storage provisioning for applications with SmartCloud Virtual Storage Center

End user

End user

End user

End user


End user

XIV

Data Center

SmartCloud

Storage Access + SONAS +


43/43


Thank You

Documents

IBM® Edge2013 - IBM Cloud Storage Architectures