Storage Virtualization

© 2009 EMC Corporation. All rights reserved.

Storage VirtualizationStorage Virtualization

Module 2.6

© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 2

Module Objectives

Upon completion of this module, you will be able to:

Identify different virtualization technologies

Describe block-level virtualization technologies

Describe file-level virtualization technologies

Discuss virtual provisioning


Lesson –Virtualization Overview

Upon completion of this lesson, you will be able to:

Identify and discuss virtualization technologies


What is Virtualization

Virtualization is a technique of abstracting physical resources in to logical view

Increases utilization and capability of IT resource

Simplifies resource management by pooling and sharing resources

Significantly reduce downtime– Planned and unplanned

Improved performance of IT resources


Virtualization Comes in Many Forms

5

Each application sees its own logical memory, independent of physical memory

Virtual Memory

Each application sees its own logical network, independent of physical network

Virtual Networks

Each application sees its own logical server, independent of physical servers

Virtual Servers

Each application sees its own logical storage, independent of physical storage

Virtual Storage

© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 6 6

Each application sees its own logical memory, independent of physical memory

Virtual Memory

Memory Virtualization

Benefits of Virtual Memory•Remove physical-memory limits•Run multiple applications at once

Physical memory

Swap space

App

App

App

© 2009 EMC Corporation. All rights reserved. Storage Virtualization - 7 7

Each application sees its own logical network, independent of physical network

Virtual Networks

Network Virtualization

Benefits of Virtual Networks•Common network links with access-control properties of separate links

•Manage logical networks instead of physical networks

•Virtual SANs provide similar benefits for storage-area networks

VLAN A VLAN B VLAN C

VLAN trunkSwitch

Switch


Server Virtualization

Before Server Virtualization:

Operating system

Application

Single operating system image per machine

Software and hardware tightly coupled

Running multiple applications on same machine often creates conflict

Underutilized resources

After Server Virtualization:

Virtual Machines (VMs) break dependencies between operating system and hardware

Manage operating system and application as single unit by encapsulating them into VMs

Strong fault and security isolation

Hardware-independent

Virtualization layer

Operating system

App App App

Operating system

App App App


Storage Virtualization Process of presenting a logical view

of physical storage resources to hosts

Logical storage appears and behaves as physical storage directly connected to host

Examples of storage virtualization are:

– Host-based volume management

– LUN creation

– Tape virtualization

Benefits of storage virtualization:– Increased storage utilization

– Adding or deleting storage without affecting application’s availability

– Non-disruptive data migration

Virtualization Layer

Heterogeneous Physical Storage

Servers


Lesson Summary

Key topics covered in this lesson:

Various forms of virtualization– Memory, network, server and storage virtualization


Lesson – Storage Virtualization Implementation


Discuss SNIA virtualization taxonomy

Describe Block-Level Virtualization technologies and implementation

Describe File Level Virtualization technologies and implementation


SNIA Storage Virtualization Taxonomy

StorageVirtualization

BlockVirtualization

DiskVirtualization

File System,File/record

Virtualization

Other DeviceVirtualization

Tape, Tape Drive,Tape LibraryVirtualization

NetworkBased Virtualization

Storage Device/StorageSubsystem Virtualization

Host Based Virtualization

In-band Virtualization

Out-of-band Virtualization

What is created

Where it is done

How it is implemented


Storage Virtualization Requires a Multi-Level Approach

Server

StorageNetwork

Storage

Path management

Volume management

Replication

Volume management - LUNs

Access control

Replication

RAID

Path redirection

Load balancing - ISL trucking

Access control - Zoning


Storage Virtualization Configuration

(a) In out-of-band implementation, the virtualized environment configuration is stored external to the data path

(b) The in-band implementation places the virtualization function in the data path

Servers

StorageArrays

VirtualizationAppliance

Out-of-Band

(a)

StorageNetwork

Servers

StorageArrays

In-Band

(b)

Storage Network

VirtualizationAppliance


Storage Virtualization Challenges

Scalability– Ensure storage devices perform appropriate requirements

Functionality– Virtualized environment must provide same or better functionality

– Must continue to leverage existing functionality on arrays

Manageability– Virtualization device breaks end-to-end view of storage infrastructure

– Must integrate existing management tools

Support– Interoperability in multivendor environment


Block-Level Storage Virtualization

Ties together multiple independent storage arrays– Presented to host as a single

storage device– Mapping used to redirect I/O on

this device to underlying physical arrays

Deployed in a SAN environment

Non-disruptive data mobility and data migration

Enable significant cost and resource optimization

Servers

Heterogeneous Storage Arrays

Virtualization Applied at SAN Level


File-Level Virtualization

Every NAS device is an independent entity, physically and logically

Underutilized storage resources

Downtime caused by data migrations

NAS Devices/Platforms

Before File-Level Virtualization

IP Network

StorageArray

FileServer

FileServer

Clients Clients

Break dependencies between end-user access and data location

Storage utilization is optimized

Nondisruptive migrations

NAS Devices/Platforms

After File-Level Virtualization

IP Network

Clients Clients

StorageArray

FileServer

FileServer

Virtualization Appliance


Lesson: Summary

Key points covered in this lesson:

Storage virtualization challenges

Storage virtualization configuration

Types of storage virtualization


Concept in Practice – EMC Invista

Inside the Intelligent Switch

Mapping

operation

Mapped I/O streams

Host Storage

EMC Invista

Input I/O stream

Intelligent Switches: Fibre Channel switches with custom hardware for enhanced processing

Capable of performing operations on data streams at line speed

Controlled by instructions from external management software (via APIs)


Invista Video


Automount

NIS LDAP

DFS

AD

Moving Files Online: A File Virtualization Example

NFS4 Root

NIS LDAP

Global Namespace

Manager

Event Log File Virtualization inserted

into I/O Client redirection

Global Namespace updated

File Virtualization Appliance

DFS

AD

Automount

NIS LDAP

Global Namespace

Manager

NFS4 root

NIS LDAP

File-datamigrationFile-datamigration

Migration complete without down time


Rainfinity Video

Click here to play the video


Lesson: Virtual Provisioning


Explain Virtual Provisioning

Describe and explain Thin vs. Traditional LUNs

Explain the benefits of Virtual Provisioning

Explain how to create, monitor, and manage Thin LUNs


What is Virtual Provisioning

Capacity-on-demand from a shared storage pool– Logical units presented to hosts have more capacity than physically

allocated

– Physical storage is allocated only when the host requires it

– Provisioning decisions not bound by currently available storage

Above and beyond “Thin Provisioning”– Includes management tools that make it easier to configure, use,

monitor and manage Thin Pools and Thin LUNs

AllocatedAllocated Allocated

Host Reported Capacity

Shared Storage Pool

Storage perceived by the application is larger than physically allocated storage


Traditional Provisioning Virtual Provisioning

Traditional Provisioning vs. Virtual Provisioning

1650 GB Or

1.65 TB Available Capacity

350 GB Actual Data

Storage SystemLUN 1 LUN 2 LUN 3


Virtual Provisioning – Benefits

Reduce administrative costs– Simplifies storage provisioning– Over-provisioning can eliminate challenges of expansion– Reduces time required to repeatedly add storage capacity

Reduce storage costs– Increased space efficiency for primary storage and replicas– “Storage on demand” from shared storage pool– Deploy assets as needed– Reduce levels of unused physical storage– Avoid pre-allocating physical storage to applications

Reduce operating costs– Fewer disks consume less power, cooling and floor space

Reduce downtime– Less disruptive to applications


Virtual Provisioning – Thin Pool Expansion

Adding drives to the pool non-disruptively increases available shared capacity for all Thin LUNs in pool– Drives can be added to a Thin Pool while pool is being used in

production

Allocated capacity is reclaimed by the pool when Thin LUNs are deleted– Do not defrag

Additional Disk Drives

“Test & Dev Pool 2”


Traditional vs. Thin LUNs

Use RAID Groups and traditional LUNs

When microseconds of performance matters

For the best and most predictable performance

For precise data placement

You are not as concerned about space efficiency

Use Virtual Provisioning with Thin Pools and Thin LUNs

When the best space efficiency is needed

For minimal host impact

When energy and capital savings are paramount

For applications where space consumption is difficult to forecast


Lesson Summary

Key points covered in this module:

Virtual Provisioning

Thin vs. Traditional LUNs

Benefits of Virtual Provisioning


Module Summary

Key points covered in this module:

Virtualization technologies and forms

SNIA storage virtualization taxonomy

Storage virtualization configuration

Storage virtualization challenges

Types of storage virtualization

Virtual provisioning overview


Check Your Knowledge

What are the four forms of virtualization?

Difference between in-band and out-of-band implementation.

What are the challenges of storage virtualization?

What is virtual provisioning?

© 2009 EMC Corporation. All rights reserved.

Cloud Storage InfrastructureCloud Storage Infrastructure


Challenges with Traditional Storage Approach

Not designed to scale in the multi-petabyte – Addition of new arrays for capacity enhancement

Cost and management overhead Increased time to market

Can address transactional and distributed computing – But fell short for Internet Era requirements

– Designed for Operation Within IT’s Walls


Cloud Storage Infrastructure: The Big Picture

To deal with Internet Era data growth– A massively scalable infrastructure is required

– One that offers global data distribution, self-healing, self-management, and multi-tenancy features

A Cloud approach to storage– A cost effective approach to handling internet era data growth

– Focusing on five key infrastructure requirements Infinite Scale No Boundaries Operationally Efficient Self-Management Self-Healing


Use of Cloud Computing Resources

“Cloud computing” takes hold as 69% of all internet users have either stored data online or used a web-based software application

Source: “Use of Cloud Computing Applications and Services”, Pew Internet & American Life Project, 9/12/2008


Defining Cloud Computing

“Cloud Computing is an emerging IT development, deployment and delivery model, enabling real-time delivery of products, services and solutions over the Internet (i.e. enabling cloud services)”

Services include– Software-as-a-Service (SaaS)

– Storage-as-a-Service (Staas)

– Computing-as-a-Service (CaaS)

– Hardware-as-a-Service, Data-as-a-service……

Examples:– Amazon: Elastic Compute Cloud (EC2), Simple Storage Services (S3)

– Google Apps

– Storage Cloud - Decho (Mozy Online Backup), EMC Atmos

– Salesforce.com……

Source: IDC, “Defining “Cloud Services” and “Cloud Computing”, September 2008


Cloud Services:

In cloud execution – Offsite, provided by third-party

Accessed via Internet – Not bound to corporate/private

network

Minimal/no IT skills to “implement” – Users need not have expertise

Provisioning – Self-requesting

Pricing – Fine-grained & usage-based

pricing capability

User Interface – Simple, not tied to any specific

device/platform

System Interface– Web based standard framework

Shared resources– Shared asset approach

Source: IDC, “Defining “Cloud Services” and “Cloud Computing”, September 2008


Cloud Applications

Enterprise Solutions– Transactional data or high performance file sharing applications

Example: Amazon EC2

– Cloud storage infrastructure Example: EMC Atmos

End-user Solutions – Rich Internet applications and online service providers

Examples: Social media sites, Online photo sharing

– Online data backup Example: Mozy online backup

Documents

Storage Virtualization