Solving capacity-crisis-2012-aug-v2

Solving the Storage Capacity

Crisis – Tools And Practices

For Effective Management

Tony PearsonIBM Master Inventor and Senior Managing [email protected]

Interactivity Tips

1. Ask A Question

2. Download a PDF copy of today’s presentation

3. Social Networking Tools

About the Speaker

Mr. Tony Pearson

Master Inventor,

Senior Managing Consultant

IBM System Storage

Tony Pearson is a Master Inventor and Senior managing consultant for the IBM System Storage™ product line. Tony joined

IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics covering the entire System Storage product line, Tivoli storage software products, and topics related to Cloud

Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization products.

Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1

most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through IV.

Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in

Electrical Engineering, both from the University of Arizona. Tony holds 19 IBM patents for inventions on storage hardware and software products.

9000 S. Rita RoadBldg 9070 Mail 9070Tucson, AZ 85744

+1 520-799-4309 (Office)

[email protected]

Tony Pearson

Master Inventor, Senior Managing Consultant

IBM System Storage™

Marketing Promotion

• The problems that used to keep storage managers awa ke at night – power, cooling and physical footprint – are being successfu lly addressed by technology, but a more vexing issue still remains: How to get more out of the limited supply of skilled storage management pr ofessionals.

• Demand for storage capacity continues to grow far f aster than the pool of people to manage it. With no end in sight to data g rowth, businesses need to apply technology and practices that distribute m anagement responsibility to the people who need storage, and multiply the vo lumes of storage that skilled professionals can handle.

• In this presentation, IBM Master Inventor Tony Pearson b rings you up to speed on the best practices and new tools that are enabling leaps in productivity. He outlines a three-pronged approach to solving the storage capacity crisis:

– Abandon the Craftsman Approach. Storage administrat ors need to discard some long-held myths about storage management and adopt new ways of thinking that enable them to handle significantly greater capacit y.

– Adopt software tools. Computers can now provide unp recedented guidance on storage optimization so that people don’t have to. Policy-based management, smart provisioning and automated tiering are among t he innovations that are powering leaps in productivity.

– Consider self-service portals. Companies are now exp loring the self-service capabilities of private and public clouds. However, organizations need to adopt policies and limits in place to create an atmospher e of trust that enables efficient self-provisioning for storage.

The Information Challenge

5

Pharma

Telco

Government

Retail

Finance

…industries need to harness this data todeliver better and faster business outcomes

Digital Information is Driving

Exponential Growth in Data

Churn100K records/sec 9B/day10 ms/decision

Drug, TreatmentMillions of SNPs1000’s patientsFrom weeks to days

Risk, StabilityPBs of dataDeeper analysisNightly to hourly

Cyber Security600,000 docs/sec50B/day1-2 ms/decision

Consumer Insight100Ms documentsMillions of InfluencersDaily re-analysis

6

The Impact of Growth is Being Felt

� Structured data growing at 32%(databases for transactional workloads)

� Unstructured data growing at 63%(such as user files, medical images, web and rich media content)

� Replicated data growing at 49%(including backup, archive, discovery and business continuance)

Sources: IDC worldwide enterprise disk in Exabytes from “Changing Enterprise Data Profile”, December 2007

Replicated dataUnstructured dataTraditional Structured data

25.0

20.0

15.0

10.0

5.0

Exabyte

s

Information Infrastructure is doubling every 18 mon ths…

7

Source: TheInfoPro Storage Study (Q4 2009), n=186. *Note that due to multiple responses per interview, total exceeds100%. This is a partial list of responses received, showing only the top 5 issues.

Managing Complexity

Backup Administrationand Management

Managing Costs

Proper Capacity Forecastingand Storage Reporting

Managing Storage Growth

0% 20% 40% 60%

Top Issues for Storage Managers

Clients are Struggling to Keep Up

8

A Fundamental Shift in Costs

New IT Hardware Spend

IT Power and Cooling

Management and Administration

Hardware is cheaper…but administration isn’t

Source: IDC, 2012

9

Agenda

Abandon the Craftsman Approach

Leverage Software Tools for Automation

Consider Self-Service Portals

10

Long-held Myths of Storage

• End users should dictate which storage their data resides on

• Mission Critical apps must be hand placed on…

– Block storage, not NAS– RAID1, not RAID5/6– 15K RPM drives, not 10K or

7200 RPM drives– Outer edges of the rotating disk

• If Tier 1 storage is good enough for Mission Critical apps, it’s good for all other data also

11

Four Fundamental Truths Basis for Information Lifecycle Management

• All data, when created, does not have equal value

• Information changes in business value and in service level requirements over time

• IT resources should be allocated according to the value of data

• Information must be managed throughout its entire lifespan …data outlives media

0

20

40

60

80

100

1 w 2 w 3 w 4 w 3 m 6 m 9 m 1 yr 2 yr 5 yr 10 yr

Da

ta V

alu

e

Age of Data

Machine data

Email

EMR

Database

Surveillance Video

12

Mission Critical

Business Critical

Business Operational

General Business

app/data type

Platinum Gold Silver Bronze

app/data type

app/data type

app/data type

app/data type

app/data type

Service Level Agreements

• Align business requirements to 3-5 Information Classes

• Establish policies to map Information Classes to Service Level Agreements

• Deploy well-differentiated Tiers of Storage that satisfy these Service Level Agreements

Tiers of Storage

13

Automate Data Placement and

MigrationIBM Active Cloud Engine™

Initial placement

SAS

NL-SAS

180 days

30 days

File creation

IBM SONAS orStorwize V7000 Unified

Optional TSM/HSMServer & Virtual or Physical Tape Pool

14

15

Automated Sub-Volume Tiering

� IBM Easy Tier– Automatic movement of sub-volume extents

between SSD, SAS and NL-SAS media

– Small amount of SSD can provide huge

performance gains

– Up and down tier

– Available on various IBM storage products

– DS8000

– SAN Volume Controller (SVC)

– Storwize V7000

– Transparent to applications

SSD RAID Array(s)

FC/SAS RAID Array(s)

SATA/NL RAID Array(s)

15

16

Application

Transactions

Easy Tier

Learning

Easy Tier

In Action

240% from

Original

brokerage

transaction

Easy Tier Application Transaction

Improvement

�No change to the database or application

�No work to identify active indexes

�No manual movement of files or volumes

� Just turn it on and let it work!

16

17

• I/O Priority Manager aligns service levels to separate workloads in the system–Administrators select from 4

Performance Groups (service levels) to assign to each workload

–System resources are dynamically allocated to higher priority volumes during resource contention

I/O Priority Manager (QoS)

Performance when and where you need it -- DS8000 and XIV Gen3

Performance when and where you need it -- DS8000 and XIV Gen3

17

Agenda




18

Embrace Automation

• How are you spending your time?

– Spreadsheets to track your storage assets?

– VISIO diagrams of storage fabric connections?

– Writing scripts that you run only once?

– Fighting fires?– Making reports pretty for

upper management?

19

Different Perspectives

Device Perspective:Looking at storage environment from the device level, for performance and replication functions

Data Perspective:Looking at storage environment from the host level, for data stored in file

systems and databases

Fabric Perspective:Looking at storage environment from the

fabric level, how it all gets connected together

20

IBM’s “Single Pane of Glass”

Strategy

Small CompanyNo formal IT dept� IT managed by

non-IT personnel� Manage a few

storage devices Medium-Size CompanyCentralized IT Dept� IT managers handle

servers, storage, networks, backups and perhaps even databases

Large EnterpriseData Center Ops� Server Admins� Network Admins� Storage Admins

Browser-based GUI for each

storage device

Storage Control Plug-in

IBM Tivoli Storage Productivity Center

21

Virtualize Your Infrastructure

22

Virtual Server

Infrastructure

Virtual Storage

InfrastructureStorage Hypervisor

Midrange

Storwize V7000Enterprise

SAN Volume ControllerTivoli Storage Productivity

Center

22

TPC 5.1 - Single dashboard for the SAN

Hover-over health status for individual components

Aggregated health status for all components in group

Hyperlinks for fast navigation

Bread-crumb trail navigation

Clear and simple to use hover-over menu items

NEW!

23

Performance at a Glance

Display resources associated with this data path

Icon based navigation

View backend device performance as part of your day to day dashboard

Quick access to alerts for devices

� Near real-time monitoring

� View performance data for all components

� Discover Bottlenecks

� Reduce time to problem isolation and resolution

24

Tivoli Common Reporting

Enhanced with Cognos

• Data Abstraction- Modeled Tivoli data makes report creation/customization simple for customers

• Simplified report editing- Run an out-of-the-box report, and launch the editor in context to make changes

• Ad-Hoc Reporting- Novice users can rapidly create reports with intuitive drag & drop function via the Query Studio

• Other capabilities- e-mailing of reports- Additional report formats (XML, CSV)- Greater granular data security- And more...

Brings industry leading reporting suite to Tivoli customers at no additional charge

25

Datacenter Tiering

� Policy-driven Information Lifecycle Management (ILM)

– Leveraging virtualization technology to provide recommendations for storage re-location

– Based on file system level data, performance and capacity utilization

– Developed by IBM Research and has been deployed by IBM GTS to manage storage assets

� Benefits– Ensures only highest performing

workloads are allocated to most expensive storage

– Enterprise wide datacenter storage tiering solution complementary to Easy Tier technology

High

Capacity

HDD

High

Performance

HDD

SSD

LUNs

Storage

pools Tier 1Tier 0 Tier 2

26

IBM Tivoli Storage Productivity Center family

• Gain comprehensive insights for improved service delivery

• Understand your environment from the device, fabric and host perspective

• Manage SAN through policy-driven recommendations

• Analyze your environment against SAN best practices

• Establish and achieve storage service level agreements

• Performance thresholds and fault alerting enable proactive management

• Optimize resource utilization for enhanced return on storage investments

• Intelligent migration of data to balance performance with costs

27

Agenda




28

What if IT were like a Vending

Machine?

• IT staff stocks the machine with standard offerings

– Based on information class and service level agreements

– Proactive management

• Business units choose the right offering based on their needs and budget

– Self-service– Pay-per-use

29

IBM’s Intelligent Storage Service

Catalog (ISSC)

• Unique demand-based approach to storage

– Analyze usage into 15-20 standard data types

– Define key performance indicators (KPI)

– Enable storage governance

• Client Benefits– Increases storage utilization – Simplifies storage allocation

processes– Implements enforceable

standards

30

IBM SmartCloud Enterprise

• Self-service access to storage

– Desktop, Laptop or Mobile

– Shared and Individual folders

• Use IBM’s public cloud storage, or your own storage on premises

IBM SmartCloudObject Storage

Windows, Mac,iPad, iPhone, Android

CIFS, NFS

Public Cloud

Private Cloud

31

Summary

• Cost associated with managing and administering storage has become the largest part of IT budgets

• IT staff need to abandon the craftsman approach, and leverage software automation to meet business requirements

• Consider self-service and pay-per-use delivery models to standardize offerings

32

Thank You

Q & A

Additional Resources

35

Email:[email protected]

Twitter:http://twitter.com/az99Øtony

Blog: http://ibm.co/brAeZØ

Books:http://www.lulu.com/spotlight/99Ø_tony

IBM Expert Network:http://www.slideshare.net/az99Øtony

35

Trademarks and disclaimersAdobe, the Adobe logo, PostScript, and the PostScri pt logo are either registered trademarks or tradema rks of Adobe Systems Incorporated in the United Sta tes, and/or other countries. IT Infrastructure Library is a register ed trademark of the Central Computer and Telecommun ications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel I nside logo, Intel Centrino, Intel Centrino logo, Cel eron, Intel Xeon, Intel SpeedStep, Itanium, and Pen tium are trademarks or registered trademarks of Intel Corporation or its s ubsidiaries in the United States and other countrie s. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windo ws NT, and the Windows logo are trademarks of Micro soft Corporation in the United States, other countr ies, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Offi ce. UNIX is a registered trademark of The Open Group in the Unite d States and other countries. Java and all Java-bas ed trademarks and logos are trademarks or registere d trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc . in the United States, other countries, or both an d is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ult rium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

Other product and service names might be trademarks of IBM or other companies. Information is provide d "AS IS" without warranty of any kind.

The customer examples described are presented as il lustrations of how those customers have used IBM pr oducts and the results they may have achieved. Actu al environmental costs and performance characteristics may vary by customer.

Information concerning non-IBM products was obtaine d from a supplier of these products, published anno uncement material, or other publicly available sour ces and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance num bers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM h as not tested these products and cannot confirm the accuracy of performance, capability, or any other c laims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the suppli er of those products.

All statements regarding IBM future direction and i ntent are subject to change or withdrawal without n otice, and represent goals and objectives only.

Some information addresses anticipated future capab ilities. Such information is not intended as a defin itive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presen ted here to communicate IBM's current investment and developmen t activities as a good faith effort to help with ou r customers' future planning.

Performance is based on measurements and projection s using standard IBM benchmarks in a controlled env ironment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user' s job stream, the I/O configuration, the storage co nfiguration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve thro ughput or performance improvements equivalent to th e ratios stated here.

Prices are suggested U.S. list prices and are subje ct to change without notice. Starting price may not include a hard drive, operating system or other fe atures. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Photographs shown may be engineering prototypes. Ch anges may be incorporated in production models.

© IBM Corporation 2012. All rights reserved.References in this document to IBM products or serv ices do not imply that IBM intends to make them ava ilable in every country.

Trademarks of International Business Machines Corpo ration in the United States, other countries, or bot h can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml .

ZSP03490-USEN-00

36

Technology

Solving capacity-crisis-2012-aug-v2