Configuring DS6KDS8K for Opt Perf

Embed Size (px)

Citation preview

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    1/63

    IBM Systems and Technology Group

    Las Vegas, NV

    P03

    Rosemary McCutchen

    Configuring DS6000 and DS8000 for Optimal Performance

    July 24 - 28, 2006

    IBM Corporation 2006

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    2/63

    2006 IBM Corporation

    IBM TotalStorage

    TrademarksThe following terms are trademarks of International Business Machines Corporation in the United

    States, other countries or both.

    AS/400, DS6000, DS8000, DS Storage Manager, Enterprise Storage Server, FICON, FlashCopy,GDPS, IBM, iSeries, pSeries, RS/6000, RMF, IBM TotalStorage, VM/ESA, VSE/ESA, xSeries, z/OS,zSeries, z/VM, On Demand Business

    Intel and Pentium are trademarks of Intel Corporation in the United States, other countries, or both.

    Microsoft, Windows and Windows NT are trademarks of Microsoft Corporation in the United States,

    other countries, or both.

    Other company, product, or service names may be trademarks or service marks of others.

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    3/63

    2006 IBM Corporation

    IBM TotalStorage

    DisclaimerCopyright 2006 by International Business Machines Corporation.

    No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation.

    Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. Thisinformation could include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s)and/or programs(s) at any time without notice. Any statements regarding IBM's future direction and intent are subject to change or

    withdrawal without notice, and represent goals and objectives only.

    References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs orservices available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is

    not intended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringeIBM's intellectually property rights, may be used instead. It is the user's responsibility to evaluate and verify the operation of any on-IBMproduct, program or service.

    THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED.

    IBM EXPRESSLY DISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE ORNONINFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and

    conditions of the agreements (e.g., IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement,etc.) under which they are provided. IBM is not responsible for the performance or interoperability of any non-IBM products discussedherein.

    The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or

    copyrights. Inquiries regarding patent or copyright licenses should be made, in writing, to:

    IBM Director of LicensingIBM CorporationNorth Castle Drive

    Armonk, NY 10504-1785U.S.A.

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    4/63

    2005 IBM Corporation

    Configuring the DS6000/DS8000 forOptimal Performance

    Rosemary McCutchenCertified Consulting IT SpecialistIBM Advanced Technical Support

    [email protected]

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    5/63

    2006 IBM Corporation5 Information On Demand |Information Assets and Systems

    Objectives

    Understand DS8000 and DS6000 hardware performance characteristics

    Understand logical configuration considerations related to performance

    Understand principles of DS performance optimization

    Isolation Resource sharing

    Spreading

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    6/63

    2006 IBM Corporation6 Information On Demand |Information Assets and Systems

    DS8000 Hardware Performance Considerations

    Front-end performance considerations

    I/O ports Host adapters (HAs)

    I/O enclosures

    Servers (processors and memory)

    Backend performance considerations

    Ranks (and array type)

    Device Adapter (DA) pairs

    Servers (processors and memory)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    7/63

    2006 IBM Corporation7 Information On Demand |Information Assets and Systems

    One server I/O loop

    Maximum of 4 DA pairs

    Order of installation of disks onDA pairs

    2,0,3,1,2,0

    64-disk increments

    Disks ordered per frame

    Larger disks installed first

    Fully-populated 921

    384 disks

    DA2 and DA0 - 128 disks each

    DA1 and DA3 - 64 disks each

    921 with 256 disks

    Balanced configuration

    Uses all 4 DA pairs equally

    2107 Model 921 Disk Enclosures & Device Adapter Pairs

    DA2

    DA0

    DA2

    DA0

    DA3

    DA1

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    8/63

    2006 IBM Corporation8 Information On Demand |Information Assets and Systems

    2107 Model 922 Disk Enclosures and Device Adapter Pairs

    2 server I/O loops

    Maximum of 8 DA pairs

    Order of installation of disks onDA pairs

    2,0,6,4,7,5,3,1,2,0

    64 disk increments

    Disks ordered per frame

    Larger disks installed first

    Fully-populated 922

    640 disks

    DA2 and DA0 - 128 disks each

    Other DA pairs 64 disks each

    922 with 512 disks

    Balanced configuration

    Uses all 8 DA pairs equally

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    9/63

    2006 IBM Corporation9 Information On Demand |Information Assets and Systems

    Storage Image 1(B)

    1 server I/O loop

    Maximum of 4 DA pairs

    Installation order of disks

    on DA pairs 0,4,5,1,0

    Balanced configuration

    256 disks (4 DAs)

    2107 Model 9A2 Disk Enclosures & Device Adapter PairsStorage Image 2(A)

    1 server I/O loop

    Maximum of 4 DA pairs

    Installation order ofdisks on DA pairs

    2,6,7,3,2

    Balanced configuration

    256 disks (4 DAs)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    10/63

    2006 IBM Corporation10 Information On Demand |Information Assets and Systems

    DS8000 Application Performance Accelerator RPQ

    For workloads requiring high bandwidthbut not a large number of disk drives

    Normally, 64 disks required per DA pairbefore adding next DA pair

    RPQ requires only 32 disks per DA pair

    Currently DS8300 model 922 A+Bframes only

    Allows use of more device adapters to

    achieve higher bandwidth for a givenamount of disk capacity

    Base Frame (A) Exp. Frame (B)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    11/63

    2006 IBM Corporation11 Information On Demand |Information Assets and Systems

    2107 Model 921 & 922 I/O Enclosures & I/O Ports (Base Frame)

    Slot 0 1 2 3 4 5 0 1 2 3 4 5

    For high performanceconnections, 2 I/O portsper FCP/FICON Host

    Adapter recommended z/OS FICON

    Express2 to DS ratioof 1:1recommended

    z/OS FICON Expressto DS ratio of 2:1 may

    be acceptable

    For 2107 with all I/Oenclosures in use

    Left enclosures (0,2)

    are closer to server0 Right enclosures

    (1,3) are closer toserver1

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    12/63

    2006 IBM Corporation12 Information On Demand |Information Assets and Systems

    2107 Models 921 & 922 Host Adapter Installation Order (Base Frame)

    15

    1 2

    3 4

    5 6

    7 8

    9 10

    11 12

    13 14

    16

    Host adapter

    installation sequenceis shown by numbers1-16

    With an odd numberof host adapters,there will be anadditional adapter ina left (server0)enclosure

    DAs will not be in useif associated disks

    are not installed

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    13/63

    2006 IBM Corporation13 Information On Demand |Information Assets and Systems

    2107 Model 922 I/O Enclosures & I/O Ports (1st Expansion Frame)

    Slot 0 1 2 3 4 5 0 1 2 3 4 5

    For high performanceconnections, 2 I/Oports per FCP/FICON

    Host Adapterrecommended

    z/OS FICONExpress2 to DS ratioof 1:1recommended

    z/OS FICON

    Express to DS ratioof 2:1 may beacceptable

    For 2107 with all I/Oenclosures in use

    Left enclosures arecloser to server0

    Right enclosures arecloser to server1

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    14/63

    2006 IBM Corporation14 Information On Demand |Information Assets and Systems

    15

    1 2

    3 4

    5 6

    7 8

    9 10

    11 12

    13 14

    16

    2107 Model 922 HA Installation Order (1st

    Expansion Frame)

    Host adapter

    installation sequenceis shown by numbers1-16

    With an odd numberof host adapters,

    there will be anadditional adapter in

    a left (server0)enclosure

    DAs will not be in use

    if associated disksare not installed

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    15/63

    2006 IBM Corporation15 Information On Demand |Information Assets and Systems

    I/O enclosures 0 and 1are dedicated to Storage

    Image 1

    I/O enclosures 2 and 3

    are dedicated to StorageImage 2

    Storage Images mayhave different number ofHAs installed

    2107 Model 9A2 I/O Enclosures & I/O Ports (Base Frame)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    16/63

    2006 IBM Corporation16 Information On Demand |Information Assets and Systems

    2107 Model 9A2 Host Adapter Installation Order (Base Frame)

    7

    1 2

    1 2

    3 4

    3 4

    5 6

    5 6

    7 8

    8

    Host adapterinstallation sequence

    is independent foreach Storage Image

    Shown by

    numbers 1-8

    With an odd numberof host adapters,there will be anadditional adapter in

    the left (server0)enclosure

    DAs will not be in useif associated disksare not installed

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    17/63

    2006 IBM Corporation17 Information On Demand |Information Assets and Systems

    I/O enclosures 4and 5 are dedicatedto Storage Image 1

    I/O enclosures 6and 7 are dedicatedto Storage Image 2

    Storage Imagesmay have differentnumber of HAs

    installed

    2107 Model 9A2 I/O Enclosures & I/O Ports (1st Expansion Frame)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    18/63

    2006 IBM Corporation18 Information On Demand |Information Assets and Systems

    7

    1 2

    1 2

    3 4

    3 4

    5 6

    5 6

    7 8

    8

    Host adapterinstallation is

    independent for eachStorage Image

    Shown bynumbers 1-8

    With an odd numberof host adapters,

    there will be anadditional adapter ina left (server0)enclosure

    DAs will not be in useif associated disksare not installed

    2107 Model 9A2 HA Installation Order (1st Expansion Frame)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    19/63

    2006 IBM Corporation19 Information On Demand |Information Assets and Systems

    2107 Model 922 8-Host Adapter Ordering Option (Recommended)

    5

    ____

    0

    ____

    1 2

    X___

    3

    ____

    4 5

    X___

    0

    ____

    1 2

    ____

    3

    ____

    4

    5

    __

    __0

    __

    __1 2

    X_

    __3

    __

    __4 5

    X_

    __0

    __

    __1 2

    __

    __3

    __

    __4

    5

    ____

    0

    ____

    1 2

    X___

    3

    ____

    4 5

    X___

    0

    ____

    1 2

    ____

    3

    ____

    4

    5

    __

    __0

    __

    __1 2

    X_

    __3

    __

    __4 5

    X_

    __0

    __

    __1 2

    __

    __3

    __

    __4

    I/O Enclosure 1

    I/O Enclosure 2 I/O Enclosure 3

    I/O Enclosure 0 I/O Enclosure 4 I/O Enclosure 5

    I/O Enclosure 6 I/O Enclosure 7

    DA2

    DA2

    DA3

    DA0

    DA1

    DA4

    DA5

    DA5

    DA6

    DA7

    DA7

    DA6

    DA0

    DA1

    DA3

    DA4

    4 adapters in base frame and 4 adapters in expansion frame

    This is the most conservative approach for Host Adapter performance

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    20/63

    2006 IBM Corporation20 Information On Demand |Information Assets and Systems

    2107 Model 9A2 8-Host Adapter Ordering Option (Recommended)

    2 adapters in base frame and 2 adapters in expansion frame for each Storage Image

    Image 1 Image 2

    This is the most conservative approach for Host Adapter performance

    5

    __

    __0

    __

    __1 2

    X_

    __3

    __

    __4 5

    X_

    __0

    __

    __1 2

    __

    __3

    __

    __4

    5

    _

    _

    __0

    _

    _

    __1 2

    X

    _

    __3

    _

    _

    __4 5

    X

    _

    __0

    _

    _

    __1 2

    _

    _

    __3

    _

    _

    __4

    5

    __

    __0

    __

    __1 2

    X_

    __3

    __

    __4 5

    X_

    __0

    __

    __1 2

    __

    __3

    __

    __4

    5

    _

    _

    __0

    _

    _

    __1 2

    X

    _

    __3

    _

    _

    __4 5

    X

    _

    __0

    _

    _

    __1 2

    _

    _

    __3

    _

    _

    __4

    I/O Enclosure 1

    I/O Enclosure 2 I/O Enclosure 3

    I/O Enclosure 0 I/O Enclosure 4 I/O Enclosure 5

    I/O Enclosure 6 I/O Enclosure 7

    DA

    2

    DA

    2

    DA

    3

    DA

    0

    DA

    1

    DA

    4

    DA

    5

    DA

    5

    DA

    6

    DA

    7

    DA

    7

    DA

    6

    DA

    0

    DA

    1

    DA

    3

    DA

    4

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    21/63

    2006 IBM Corporation21 Information On Demand |Information Assets and Systems

    DS8000 Memory Considerations

    Processor memory

    System memory (Cache)

    Primarily affects read performance

    Persistent memory (NVS)

    Primarily affects write performanceDS8000 persistent memory scales with processor memory size

    4GB128GB

    2107 Models 922/9A2 only8GB256GB

    2GB64GB

    1GB32GB

    2107 Model 921 only1GB16GB

    SupportPersistent MemoryProcessor Memory

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    22/63

    2006 IBM Corporation22 Information On Demand |Information Assets and Systems

    DS6000 Hardware Performance Considerations

    Front-end performance considerations

    I/O ports Host adapters

    Servers (processors and memory)

    Back-end performance considerations

    Ranks (and array type)

    Loops

    Servers (processors and memory)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    23/63

    2006 IBM Corporation23 Information On Demand |Information Assets and Systems

    DS6000 IRC Host Adapters & I/O Ports

    Two 4-port

    FCP/FICON

    HAs

    I0100 I0101 I0102 I0103

    L0 L0

    L0 L0

    L1 L1

    L1 L1

    I0000 I0001 I0002 I0003

    Server0

    Server1

    Each host adapter communicates with either server0 or server1

    For availability, each z/OS or open systems host server should have 2connections (one to each DS6000 host adapter)

    For open systems, Subsystem Device Driver Preferred Path will optimizeperformance

    For remote mirroring, two dedicated I/O ports are recommended (one oneach DS6000 host adapter)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    24/63

    2006 IBM Corporation24 Information On Demand |Information Assets and Systems

    DS6000 Preferred Path

    The preferred path function optimizessequential read performance

    The preferred path function will direct:

    I/O for LUNs 0000-3 to HBA 0

    I/O for LUNs 0100-3 to HBA 1

    The preferred path function is included in:

    the IBM Subsystem Device Driver

    z/OS operating system

    0000 0001

    0100 0101

    0002 0003

    0102 0103

    Server0

    Server1

    AIX1

    HBA 0

    HBA 1

    I/O portsAIX1 LUNs

    AIX1 LUNs

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    25/63

    2006 IBM Corporation25 Information On Demand |Information Assets and Systems

    DS6000 IRC Device Adapter and Disk Loops

    One

    DA Pair

    (DA0)

    Loop 0 Loop 1

    I0100 I0101 I0102 I0103

    L0 L0

    L0 L0

    L1 L1

    L1 L1

    I0000 I0001 I0002 I0003

    Server0

    Server1

    DS6000 DA pair connects to both servers and both disk loops

    Expansion units are connected to either Loop 0 or Loop 1

    IRC is internally connected to Loop 0

    Each disk loop is connected to both server0 and server1

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    26/63

    2006 IBM Corporation26 Information On Demand |Information Assets and Systems

    DS6000 Disk Enclosures and Loops

    Each block represents one 4-DDMarray site

    Recommended order of installation of

    disk enclosures on loops

    0 (IRC),1,1,0,1,0,1,0

    IRC disks are internally connected to

    Loop 0

    Balanced configuration with oddnumber of EX1s

    Loop 1 will support more disks thanLoop 0 if there is an even number ofEX1s

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    27/63

    2006 IBM Corporation27 Information On Demand |Information Assets and Systems

    Logical Configuration Considerations for Performance

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    28/63

    2006 IBM Corporation28 Information On Demand |Information Assets and Systems

    Array Considerations

    RAID type

    RAID5 and RAID10 arrays perform equally for read

    RAID5 array performs better for sequential write

    RAID10 array performs better for random write

    DS6000 Array size

    8-DDM arrays are recommended unless there is a specific requirement for 4-DDMarrays

    Sparing

    Arrays without spares may mean better potential random performance

    Array capacity should be confirmed after array creation

    Array types (with spares and without spares) should be balanced across server0 andserver1 (when ranks are assigned to extent pools)

    DS8000 - minimum of 4 spares per DA (64 or 128 disks) (single disk type)

    DS6000 - minimum of 2 spares per 64 disks (single disk type0

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    29/63

    2006 IBM Corporation29 Information On Demand |Information Assets and Systems

    2107 Model 922 RAID5 Example (Single Disk Type)

    Each block representsone 8-DDM RAID5 array

    Minimum of 4 spares perDA

    First 4 arrays createdon DA contain spares

    Single disk type example

    Mixed disk types orRAID types may resultin creation of more 6+Parrays

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    30/63

    2006 IBM Corporation30 Information On Demand |Information Assets and Systems

    DS6000 RAID5 Example (Single Disk Type)

    Each block represents one 8-DDMRAID5 array

    Minimum of 2 spares per 64 DDMs

    Spares are assigned to array sites

    and remain with those array sites,whether an array is created or not

    Not necessarily on IRC and 1st

    EX1 as shown

    Array capacity should beconfirmed after creation

    Single disk type example

    Mixed disk types may result inmore 6+P arrays

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    31/63

    2006 IBM Corporation31 Information On Demand |Information Assets and Systems

    Rank Considerations

    A rank (and the underlying RAID array and array site) has no relationshipto server0 or server1 until after it has been assigned to an extent pool

    Rank ID (Rx) does not indicate a server association unless specificallyconfigured to do so

    Ranks should be assigned to server0 and server1 extent pools in abalanced manner

    Ranks built on arrays containing spares should be balanced acrossserver0 and server1 extent pools

    DS8000 ranks built on array sites associated with each Device Adapter

    should be balanced across server0 and server1 extent pools

    DS6000 ranks built on array sites associated with each disk loopshould be balanced across server0 and server1 extent pools

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    32/63

    2006 IBM Corporation32 Information On Demand |Information Assets and Systems

    2107 Model 922 Ranks Balanced Across Servers Example

    Each block representsone 8-DDM rankassigned to an extent

    pool

    Ranks on each DA arebalanced across server0and server1extent pools

    Ranks with spares arebalanced across server0and server1 extent pools

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    33/63

    2006 IBM Corporation33 Information On Demand |Information Assets and Systems

    DS6000 Ranks Balanced Across Servers Example

    Each block represents one 8-DDMrank assigned to an extent pool

    Ranks on each loop are balancedacross server0 and server1 extentpools

    Ranks with spares are balancedacross server0 and server1 extentpools

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    34/63

    2006 IBM Corporation34 Information On Demand |Information Assets and Systems

    Extent Pool Considerations

    Single-rank extent pools are recommended unless there is aspecific requirement for multi-rank extent pools

    Single-rank extent pools make it easier to map volumes to ranksand achieve uniform performance for volumes

    Extent pools should be balanced across server0 and server1

    Ranks should be assigned to server0 extent pools and server1extent pools in a balanced manner

    Volumes should be allocated from server0 extent pools andserver1 extent pools in a balanced manner

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    35/63

    2006 IBM Corporation35 Information On Demand |Information Assets and Systems

    Multi-Rank Extent Pool Considerations

    All extents for a volume are allocated onone rank if possible

    May change in the futureNo striping of extents for a single volume

    across multiple ranks

    Volume may spill across ranks if notenough extents are available on one rank

    Volume may be larger than a single rank

    Each new volume is allocated on the rankwith the most free extents

    May change in the future

    Standard volume size will result in roundrobin allocation of volumes across ranks

    Same LSS will be used on multiple ranks

    DSCLI showfbvol, showckdvol &showrankcommands may be used tomap volumes to ranks

    Rank R2

    Rank R0

    2 A 1 0

    2 A 1 1

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    36/63

    2006 IBM Corporation36 Information On Demand |Information Assets and Systems

    Logical Subsystem/Logical Control Unit Considerations

    For open systems, LSSs do not directly affect application performance

    For z/OS, more LCUs will provide additional addresses for PAVs which canimprove performance

    One or more unique LSS/LCU IDs consistently associated with a specific rankand DA or application may simplify performance analysis

    Using one LSS/LCU across multiple ranks

    Allows cross-rank copy services consistency grouping

    May make performance analysis more complex

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    37/63

    2006 IBM Corporation37 Information On Demand |Information Assets and Systems

    Logical Subsystem/Logical Control Unit Options

    1.One unique LSS/LCU per rank

    Simplifies management

    2.Multiple LSSs/LCUs on one rank

    Provides more addresses (& PAVs) forrank

    Allows utilization of large drives withsmall volumes

    3.One LSS/LCU on multiple ranks

    Enables cross-rank Copy Servicesconsistency group

    This will be typical for DS8000 multiple-rank extent pools

    May make management more complex

    00

    2A

    2A

    01

    2B

    2B

    Server0 Server1

    Ranks/Pools Ranks/Pools

    12 14 16 18 13 15 17 19

    or

    13 2312 22

    15 2514 24

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    38/63

    2006 IBM Corporation38 Information On Demand |Information Assets and Systems

    Logical Volume Considerations

    Volume size

    Volume size does not necessarilyaffect performance

    For open systems, for a given amount of capacity, choose a volume sizesmall enough to allow volumes to be spread appropriately across all ranksavailable to an application workload

    For z/OS, larger volumes may require more aliases (PAVs)

    Volume placement

    Logical volume placement on ranks, DAs (DS8000), loops (DS6000) andservers (server0 and server1) has a significant effect on performance

    Logical volumes for each application workload should be allocatedaccording to isolation, resource sharing and spreading principles

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    39/63

    2006 IBM Corporation39 Information On Demand |Information Assets and Systems

    z/OS Parallel Access Volumes (PAVs) Considerations

    A successful IBM 2105 PAV strategy should also work well with the DS8000 and DS6000

    Larger volumes require sufficient PAVs

    Use dynamic PAVs and z/OS workload manager (WLM) if possible

    Use the z/OS PAV Analysis Tool to analyze PAV use in existing systemswww.ibm.com->Servers ->mainframe->support->downloads->z/OS->z/OS Unix tools and toys

    orhttp://www-03.ibm.com/servers/eserver/zseries/zos/unix/bpxa1ty2.html

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    40/63

    2006 IBM Corporation40 Information On Demand |Information Assets and Systems

    Principles of DS Performance Optimization

    Allocation of logical volumes and host connections for an application workload

    Isolation

    Resource sharing

    Spreading

    These principles are described in detail in Chapter 4 (4.1-4.3) of

    IBM TotalStorage DS8000 Series: Performance Monitoring and Tuning SG24-7146.

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    41/63

    2006 IBM Corporation41 Information On Demand |Information Assets and Systems

    Workload Isolation

    Dedicating a subset of hardware resources to one workload

    Ranks

    I/O ports

    Logical volumes and host connections for the workload are isolated to thededicated resources

    Provides increased probability of consistent response time for an importantworkload, but

    Maximum potential performance limited to the set of dedicated resources

    Contention still possible for any resources which are not dedicated (e.g. processor,cache, persistent memory)

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    42/63

    2006 IBM Corporation42 Information On Demand |Information Assets and Systems

    Workload Isolation (2)

    Can prevent less important workloads with high I/O demands from impactingmore important workloads

    It may be acceptable for multiple less important, I/O intensive resources to contendwith each other on a single set of shared resources (isolated from other workloads)

    A good approach if workload experience, analysis or modeling identifies:

    A workload which tends to consume 100% of resources available

    A workload which is much more important than other workloads

    Conflicting I/O demands among workloads

    Rank level isolation may be appropriate for heavy random workloads

    DA level isolation (DS8000) may be appropriate for large blocksize, heavysequential workloads

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    43/63

    2006 IBM Corporation43 Information On Demand |Information Assets and Systems

    Workload Resource Sharing

    Multiple workloads use a common set of resources

    Ranks

    I/O ports

    Logical volumes and host connections for multiple workloads are assigned tothe shared set of resources

    Provides higher potential performance by making a larger set of resources

    available to a workload, but Possible contention for all shared hardware resources (e.g. ranks, I/O ports, Device

    Adapters as well as processors, cache and persistent memory)

    Good approach when not enough workload information is available to identifyisolation requirements

    Also good for workloads that: Will not try to consume all of the hardware available

    Peak at different times

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    44/63

    2006 IBM Corporation44 Information On Demand |Information Assets and Systems

    Workload Spreading

    Workload is balanced and distributed evenly across all allowed hardwareresources

    Applies to both isolated and resource-sharing workloads

    Logical volumes

    Logical volumes for a workload are spread across:

    Ranks Device adapters (DS8000)

    Loops (DS6000) Server0 and server1

    New logical volumes are allocated on least-used shared resources

    Additionally, host logical volume striping may be used

    Logical volume spreading exception

    Files or datasets which will never be accessed simultaneously Multiple log files for a single application may be placed on the same rank

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    45/63

    2006 IBM Corporation45 Information On Demand |Information Assets and Systems

    Workload Spreading (2)

    Host connections

    Host connections for a workload are spread across:

    I/O ports Host adapters I/O enclosures (DS8000) Server0 and Server1

    Both host adapters (DS6000)

    Left side I/O enclosures and right side I/O enclosures (DS8000) New host connections are allocated on least-used shared resources

    Additionally, multipathing software may be used

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    46/63

    2006 IBM Corporation46 Information On Demand |Information Assets and Systems

    High I/O Demand Workload Examples Large-blocksize sequential

    Logging

    Sort/work

    Business intelligence/data mining, data warehouse, decision support, Databasequeries

    Disk copies

    Backup/Restore Point-in-time Copy with background copy Remote mirror target volumes

    Tape simulation on disk Video/imaging, film rendering

    Life sciences

    Batch

    Small-blocksize random

    Mail servers OLTP

    Database

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    47/63

    2006 IBM Corporation47 Information On Demand |Information Assets and Systems

    Identifying Workloads for Isolation or Resource Sharing Review service level requirements (workload importance) and application

    history

    Analyze workload characteristics

    Read/write ratio

    Random/sequential ratio

    Average transfer size (blocksize)

    Cache hit ratio

    Average and peak workload (random I/Os, sequential MBs)

    Peak periods

    Copy services requirements

    Link utilization and throughput (host connections and remote mirroring links)

    Review the amount of capacity required (e.g. GB) and any volume size

    requirements IBM and Business Partners can access Disk Magic tool to model DS hardware

    requirements based on application characteristics

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    48/63

    2006 IBM Corporation48 Information On Demand |Information Assets and Systems

    DS8000 Examples

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    49/63

    2006 IBM Corporation49 Information On Demand |Information Assets and Systems

    DS8000 Rank Level Isolation Example

    4 workloads (B,C,D,E)share 6 DA pairs

    Each workload has 12dedicated ranks

    2 on each of theshared DA pairs

    Logical volumes for eachworkload are allocatedon its dedicated ranks onthe shared DA pairs

    Device adapters are ashared resource

    Additionally, host levelstriping may me usedacross multiple volumes

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    50/63

    2006 IBM Corporation50 Information On Demand |Information Assets and Systems

    DS8000 DA Level Isolation Example

    Workload A has 2dedicated DeviceAdapters

    DA2 and DA0 (and all

    ranks on these DAs)

    Logical volumes forworkload A are isolated tothe 32 ranks on DA2 andDA0

    The 32 ranks for workloadA are spread acrossserver0 and server1

    16 ranks assigned toserver0 extent pools

    16 ranks assigned toserver1 extent pools

    Additionally, host levelstriping may be usedacross multiple volumes

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    51/63

    2006 IBM Corporation51 Information On Demand |Information Assets and Systems

    DS8000 Rank Level Resource Sharing Example

    4 workloads (B,C,D,E)

    share 48 ranks on 6DA pairs

    Ranks for theworkloads are spreadacross DAs as well as

    server0 extent poolsand server1 extentpools

    Additionally, host levelstriping should beconsidered

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    52/63

    2006 IBM Corporation52 Information On Demand |Information Assets and Systems

    DS8000 Multiple Isolated Workloads DA Level Example

    Workloads A&B share ranksand DAs with each other butare isolated from otherworkloads

    Logical volumes forworkloads A and B areisolated to 32 ranks on DA2and DA0

    Ranks for isolatedworkloads A & B are spreadacross DA2 and DA0 aswell as server0 extent poolsand server1 extent pools

    Additionally, host levelstriping should beconsidered

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    53/63

    2006 IBM Corporation53 Information On Demand |Information Assets and Systems

    DS8000 I/O Port Level Isolation Example

    5

    ____

    0

    ____

    1 2

    ABCD

    3

    ____

    4 5

    ABCD

    0

    ____

    1 2

    ____

    3

    ____

    4

    5

    __

    __0

    __

    __1 2

    AB

    CD3

    __

    __4 5

    AB

    CD0

    __

    __1 2

    __

    __3

    __

    __4

    4 workloads (A,B,C,D) eachhave one dedicated I/O porton 4 shared host adaptercards

    Ports for each workload arespread across HAs, I/Oenclosures and server0/1

    Host adapter and I/Oenclosure are sharedresources

    Additionally, multipathingsoftware should beconsidered

    I/O Enclosure 0 I/O Enclosure 1

    I/O Enclosure 2 I/O Enclosure 3

    DA2

    DA2

    DA

    1

    DA

    1

    DA3

    DA3

    DA

    0

    DA

    0

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    54/63

    2006 IBM Corporation54 Information On Demand |Information Assets and Systems

    DS8000 Host Adapter Level Isolation Example

    5

    C___

    0

    D___

    1 2

    A___

    3

    B___

    4 5

    A___

    0

    B___

    1 2

    C___

    3

    D___

    4

    5

    C_

    __0

    D_

    __1 2

    A_

    __3

    B_

    __4 5

    A_

    __0

    B_

    __1 2

    C_

    __3

    D_

    __4

    4 workloads (A,B,C,D) eachhave 4 dedicated hostadapters

    1 HA in each base frameI/O enclosure

    Workload may use 1 or

    more ports per HA

    Ports for each workload arespread across HAs, I/Oenclosures and server0/1

    I/O enclosure is a shared

    resource

    Additionally, multipathingsoftware should beconsidered

    I/O Enclosure 0 I/O Enclosure 1

    I/O Enclosure 2 I/O Enclosure 3

    DA2

    DA2

    DA

    1

    DA

    1

    DA3

    DA3

    DA

    0

    DA

    0

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    55/63

    2006 IBM Corporation55 Information On Demand |Information Assets and Systems

    DS8000 I/O Port Level Resource Sharing Example

    5

    ____

    0

    ____

    1 2

    AB

    CD_

    __

    3

    ____

    4 5

    AB

    CD__

    _

    0

    ____

    1 2

    ____

    3

    ____

    4

    5

    __

    __0

    __

    __1 2

    __

    __3

    __

    __4 5

    __

    __0

    __

    __1 2

    __

    __3

    __

    __4

    Host connections for workloadsA, B, C and D share 2 I/O

    ports: 1 in a left-side I/O enclosure

    1 in a right-side I/Oenclosure

    Ports for each workload arespread across HAs, I/Oenclosures and server0/1

    Workload analysis should becompleted before planning to

    share I/O ports Additionally, multipathing

    software should be considered

    I/O Enclosure 0 I/O Enclosure 1

    I/O Enclosure 2 I/O Enclosure 3

    DA2

    DA2

    DA

    1

    DA

    1

    DA3

    DA3

    DA

    0

    DA

    0

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    56/63

    2006 IBM Corporation56 Information On Demand |Information Assets and Systems

    DS6000 Examples

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    57/63

    2006 IBM Corporation57 Information On Demand |Information Assets and Systems

    DS6000 Disk Capacity/Logical Volume Spreading Example

    Logical volumes for the isolatedworkload (A) are spread across:

    Ranks on Loop 0 and Loop 1

    Ranks in server0 and server1extent pool

    Logical volumes for the resource-

    sharing workloads (B,C,D,E) arespread across:

    Ranks on Loop 0 and Loop 1

    Ranks in server0 and server1

    extent pools

    Additionally, host level stripingshould be considered

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    58/63

    2006 IBM Corporation58 Information On Demand |Information Assets and Systems

    DS6000 I/O Port Level Isolation Example

    I0100 I0101 I0102 I0103

    L0 L0

    L0 L0

    L1 L1

    L1 L1

    I0000 I0001 I0002 I0003

    Server0

    Server1

    The 4 workloads each have 2 dedicated I/O ports

    1 I/O port on the Server0 Host Adapter(upper)

    1 I/O port on the Sever1 Host Adapter(lower)

    The ports for each workload are spread across Host adapters and server0/1

    Additionally, multipathing software should be considered

    A B C D

    A B C D

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    59/63

    2006 IBM Corporation59 Information On Demand |Information Assets and Systems

    DS6000 I/O Port Level Resource Sharing Example

    The 4 workloads (A, B, C and D) share 2 I/O ports

    1 I/O port on server0

    1 I/O port on server1

    The ports for the workloads are spread across Host adapters and server0/1

    Additionally, multipathing software should be considered

    I0100 I0101 I0102 I0103

    L0 L0

    L0 L0

    L1 L1

    L1 L1

    I0000 I0001 I0002 I0003

    Server0

    Server1

    AB

    CD

    AB

    CD

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    60/63

    2006 IBM Corporation60 Information On Demand |Information Assets and Systems

    Summary

    DS8000 Hardware Performance Considerations

    DS60000 Hardware Performance Considerations

    DS6000 and DS8000 Logical Configuration Performance Considerations

    Principles of Performance Optimization

    Isolation

    Resource sharing

    Spreading

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    61/63

    2006 IBM Corporation61 Information On Demand |Information Assets and Systems

    Related Sessions

    Monitoring and Managing Performance Using TPC 3.1P07

    DS8000 in a Microsoft Exchange EnvironmentD17

    Best Practices Data layout for DS6000/DS8000D09

    IBM TotalStorage DS Storage ManagerD04

    DS Hardware Components and Logical Configuration ConceptsD03

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    62/63

    2006 IBM Corporation62 Information On Demand |Information Assets and Systems

    DS8000 References

    SG24-6452IBM TotalStorage DS8000 Series: Concepts and Architecture

    SC30-4096Multipath Subsystem Device Driver Users Guide

    SC26-7628IBM TotalStorage DS8000 Host Systems Attachment Guide

    SC26-7623IBM TotalStorage DS8000 Users Guide

    SY27-7641IBM TotalStorage DS8000 Installation Guide

    GC35-0495IBM TotalStorage DS8000 Introduction and Planning Guide

    SG24-6788-01

    SG24-7146

    IBM TotalStorage DS8000 Series: Copy Services in Open Environments

    IBM TotalStorage DS8000 Series: Performance Monitoring and Tuning

    SG24-6787-01IBM TotalStorage DS8000 Series: Copy Services with IBM eServer zSeries

    SG24-6786-01IBM TotalStorage DS8000 Series: Implementation

  • 8/3/2019 Configuring DS6KDS8K for Opt Perf

    63/63