B14 Dense DAS Experience With SL45XX and MDS600 D6000

Embed Size (px)

DESCRIPTION

Presentation given at HP technical symposium about big data hardware configurations

Citation preview

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    1/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    Dense DAS Experience with

    SL 4500 and D6000Joe Handzik

    ISS Smart Storage

    Session B14

    March 2013

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    2/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    Market Overview

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    3/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3

    Big Data is the new frontier for global competi

    Banking Customer insight Financial risk management Relationship pricing

    Pub Frau Thre Regu

    Retail Merchandising Supply chain management Multi-channel marketing

    Telco Churn management Network Analytics Sales & marketing

    Information drives intelligent business decisions

    Big Data is no longer just a Buzzword

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    4/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4

    Big Data growth outpacing todays siloed infra

    The market for software related to the

    Hadoop and MapReduce...will jump from

    US$77 million in 2011 to $812.8 million in2016, a compound annual growth rate of

    60.2 percent1

    Openstack is being adopted faster thanLinuxachieving same number of contributing

    companies in 1/10 of the time2

    1IDC, Worldwide Hadoop-MapReduce Ecosystem Software 20122016 forecast, May 2012 Doc #2342942Rackspace Hosting, 2 year milestone, July 19th, 2012

    Todays Siloed Infras

    EnergySpace

    Not optimized for B

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    5/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    SL 4500 Overview

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    6/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6

    The HP ProLiant SL4500 Server Series

    Workload optimized

    Converged and balanced a

    ProLiant-class solution

    HP ProLiant SL4545 G7 ServHP ProLiant SL4540 Gen8 S

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    7/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7

    HP ProLiant SL4500 SeriesFlexibility to address Big Data workloads in any data center

    2 node configuration1 node configuration

    2 compute nodes with up to 25 LFF and

    2 SFF hard drives per node

    1 compute node with up to 60 LFF and

    2 SFF hard drives

    3 compute nodes

    2 SFF hard

    3 node co

    Note: HP ProLiant SL4540 Gen8 Server and HP ProLiant SL4545 G7 Server will be available in 1, 2 and 3 node based configurations as shown above

    SL4540 & SL4545 (1X60) SL4540 & SL45SL4540 & SL4545 (2X25)

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    8/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8

    The first server purpose-built for big data

    HP ProLiant SL4500 Series

    Converged and balanced architecture

    HP Smart Array technology delivers sca

    multiple drive technologies (SSD, SAS o Energy savingswith shared cooling an

    complexitywith fewer cables

    Flexible compute, up to 3 compute nod

    Enterprise class solution

    Cluster management using HP Insight C

    Power management- Dynamic Power C

    Managementwith SL Advanced Power 94% Platinum Plusefficient power sup

    Front service zone Rear service zone

    Node 2Node 3 Node 1Node 2Node 1 Node 3

    Node 2 Node 1Node 1 Node 2

    Node 1Node 1

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    9/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9

    Flexible IO bay

    HP ProLiant SL4500 Series

    Flexible PCI slot expansion options

    Low profile Supports network card, HP I/O accelerator,

    or 2ndSmart Array controller (future)

    Connectivity to outside world

    Dedicated IO Bay per node

    Contains Smart Array p420i Gen8 controller

    2x1Gb Ethernet Optional 2x10Gb Ethernet options

    High speed signaling

    Up to 24 lanes PCI Express Gen2

    Up to16 lanes (future) of SAS/SATA (8 current)2x RJ45

    1GbE

    Optional iLO

    QSFP

    10GbE

    Or

    40G QDR IB

    1

    PCIe Slot

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    10/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10

    Central chassis and node management

    HP ProLiant SL4500 Series

    Management features

    SL Advanced Power Management Node-level power monitoring and control

    SL Rack Dynamic Power Capping

    Discovery of server rack components by topology

    Easy node identification through UID indicators

    Asset Management

    Single iLO Port for 1-3 nodes for reduced cabling Optional 1GbE port can be dedicated for iLO

    USB Debug iLO

    SL-APMD

    Connecto

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    11/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11

    HP ProLiant SL4540 Gen8/SL4545 G7 ServerSystem diagram for 1 node configuration

    Motherboard I/O Board

    30LFF

    X4 SAS

    CPU 1

    Socket B2CPU 2

    Socket B2

    6 DIMM 6 DIMM

    up to 1333MHz (192GB max)

    Intel

    Xeon

    E5-2400, 4/6/8 coresAMD Opteron 4200, 6/8 cores

    DDR3

    2X SFF SATA

    Mgmt Module

    SL APM

    2x10Gb NIC(opt)

    2x1Gb

    NIC

    PCI-E Slot

    RJ45

    RJ45RJ45 SFP+QSFP

    iLO4

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    12/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    D6000 Overview

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    13/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13

    The D6000

    6 Gb/s SAS connection

    MDS600: 3 Gb/s

    70 LFF SAS drives across both drawers

    14 drives per u of rack space

    Redundant hot plug power supplies and fans

    Cooling redundancy at drawer-level Power supply redundancy at chassis-level

    Supported by BladeSystem and ProLiant Gen 8 Servers

    Overview

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    14/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14

    Max Controller Drive Count: 35*4 = 140 (Single Domain, using P822 and

    Note: Max logical volumes for Smart Array: 64

    Direct Attached D6000 Configuration

    HP DL380p D6000 Disk EncHP Smart Array P421 or P822

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    15/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15

    Max Drive count per P721m: 227 via SAS Zoning

    SAS Switch + BladeSystem D6000 Configuratio

    HP C7000 BladeSystem HP 6G SAS BL Switch D6000 DHP Smart Array P721m

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    16/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16

    Configuring SAS Zoning

    VSM Virtual SAS Manager software

    resides on the SAS Switch.

    1. Select a blade server

    2. Select hard drives

    3. Done!

    Configuration can be replicated from

    rack to rack.

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    17/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    Workload Example: Object Storage

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    18/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18

    OpenStack Swift Architecture

    Recommended Configuration

    Proxy node Runs Proxy services

    Can add additional Proxy nodes for better

    performance and reliability

    Auth node

    Optional, runs Auth service separate from Proxy

    Storage node Runs Account, Container, and Object services

    Scalable object storage system

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    19/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19

    Recommended D6000 SL4500 (si

    Processor 2x Quad Core Max: Varies Max: 2x 8 C

    Memory 8-12 GB RAM Max: Varies Max: 192 G

    Network 1 Gb Ethernet

    Operating System LinuxFull support: RHEL, SLES

    Partial support: Ubuntu

    Full suppor

    Partial sup

    Disk Space Cost/GB Optimization 70 drive bays (35 per drawer) 60 drive ba

    Swift Object servers

    Note: D6000 does not support SATA drives

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    20/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20

    Configuration Options

    SL 4500 (one node)

    Expansion possible Connect a P421 via the flexible

    IO bay for external storage

    Connect a D6000

    Improve Throughput

    Connect a second P420i via the

    flexible IO bay

    Smart Cache

    D6000 (DL/ML/SL)

    D6000 + existing server Connect via a Smart Array card

    Expansion possible

    Connect another D6000

    Improve Throughput

    Connect a second Smart Array

    Dual Domain Smart Cache

    D6000 (BladeS

    Use VSM to zoneExpansion possib

    Zone in new driv

    Connect another

    Improve Through

    Dual Domain

    Smart Cache

    Suggested drive configuration is RAID 0

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    21/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    Workload Example: Hadoop

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    22/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22

    Hadoop + MapReduce

    Recommended Configuration

    NameNodes Two in each cluster (one active, one spare)

    Manages namespace, filesystem metadata, access

    control

    JobTracker

    Hands out tasks to slave nodes

    DataNode/TaskTracker Holds filesystem data

    Carries out map and reduce tasks

    Scalable Distributed Computing

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    23/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23

    Recommended D6000 SL4500 (thre

    Processor 2x Quad Core Max: Varies Max: 2x 8 Cor

    Memory 16-72 GB RAM Max: Varies Max: 192 GB (

    Network 1 Gb Ethernet

    Operating System Linux, Windows (w/ Cygwin)

    Full support: RHEL, SLES,

    Windows

    Partial support: Ubuntu

    Full support:

    Windows

    Partial suppo

    Disk Space ~1 spindle per CPU core 70 drive bays (35 per drawer) 15 drive bays

    Hadoop DataNodes

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    24/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24

    Which works well for Hadoop?

    SL 4500 (three node)

    Designed for Hadoop Drive count scales appropriately

    Consistent node configuration

    D6000 (DL/ML/SL)

    Doesnt scale well for Hadoop Too many drives connected to a

    single DataNode

    DL/ML/SL still useful in Hadoop

    cluster

    D6000 (BladeS

    Scales for Hadoo Drive zoning scal

    Also has consiste

    Dual-domain imp

    tolerance and pe

    S

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    25/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    Summary

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    26/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26

    Optimized for a range of big data workloadsMatch your exact needs with an ideal combination of core to spindle ratios

    1 node plus 60 LFF drives

    2 node each with 25 LFF drivesCore/Spindle

    Capacity/Node (TB)

    24018045 60 10075

    Object Storage

    Big data analytics

    Distributed parallel processing

    3 node each with 15 LFF drives

    1:10

    1:2

    1:1

    Software-defined storage

    Email

    i i

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    27/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27

    Choosing the best solution

    SL4500 or D6000?

    Depends on your infrastructure needs D6000 expands storage capacity of existing servers

    SL4500 introduces new servers into your infrastructure

    How much does ratio optimization matter?

    SL4500 is designed around big data workloads

    D6000 requires more configuration to achieve this

    Is fine-grained storage provisioning important? SAS Zoning (BladeSystem only)

    SL4500 cannot share its storage

    Dual-domain failover

    Not available for the SL4500

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    28/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28

    Questions?

    Th k

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    29/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

    Thank you

    HP P Li t SL4540 G 8/SL4545 G7 S

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    30/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30

    HP ProLiant SL4540 Gen8/SL4545 G7 ServerFront view of 1 node configuration

    Front view:1. Hood Cover

    2. LFF 3.5 hard drives (60)

    3. SFF 2.5 hard drives on node (2)

    4. LFF hard drives connected to storage con

    5. LFF hard drives connected to storage con

    6. Health LED

    7. Storage UID

    8. Hard drive LED display boards

    9. Node ejection button

    10. Node USB connectors (2)

    11. Node video connector (VGA port)

    12. Node power ON/Standby button and syst

    13. Node health LED

    14. Node UID LED button

    HP P Li t SL4540 G 8/SL4545 G7 S

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    31/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31

    HP ProLiant SL4540 Gen8/SL4545 G7 ServerRear view of 1 node configuration

    Front view:1. Fan LED2. System fans3. I/O Module4. Management Module

    5. SL Advanced Power Manager Distribution

    6. iLO connector7. Serial port8. 10Gb Ethernet SFP+ port9. 10Gb Ethernet QSFP port10. 2 X 1Gb Ethernet ports11. Low profile PCI express slot12. Power supplies13. Power supply LED

    HP P Li t SL4540 G 8/SL4545 G7 S

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    32/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32

    HP ProLiant SL4540 Gen8/SL4545 G7 ServerFront view of 2 node configuration

    Front view:1. Server Node 12. SFF 2.5 hard drives on node (2)3. Health LED4. Storage UID5. LFF Hard drives connected to node6. Server Node 27. Hard drive LED display boards8. Node video connector (VGA port)9. Node USB connectors (2)10. Node power ON/Standby button and syst

    11. Node health LED12. Node ejection button13. Node UID LED button

    HP ProLiant SL4540 Gen8/SL4545 G7 Server

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    33/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.33

    HP ProLiant SL4540 Gen8/SL4545 G7 ServerRear view of 2 node configuration

    Front view:1. Fan LED2. System fans3. I/O Module for Node 14. Management Module

    5. SL Advanced Power Manager Distribution

    6. iLO connector7. Serial port8. 10Gb Ethernet SFP+ port9. 10Gb Ethernet QSFP port10. 2 X 1Gb Ethernet ports11. Low profile PCI express slot12. Power supplies13. Power supply LED14. I/O Module for Node 2

    HP ProLiant SL4540 Gen8/SL4545 G7 Server

  • 7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000

    34/34

    Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.34

    HP ProLiant SL4540 Gen8/SL4545 G7 ServerThe first server purpose-built for big data

    SL4540 Gen8Built on ProActive Insight Architecture

    SL4545 G

    Compute IntelXeonE5-2400, 4/6/8 cores | PCIe 2.0 (6) AMD Opteron 4200,6/8 co

    HP Smart Socket guideMemory (12) DDR3, up to 1333MHz (192GB max) (12) DDR3, up to 1600MH

    HP SmartMemory

    StorageHP Smart Array P420i controller

    60LFF / 2SFF max - HDD/SSD/SAS

    HP Smart Array P420

    60LFF / 2SFF* (no full Gen8 dr ive carrier f

    HP SmartDrives

    FBWC up to 2GB DDR3-1333 MHz up to 2GB DDR3-1

    Networking 2x1GbE + 2x10GbE(Optional) 2x1GbE + 2x10GbE

    FlexibleLOM

    Embedded Management HP iLO Management Engine (iLO 4) HP Integrated Lights-

    Intelligent Provisioning

    Active Health System

    Agentless Management

    Cloud-based Management HP Insight Management 7 HP Insight Manag

    HP Insight Control (agentless)

    HP Insight Online

    Power & Cooling 94% Platinum Plus standard 94% Platinum Plus

    3D Sea of Sensors (Sea of Senso