Upload
joe-handzik
View
36
Download
0
Embed Size (px)
DESCRIPTION
Presentation given at HP technical symposium about big data hardware configurations
Citation preview
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
1/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Dense DAS Experience with
SL 4500 and D6000Joe Handzik
ISS Smart Storage
Session B14
March 2013
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
2/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Market Overview
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
3/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3
Big Data is the new frontier for global competi
Banking Customer insight Financial risk management Relationship pricing
Pub Frau Thre Regu
Retail Merchandising Supply chain management Multi-channel marketing
Telco Churn management Network Analytics Sales & marketing
Information drives intelligent business decisions
Big Data is no longer just a Buzzword
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
4/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4
Big Data growth outpacing todays siloed infra
The market for software related to the
Hadoop and MapReduce...will jump from
US$77 million in 2011 to $812.8 million in2016, a compound annual growth rate of
60.2 percent1
Openstack is being adopted faster thanLinuxachieving same number of contributing
companies in 1/10 of the time2
1IDC, Worldwide Hadoop-MapReduce Ecosystem Software 20122016 forecast, May 2012 Doc #2342942Rackspace Hosting, 2 year milestone, July 19th, 2012
Todays Siloed Infras
EnergySpace
Not optimized for B
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
5/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
SL 4500 Overview
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
6/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6
The HP ProLiant SL4500 Server Series
Workload optimized
Converged and balanced a
ProLiant-class solution
HP ProLiant SL4545 G7 ServHP ProLiant SL4540 Gen8 S
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
7/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7
HP ProLiant SL4500 SeriesFlexibility to address Big Data workloads in any data center
2 node configuration1 node configuration
2 compute nodes with up to 25 LFF and
2 SFF hard drives per node
1 compute node with up to 60 LFF and
2 SFF hard drives
3 compute nodes
2 SFF hard
3 node co
Note: HP ProLiant SL4540 Gen8 Server and HP ProLiant SL4545 G7 Server will be available in 1, 2 and 3 node based configurations as shown above
SL4540 & SL4545 (1X60) SL4540 & SL45SL4540 & SL4545 (2X25)
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
8/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8
The first server purpose-built for big data
HP ProLiant SL4500 Series
Converged and balanced architecture
HP Smart Array technology delivers sca
multiple drive technologies (SSD, SAS o Energy savingswith shared cooling an
complexitywith fewer cables
Flexible compute, up to 3 compute nod
Enterprise class solution
Cluster management using HP Insight C
Power management- Dynamic Power C
Managementwith SL Advanced Power 94% Platinum Plusefficient power sup
Front service zone Rear service zone
Node 2Node 3 Node 1Node 2Node 1 Node 3
Node 2 Node 1Node 1 Node 2
Node 1Node 1
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
9/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9
Flexible IO bay
HP ProLiant SL4500 Series
Flexible PCI slot expansion options
Low profile Supports network card, HP I/O accelerator,
or 2ndSmart Array controller (future)
Connectivity to outside world
Dedicated IO Bay per node
Contains Smart Array p420i Gen8 controller
2x1Gb Ethernet Optional 2x10Gb Ethernet options
High speed signaling
Up to 24 lanes PCI Express Gen2
Up to16 lanes (future) of SAS/SATA (8 current)2x RJ45
1GbE
Optional iLO
QSFP
10GbE
Or
40G QDR IB
1
PCIe Slot
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
10/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10
Central chassis and node management
HP ProLiant SL4500 Series
Management features
SL Advanced Power Management Node-level power monitoring and control
SL Rack Dynamic Power Capping
Discovery of server rack components by topology
Easy node identification through UID indicators
Asset Management
Single iLO Port for 1-3 nodes for reduced cabling Optional 1GbE port can be dedicated for iLO
USB Debug iLO
SL-APMD
Connecto
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
11/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11
HP ProLiant SL4540 Gen8/SL4545 G7 ServerSystem diagram for 1 node configuration
Motherboard I/O Board
30LFF
X4 SAS
CPU 1
Socket B2CPU 2
Socket B2
6 DIMM 6 DIMM
up to 1333MHz (192GB max)
Intel
Xeon
E5-2400, 4/6/8 coresAMD Opteron 4200, 6/8 cores
DDR3
2X SFF SATA
Mgmt Module
SL APM
2x10Gb NIC(opt)
2x1Gb
NIC
PCI-E Slot
RJ45
RJ45RJ45 SFP+QSFP
iLO4
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
12/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
D6000 Overview
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
13/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13
The D6000
6 Gb/s SAS connection
MDS600: 3 Gb/s
70 LFF SAS drives across both drawers
14 drives per u of rack space
Redundant hot plug power supplies and fans
Cooling redundancy at drawer-level Power supply redundancy at chassis-level
Supported by BladeSystem and ProLiant Gen 8 Servers
Overview
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
14/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14
Max Controller Drive Count: 35*4 = 140 (Single Domain, using P822 and
Note: Max logical volumes for Smart Array: 64
Direct Attached D6000 Configuration
HP DL380p D6000 Disk EncHP Smart Array P421 or P822
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
15/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15
Max Drive count per P721m: 227 via SAS Zoning
SAS Switch + BladeSystem D6000 Configuratio
HP C7000 BladeSystem HP 6G SAS BL Switch D6000 DHP Smart Array P721m
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
16/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16
Configuring SAS Zoning
VSM Virtual SAS Manager software
resides on the SAS Switch.
1. Select a blade server
2. Select hard drives
3. Done!
Configuration can be replicated from
rack to rack.
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
17/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Workload Example: Object Storage
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
18/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18
OpenStack Swift Architecture
Recommended Configuration
Proxy node Runs Proxy services
Can add additional Proxy nodes for better
performance and reliability
Auth node
Optional, runs Auth service separate from Proxy
Storage node Runs Account, Container, and Object services
Scalable object storage system
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
19/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19
Recommended D6000 SL4500 (si
Processor 2x Quad Core Max: Varies Max: 2x 8 C
Memory 8-12 GB RAM Max: Varies Max: 192 G
Network 1 Gb Ethernet
Operating System LinuxFull support: RHEL, SLES
Partial support: Ubuntu
Full suppor
Partial sup
Disk Space Cost/GB Optimization 70 drive bays (35 per drawer) 60 drive ba
Swift Object servers
Note: D6000 does not support SATA drives
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
20/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20
Configuration Options
SL 4500 (one node)
Expansion possible Connect a P421 via the flexible
IO bay for external storage
Connect a D6000
Improve Throughput
Connect a second P420i via the
flexible IO bay
Smart Cache
D6000 (DL/ML/SL)
D6000 + existing server Connect via a Smart Array card
Expansion possible
Connect another D6000
Improve Throughput
Connect a second Smart Array
Dual Domain Smart Cache
D6000 (BladeS
Use VSM to zoneExpansion possib
Zone in new driv
Connect another
Improve Through
Dual Domain
Smart Cache
Suggested drive configuration is RAID 0
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
21/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Workload Example: Hadoop
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
22/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22
Hadoop + MapReduce
Recommended Configuration
NameNodes Two in each cluster (one active, one spare)
Manages namespace, filesystem metadata, access
control
JobTracker
Hands out tasks to slave nodes
DataNode/TaskTracker Holds filesystem data
Carries out map and reduce tasks
Scalable Distributed Computing
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
23/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23
Recommended D6000 SL4500 (thre
Processor 2x Quad Core Max: Varies Max: 2x 8 Cor
Memory 16-72 GB RAM Max: Varies Max: 192 GB (
Network 1 Gb Ethernet
Operating System Linux, Windows (w/ Cygwin)
Full support: RHEL, SLES,
Windows
Partial support: Ubuntu
Full support:
Windows
Partial suppo
Disk Space ~1 spindle per CPU core 70 drive bays (35 per drawer) 15 drive bays
Hadoop DataNodes
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
24/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.24
Which works well for Hadoop?
SL 4500 (three node)
Designed for Hadoop Drive count scales appropriately
Consistent node configuration
D6000 (DL/ML/SL)
Doesnt scale well for Hadoop Too many drives connected to a
single DataNode
DL/ML/SL still useful in Hadoop
cluster
D6000 (BladeS
Scales for Hadoo Drive zoning scal
Also has consiste
Dual-domain imp
tolerance and pe
S
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
25/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Summary
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
26/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.26
Optimized for a range of big data workloadsMatch your exact needs with an ideal combination of core to spindle ratios
1 node plus 60 LFF drives
2 node each with 25 LFF drivesCore/Spindle
Capacity/Node (TB)
24018045 60 10075
Object Storage
Big data analytics
Distributed parallel processing
3 node each with 15 LFF drives
1:10
1:2
1:1
Software-defined storage
i i
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
27/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.27
Choosing the best solution
SL4500 or D6000?
Depends on your infrastructure needs D6000 expands storage capacity of existing servers
SL4500 introduces new servers into your infrastructure
How much does ratio optimization matter?
SL4500 is designed around big data workloads
D6000 requires more configuration to achieve this
Is fine-grained storage provisioning important? SAS Zoning (BladeSystem only)
SL4500 cannot share its storage
Dual-domain failover
Not available for the SL4500
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
28/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28
Questions?
Th k
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
29/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you
HP P Li t SL4540 G 8/SL4545 G7 S
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
30/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.30
HP ProLiant SL4540 Gen8/SL4545 G7 ServerFront view of 1 node configuration
Front view:1. Hood Cover
2. LFF 3.5 hard drives (60)
3. SFF 2.5 hard drives on node (2)
4. LFF hard drives connected to storage con
5. LFF hard drives connected to storage con
6. Health LED
7. Storage UID
8. Hard drive LED display boards
9. Node ejection button
10. Node USB connectors (2)
11. Node video connector (VGA port)
12. Node power ON/Standby button and syst
13. Node health LED
14. Node UID LED button
HP P Li t SL4540 G 8/SL4545 G7 S
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
31/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31
HP ProLiant SL4540 Gen8/SL4545 G7 ServerRear view of 1 node configuration
Front view:1. Fan LED2. System fans3. I/O Module4. Management Module
5. SL Advanced Power Manager Distribution
6. iLO connector7. Serial port8. 10Gb Ethernet SFP+ port9. 10Gb Ethernet QSFP port10. 2 X 1Gb Ethernet ports11. Low profile PCI express slot12. Power supplies13. Power supply LED
HP P Li t SL4540 G 8/SL4545 G7 S
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
32/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32
HP ProLiant SL4540 Gen8/SL4545 G7 ServerFront view of 2 node configuration
Front view:1. Server Node 12. SFF 2.5 hard drives on node (2)3. Health LED4. Storage UID5. LFF Hard drives connected to node6. Server Node 27. Hard drive LED display boards8. Node video connector (VGA port)9. Node USB connectors (2)10. Node power ON/Standby button and syst
11. Node health LED12. Node ejection button13. Node UID LED button
HP ProLiant SL4540 Gen8/SL4545 G7 Server
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
33/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.33
HP ProLiant SL4540 Gen8/SL4545 G7 ServerRear view of 2 node configuration
Front view:1. Fan LED2. System fans3. I/O Module for Node 14. Management Module
5. SL Advanced Power Manager Distribution
6. iLO connector7. Serial port8. 10Gb Ethernet SFP+ port9. 10Gb Ethernet QSFP port10. 2 X 1Gb Ethernet ports11. Low profile PCI express slot12. Power supplies13. Power supply LED14. I/O Module for Node 2
HP ProLiant SL4540 Gen8/SL4545 G7 Server
7/14/2019 B14 Dense DAS Experience With SL45XX and MDS600 D6000
34/34
Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.34
HP ProLiant SL4540 Gen8/SL4545 G7 ServerThe first server purpose-built for big data
SL4540 Gen8Built on ProActive Insight Architecture
SL4545 G
Compute IntelXeonE5-2400, 4/6/8 cores | PCIe 2.0 (6) AMD Opteron 4200,6/8 co
HP Smart Socket guideMemory (12) DDR3, up to 1333MHz (192GB max) (12) DDR3, up to 1600MH
HP SmartMemory
StorageHP Smart Array P420i controller
60LFF / 2SFF max - HDD/SSD/SAS
HP Smart Array P420
60LFF / 2SFF* (no full Gen8 dr ive carrier f
HP SmartDrives
FBWC up to 2GB DDR3-1333 MHz up to 2GB DDR3-1
Networking 2x1GbE + 2x10GbE(Optional) 2x1GbE + 2x10GbE
FlexibleLOM
Embedded Management HP iLO Management Engine (iLO 4) HP Integrated Lights-
Intelligent Provisioning
Active Health System
Agentless Management
Cloud-based Management HP Insight Management 7 HP Insight Manag
HP Insight Control (agentless)
HP Insight Online
Power & Cooling 94% Platinum Plus standard 94% Platinum Plus
3D Sea of Sensors (Sea of Senso