Embed Size (px)
Citation preview
Confidential
© 2016 Supermicro
Supermicro SuperStorage
Red Hat Storage Day Seattle
October 18, 2016
Paul McLeodSr. Product [email protected]
Confidential
Confidential
Supermicro Total Solution Evolution
Subsystem Innovation
1993 - 2003
Server/Storage Innovation
IPO2007
Total Solution Innovation
• Motherboard & Building Blocks Expertise • Period of Vertical Integration
• Product Line Growth & System Optimization • Twin & GPU Architectures Breakthrough
• Software & Total Solution Optimization• Service & Global Expansion
2004 - 2013 2014 - 2016
ConfidentialSuperStorage Product Evolution
Supermicro Product Portfolio Evolution
Expanding from Compute to Storage with the emergence of <Software/Defined> Storage
<Custom Storage Software>S
tora
ge A
pplia
nce
<Software/Defined> Storage
ConfidentialComprehensive Portfolio: <Software/Defined> Storage
Capacity/Density
Thro
ughp
ut/L
aten
cy
Flexibility / S
calability
Performance SAS 3.0 - 12Gb/s NVDIMM All Flash NVMe
Capacity / Density Up to 90 Hot-swap bays in 4U Simply Double Top-loading Servers Double-sided Servers
Scale-out
Scale-up
Scalability
ConfidentialAll Flash Summary
SYS-1028U-TN10RT+ SYS-2028U-TN24R4T+ SSG-2028R-NR48N
24 hot-swap 2.5” NVMe drives
32 PCIe lanes to 24 NVMe drives
Performance IOPS (4K Random Read):
up to 5.6M
1600W Titanium level high efficiency digital power supply
Quad Port 10G Base-T
2 Rear hot-swap 2.5” SATA drives
48 hot-swap 2.5” NVMe drives
32 PCIe lanes to 48 NVMe drives
Performance IOPS (4K Random Read):
5.6M
1620W Titanium level high efficiency digital power supply
SIOM
2 Rear hot-swap 2.5” SATA drives
10 hot-swap 2.5” NVMe drives
40 PCIe lanes to 10 NVMe drives
Performance IOPS (4K Random Read):
up to 7M
1000W Titanium level high efficiency digital power supply
Dual Port 10G Base-T
Confidentialx10-Series Storage Server – 2U/24
SSG-6028R-E1CR24 N/LPROCESSORDual Intel Xeon E5-2600 v3/V4 socket RCHIPSETIntel® C612 Express chipset
MEMORY24 DIMM, Up to 3TB ECC 3DS LRDIMM, 768GB ECC RDIMM
Available for EXPANSION2x PCI-E 3.0 x16 & 1x PCI-E 3.0 x8
EXTERNAL I/O SUPPORTSIOM support for flexible networking options; 2x USB 3.0 ports
DRIVE BAYS24x Hot-Swap 3.5” SAS3/SATA3 drive bays 2x 2.5” rear hot-swap drive bays
STORAGE CONTROLLERLSISAS3108 HW RAID (N-series) or 3008 IT mode (L-series)
POWER SUPPLY1620W Redundant Power, 80PLUS Titanium
ADDITIONALIPMI 2.0 w/ dedicated LAN port & KVM; 4 Pin PWM Fan Speed control; Thermal and voltage monitoring;
KEY FEATURES Dual Intel E5-2600 v3/v4 (Socket R) Server 24x Hot-Swap 3.5” SAS3/SATA3 bays ( 12Gb/sec ) IT mode LSI 3008 (L-series) / 3108 HW RAID (N-series) 24x DIMM Slots (DDR4) SIOM for flexible networking options IPMI 2.0 (dedicated LAN) with Virtual Media/KVM over LAN Cable-arm for hot-swap access of second row
APPLICATIONS Storage Appliance File servers Virtual tape library Active Archive and Backup
34”
Confidential
https://www.supermicro.com/solutions/storage_ceph.cfm
Software Defined Solutions
Confidential
Generate well-balanced solutions without compromising on availability, performance and cost
Derive configurations from empirical data during the testing.
Provide reference architectures to prime opportunities and accelerate sales and deployment
Solution Objectives
Confidential
Red Hat Ceph Reference Architecture(s)
http://www.redhat.com/en/resources/red-hat-ceph-storage-clusters-supermicro-storage-servershttps://www.redhat.com/en/resources/mysql-databases-ceph-storage-reference-architecture
Confidential
Workload Optimization
Workload IO Profiles
WorkloadExamples
Searchable Examples
Workload IO Characteristics
HardwareCharacteristics
IOPS MySQLMariaDBPostgreSQL
Medallia High IOPS/GBLow latency IOSmall random IO70/30 read/write mix
Compute serversHigh core:drive ratio10GbENVMe SSD
Throughput Digital media servingServer virtualization(OpenStack Cinder)
Acquia, BloombergTarget, Walmartyahoo!, Facebook, Intuit
High MB/Sec/GBLatency consistencyLarge sequential IOBalanced read/write
Storage serversBalanced core:drive ratio10GbE -> 40GbEHDD -> SSD
Capacity-Archive
Digital media archiveObject archiveBig Data archive
yahoo!CERN
Low cost/GBHigh write volume/hrSequential IO90/10 write/read mix
Dense storage serversLow core:drive ratio40GbEHDD
Where Ceph and Gluster are used
Confidential
Supermicro: TIME TO VALUE
RackCluster
Workload Requirement
input
IOP per GB(Provisioned IOP)
Throughput(MB per Second)
Capacity(Price / Capacity)
output
Or
Turn-key Cluster Solutions
From Public Cloud to On-premise Storage
Sizing / Guidance
Workload Defined
Building Blocks Structure
Deterministic Performance
Best TCO Speeds and Feeds
Confidential
ARCHITECTURAL CONSIDERATIONSUNDERSTANDING THE WORKLOAD
Traditional Ceph Workload• $/GB• PBs• Unstructured data• MB/sec
MySQL Ceph Workload• $/IOP• TBs• Structured data• IOPS
Confidential
ARCHITECTURAL CONSIDERATIONSFUNDAMENTALLY DIFFERENT DESIGN
Traditional Ceph Workload• 50-300+ TB per server• Magnetic Media (HDD)• Low CPU-core:OSD ratio• 10GbE->40GbE
MySQL Ceph Workload• < 10 TB per server• Flash (SSD -> NVMe)• High CPU-core:OSD ratio• 10GbE
Confidential
Supermicro/Red Hat: Ceph IOP testing SetupOSD Storage Server Systems5x SuperStorage SSG-6028R-OSDXXX
Dual Intel Xeon E5-2650v3 (10x core)32GB of 1866 MHz DDR3 ECC SDRAM DIMMs2x 80GB boot drives 4x 800GB Intel DC D3700 (Hot-swap U.2 NVMe)1x dual port 10GbE network adaptors AOC-STGN-i2S 8x Seagate 6TB 7200 RPM SAS (ST600MN00347200)Mellanox Networking installed but not used in test
Client Systems3x Super Server 2UTwin2 (12 nodes)
Dual Intel Xeon E5-2670v264GB SDRAM DIMMs
Storage Server Software:Red Hat Ceph Storage 1.3Red Hat Enterprise Linux 7.1
5x OSD Nodes 12x Client Nodes
Shared 10G
SFP
+ Netw
orking
Monitor Nodes
Confidential
Optimal
FULL
EFFECT OF CEPH CLUSTER LOADING ON IOPS/GB
04080
120160
78
37 25 19
134
7237 36
100% Write70/30 RW
IOPS
/GB
Confidential
Optimal
FULL
010203040
18 18 19
6
34 34 36
8
100% Write70/30 RWIO
PS/G
B
CONSIDERING CORE-TO-FLASH RATIOCore and NVMe count based on 4x node cluster –Capacity Full
Confidential
Optimal
Scale-out IOP per GB4x Node Cluster Comparison
80 Cores 4x NVMe
40 Cores 4x NVMe
80 Cores 8x NVMe
80 Cores 12x NVMe
Confidential
8x Nodes in 3U chassisModel: SYS-5038MR-OSD006P
Per Node Configuration:CPU: Single Intel Xeon E5-2630 v4Memory: 32GB NVMe Storage: Single 800GB Intel P3700 Networking: 1x single-port 10G SFP+
+ +
1x CPU + 1x NVMe + 1x SFP
OPTIMAL PERFORMANCE
MicroCloud for Ceph/MySQL
https://www.redhat.com/en/resources/mysql-databases-ceph-storage-reference-architecture
Confidential
Supermicro’s Ceph Ready Nodes
X10 Models CPU/MemDrive Config
SSG-6018R-MON2Dual Intel Xeon
E5-2630 v364GB
Ix 800GB PCI-flash / NVMe
SYS-5038MR-OSD006P8x Nodes with single Intel Xeon
E5-2630 v432GB
8x Nodes, 1x NVMe per node
SSG-6028R-OSD072P Single Intel Xeon E5-2620 v364GB
(12+1)12x 6TB HDD + 1x NVMe
SSG-6048R-OSD216PDual Intel Xeon
E5-2630 v3128GB
(36+2)36x 6TB HDD + 2x NVMe
SSG-6048R-OSD360PDual Intel Xeon
E5-2690 v3256GB
(60+12)60x 6TB HDD + 12x SSD
IOP per GB(Provisioned IOP)
Throughput(MB/s)
Capacity(Cost Per GB)
Monitor Node
Confidential
Supermicro’s Red Hat Storage Ready Racks
OpenStack Starter Digital Media Serving Digital Media ArchiveStorage Nodes 10x 2U 12-Bay SSG 9x 4U 36-Bay SSG 9x 4U 60-Bay SSGInstalled OSD Drives 120 324 540HDD Bays Per Node 12x 3.5” 36x 3.5” 60x 3.5”Supported Media Types SATA, SAS, SSD, NVMe SATA, SAS, SSD, NVMe SATA, SAS, SSD, NVMeRaw Capacity (if using 8TB HDD) 960TB 2.5PB 4.3PBMemory Per Node (Ceph) 64GB DDR4 – 2133Mhz 128GB DDR4 – 2133Mhz 256GB DDR4 -2133MhzMonitor Nodes (Ceph) 3x 1U Servers (6018R-MON2) 3x 1U Servers (6018R-MON2) 3x 1U Servers (6018R-MON2)Network Switches (10G SFP+) 1x 24 Port GbE
1x 24 port 10GbE 1x 24 Port 1GbE 2x 48 Port 10GbE
1x 24 Port 1GbE 2x 48 Port 10GbE
Cabinet Dimensions 42U (82.4"Hx 23.5"Wx 48"D)Power Distribution Unit 2x 3-Phase 30A, L6-30P 2x 3-Phase 30A, L6-30P 2x 3-Phase 50A, L6-30P
10 node | Half-Rack240TB (3-way replication)
Featuring 2U/12-Bay servers
9 node | Full-Rack1.5PB usable (7+2 EC)
Featuring 4U/36-Bay servers
9 node | Full-Rack2.4PB usable (7+2 EC)
Featuring 4U/72-Bay servers
Confidential
Supermicro’s Total Solutions
Turn-key Cluster Level Solutions Validated Hardware Red Hat Storage Subscription (Turn-key) 24x7x4-Hour Service
Ready Hardware Validated Hardware Bare Metal Flexible Hardware Service Options
Ready Nodes Ready Racks Turn-key Racks Turn-key Clusters
Total SolutionReady HardwareFlexibility
Confidential
© 2016 Supermicro
Q&A
Thank you
Confidential
© 2016 Supermicro
Backup
Confidential
Supermicro FatTwin And SuperStorage Systems Power BlackMesh Managed Services
Challenges: To deliver the best customer experience and the highest degree of security to its
users in the public and private sectors Looking for an infrastructure vendor that meets all of its requirements –
particularly in regards to TCO and short product fulfillment lead times
Solutions: A 100% Supermicro server farm with over 500 systems deployed in three
highest rated Tier 4 data centers. Total capacity 1.5 PB High density and high performance FatTwin servers and SuperStorage RHEL, Red Hat Ceph, OpenStack, OpenShift, Ansible all deployed on
Supermicro
Results: Exponential growth and continuous uptime Gaining more clients, the most significant being the federal agencies that
require the highest degree of network security and reliability
“By leveraging Supermicro hardware, BlackMesh is able to maintain its goal of unlimited, on-demand support while producing cost-effective savings.”
Jason Ford, CTO of BlackMesh
Las VegasReston, VA
Toronto, ON
SuperStorage SSG-6027R-E1R12N FatTwin™
SYS-F617R2-R72+
