NexentaStor 5.0 Reference Architecture - Nexenta | … following reference architectures are based on the following HGST 2U24 Flash Storage Platforms: HGST Model Number Configuration

Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com NexentaStor_Cisco5_2018Q2

April2018

NexentaStor5.xReferenceArchitecture

CiscoNexentaStor5.xReferenceArchitectureGuide

2 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com

TableofContents

TableofContents.............................................................................................................................2

Preface.............................................................................................................................................3IntendedAudience.................................................................................................................................................................................3Comments..................................................................................................................................................................................................3Copyright,Trademarks,andCompliance.....................................................................................................................................31 CiscoReferenceArchitectures....................................................................................................41.1 CiscoAll-FlashConfigurations..............................................................................................................................................41.1.1 CiscoC240andHGST2U24All-Flash...............................................................................................................................4

1.2 CiscoHybrid/All-DiskConfigurations.............................................................................................................................51.2.1 CiscoC240StandaloneHybrid............................................................................................................................................51.2.2 CiscoC240andSeagateHybrid/All-Disk.....................................................................................................................61.2.3 CiscoC240andHGST4U60G2Hybrid/All-Disk........................................................................................................7

2 AboutNexenta...........................................................................................................................8

AppendixB:LegacyConfigurations...................................................................................................9B.1 CiscoLegacyConfigurations..................................................................................................................................................9B.1.1 CiscoC240andSanDiskInfiniFlashAll-Flash..............................................................................................................9



PrefaceIntendedAudienceThisdocumentisintendedforNexentapartnersandNexentacustomer-facingorganizations.ThelatestversionofthisdocumentisavailablethroughtheNexentaPartnerPortal.

CommentsForcommentsandinquiries,[email protected],sections,andparagraphswheneverpossible.

Copyright,Trademarks,andComplianceCopyright©2018NexentaSystems™,ALLRIGHTSRESERVEDNotice:Nopartofthispublicationmaybereproducedortransmittedinanyformorbyanymeans,electronicormechanical,includingphotocopyingandrecording,orstoredinadatabaseorretrievalsystemforanypurposewithouttheexpresswrittenpermissionofNexentaSystems(hereinafterreferredtoas“Nexenta”).Nexentareservestherighttomakechangestothisdocumentatanytimewithoutnoticeandassumesnoresponsibilityforitsuse.NexentaproductsandservicesonlycanbeorderedunderthetermsandconditionsofNexentaSystems’applicableagreements.Allofthefeaturesdescribedinthisdocumentmaynotbeavailablecurrently.RefertothelatestproductannouncementorcontactyourlocalNexentaSystemssalesofficeforinformationonfeatureandproductavailability.Thisdocumentincludesthelatestinformationavailableatthetimeofpublication.Nexenta,NexentaStor,NexentaFusion,NexentaEdgeandNexentaCloudareregisteredtrademarksofNexentaSystemsintheUnitedStatesandothercountries.Allothertrademarks,servicemarks,andcompanynamesinthisdocumentarepropertiesoftheirrespectiveowners.



1 CiscoReferenceArchitectures

1.1 CiscoAll-FlashConfigurationsNexentaStorAll-FlashconfigurationsdeliververyhighIOPSandsubmillisecondlatencyforsmallrandomIOworkloadsthataretypicalofdatabases,enterpriseapplicationsandhighperformanceprivatecloud(VMware,OpenStackandHyper–V)environments.

1.1.1 CiscoC240andHGST2U24All-FlashThefollowingreferencearchitecturesarebasedonthefollowingHGST2U24FlashStoragePlatforms:

HGSTModelNumber Configuration1ES0107 12x3.84TB1DWPDSASSSDs1ES0110 24x3.84TB1DWPDSASSSDs1ES0108 12x7.68TB1DWPDSASSSDs1ES0111 24x7.68TB1DWPDSASSSDs

CiscoandHGSTRA

NCH-AF-24 NCH-AF-48 NCH-AF-72 NCH-AF-96

RawCapacity Upto184TB Upto368TB Upto552TB Upto737TBDeviceSlots 24 48 72 96FormFactor(HA)

6U 8U 10U 12U

Memory(HA)

512GB

10GbEPorts 4Software NexentaStor5.x

CiscoandHGSTRA NCH-AF-24 NCH-AF-48 NCH-AF-72 NCH-AF-96

Controller 1xor2xC240M4SXCPU E5-2643v43.4GHz,6cores,2socketDRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)

1xCisco9300-8e12GbSAS




NIC IntelX52010GbEDualPortSFP+IntelX54010GbEDualPortBaseT

FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562.QLE2672

StorageEnclosure

1xHGST2U24 2xHGST2U24 3xHGST2U24 4xHGST2U24

DataDevice# Upto24 Upto48 Upto72 Upto96

FlashDevice 3.84TBSASSSD(1DWPD)7.68TBSASSSD(1DWPD)

L2ARC n/aZIL/SLOG n/a

Note1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2: ThereisnoneedforseparateZILorL2ARCdevicesinall-SSDconfigurations.Note3: ChassismanagementfortheHGST2U24enclosureistargetedforNexentaStor5.1.1.



1.2 CiscoHybrid/All-DiskConfigurationsNexentaStorHybridconfigurationsdelivergreatsyncwriteperformanceandarebestsuitedformixedread/writeworkloadswithsmallrandomIOthataretypicalofprivatecloud(VMware,OpenStackandHyper-V)storagebackend,genericfileservicesandhighperformancebackupandarchiveusecases.NexentaStorAll-Diskconfigurationsarebestsuitedforbackupandarchivetypeusecases,sequentialworkloadsandreadintensiveworkloads.Ciscoserverandstorageenclosurepairingsarelimitedtothefollowingbuildingblocksonly.Variationsinthefollowingcomponentsarepermitted:Controller:CPUtype,DRAMcapacity,typeandcountforSASHBA,NICandFCHBAStorageenclosure:HDDtypeandcount,SSDtypeandcount

1.2.1 CiscoC240StandaloneHybridSinglenode(non-HA)storageappliancebasedonasingleCiscoC240M4SXrunningNexentaStor5.xina2Uchassis.

CiscoStandaloneRA

NC-H-24(Non-HA)

MaxRawCapacity Upto44TB(22x2TB)DeviceSlots 24FormFactor(total) 2UMemory(total) 128GBReadCache n/a10GbEPorts 2Software NexentaStor5.x

CiscoStandaloneRA NC-H-24(Non-HA)

Controller 1xCiscoC240M4SX

CPU E5-2680v32.5GHz,12cores,2socketE5-2643v43.4GHz,6cores,2socket

DRAM 128GB(8x16GB)BootDrive 2x480GBinternalSSDSASHBA n/aBuilt-inEthernet Inteli350dual-portonthemotherboard


FCHBA EmulexLPe12002,LPe16002-MC QLogicQLE2562,QLE2672

Storage

24x2.5”Data+internalBootdevices

DataHDD SeeCiscosupporteddeviceshereNotethatPCIedevicesarenotsupported.

DataDrive# Upto22L2ARC n/aZIL/SLOG 2x200GBHighEnduranceSSDdevice

Note1:Nochassismanagementprovided.Note2:BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.



1.2.2 CiscoC240andSeagateHybrid/All-DiskCiscoandSeagateRA NCS-84 NCS-168 NCS-252 NCS-336

MaxRawCapacity

Upto840TB Upto1,680TB Upto2,520TB Upto3,360TB

DeviceSlots 84 168 252 336FormFactor(HA)

9U 14U 19U 24U

Memory(HA) 512GB

ReadCache Upto400GB Upto800GB10GbEPorts 4Software NexentaStor5.x

CiscoandSeagateRA NCS-84 NCS-168 NCS-252 NCS-336

Controller 2xC240M4SX


DRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)






FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562,QLE2672

StorageEnclosure

1xSeagateSP-2584 2xSeagateSP-2584 3xSeagateSP-2584 4xSeagateSP-2584

DataDrive# Upto84 Upto168 Upto252 Upto336

DataHDD

Seagate2TBNLSAS7.2PN:ST2000NM0135Seagate4TBNLSAS7.2PN:ST4000NM0125Seagate6TBNLSAS7.2PN:ST6000NM0095Seagate8TBNLSAS7.2PN:ST8000NM0075

Seagate10TBNLSAS7.2PN:ST10000NM0086L2ARC(Optional)

Seagate1200.2400GBSSD3DWPDperpoolPN:ST400FM0303

ZIL/SLOG(Optional)

PairofSeagate1200.2200GB25DWPDSSDperpoolPN:ST200FM0133

Note1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2:Inordertosupportthehighestlevelsofperformance,resilienceandredundancyforaNexentaStordeployment,SAScabling

fromtheheadnodestotheJBODshouldtrackthefollowingrulesofthumb:• Unlessotherwisespecified,allJBODsshouldbedirectconnectedtoSASHBAs,nointermediateSASswitches,nochaining

ofJBODs.• CablingforHAconfigurationsshouldbeconnectedtoberedundantacrossHBAs,JBODsandJBODcontrollers/expanders.• CablingforHAconfigurationsshouldbeconsistentwiththeportsusedoneachnodefromtheHBAtotheportsonthe

JBODcontroller/expander.



1.2.3 CiscoC240andHGST4U60G2Hybrid/All-DiskCiscoandHGSTRA NCH-60 NCH-120 NCH-180 NCH-240

MaxRawCapacity

Upto696TB Upto1,416TB Upto2,136TB Upto2,856TB

DeviceSlots 60 120 180 240FormFactor(HA)

8U 12U 16U 20U

Memory(HA) 512GB

ReadCache 800GB Upto1.6TB10GbEPorts 4Software NexentaStor5.x

CiscoandHGSTRA NCH-60 NCH-120 NCH-180 NCH-240

Controller 2xC240M4SXCPU E5-2643v43.4GHz,6cores,2socketDRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)






FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562,QLE2672

StorageEnclosure

1xHGST4U60G2 2xHGST4U60G2 3xHGST4U60G2 4xHGST4U60G2

DataDrive# Upto60 Upto120 Upto180 Upto240

DataHDD

HGSTUltrastar6TBairHDDsHGSTUltrastar8TBheliumHDDsHGSTUltrastar10TBheliumHDDsHGSTUltrastar12TBheliumHDDs

L2ARC(Optional)

800GBSASSSD(3DWPD)perpool

ZIL/SLOG 2x400GBSASSSD(10DWPD)perpoolNote1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2: UsedualSASpathforconfigurationswithupto4enclosures.Note3: ChassismanagementfortheHGST4U60G2enclosureissupportedinNexentaStor5.1andup.



2 AboutNexentaNexentaisthegloballeaderinOpenSource-drivenSoftware-DefinedStorage(OpenSDS).Foundedin2005with6,000+customersandmorethan2,000petabytesofstorageundermanagement,ourprivatelyheldcompanydelivers100%Software-basedstoragesolutions,providingorganizationswithTotalFreedomtochooseaneasy-to-use,secureandultra-lowcoststoragesolutiontofittheirneeds.Nexentaenableseverydayapps;fromtheInternetofThingstoBigData;fromOpenStacktoContainers–andalltypesofClouds–Private,Public,andHybrid.Foundedaroundanopensourceplatformandindustry-disruptingvision,Nexentadeliversitsaward-andpatent-winningsoftware-onlyunifiedstoragemanagementsolutions24x7-aroundtheglobe-serviceandsupport.NexentahasanAllLoveapproachwithitsglobalpartnernetwork,includingsolutionintegrationwithtophardwarepartnerstodelivervalidatedandcertifiedOpenSDSsolutionstofityourbusinessrequirements.Formoreinformation,visitwww.nexenta.com,Twitter,Facebook,LinkedInandYouTube.Nexenta,NexentaStor,NexentaFusion,NexentaEdgeandNexentaCloudaretrademarksorregisteredtrademarksofNexentaSystemsInc.,intheUnitedStatesandothercountries.Allothertrademarks,servicemarksandcompanynamesmentionedinthisdocumentarepropertiesoftheirrespectiveowners.



AppendixB:LegacyConfigurationsThissectiondocumentslegacyconfigurations:configurationsthatcontinuetobesupportedeventhoughtheyarenolongerthepreferredsolutionsfornewdeployments.

B.1 CiscoLegacyConfigurations

B.1.1 CiscoC240andSanDiskInfiniFlashAll-FlashCiscoandSanDiskRA NCIF-AF-512 NCIF-AF-1024 NCIF-AF-1536 NCIF-AF-2048

RawCapacity Upto512TB Upto1024TB Upto1536TB Upto2048TBDeviceSlots 64 128 192 256FormFactor(HA)

7U 10U 13U 16U

Memory(HA)

512GB

10GbEPorts 4Software NexentaStor5.x

CiscoandSanDiskRA NCIF-AF-512 NCIF-AF-1024 NCIF-AF-1536 NCIF-AF-2048

Controller 1xor2xC240M4SX


DRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)






FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562.QLE2672

StorageEnclosure

1xInfiniFlashIF150 2xInfiniFlashIF150 3xInfiniFlashIF150 4xInfiniFlashIF150

DataDevice# Upto64 Upto128 Upto192 Upto256FlashDevice 4TBor8TBFlashModuleL2ARC n/aZIL/SLOG n/a

Note1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2: SanDiskInfiniFlashIF150SAScontrollerfirmwareversionisA01Eorlater.SeesupportedgeneralpurposeBSSDsinAppendixA.Note3:SAScablingbetweentheNexentaStornodeandtheInfiniFlashIF150enclosureshouldfollowIF150A.2cablingtopologywhere

eachNexentaStornodeisconnectedtoasingleSAScontrollerontheIF150.Note4: ThereisnoneedforseparateZILorL2ARCdevicesinall-SSDconfigurations.Nexentarequiresaminimumof128TBofrawflash

forNexentaStorandSanDiskIF150configurationsdeployedinproductionenvironments.

Documents

NexentaStor 5.0 Reference Architecture - Nexenta | … following reference architectures are based on the following HGST 2U24 Flash Storage Platforms: HGST Model Number Configuration