Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com NexentaStor_Cisco5_2018Q2
April2018
NexentaStor5.xReferenceArchitecture
CiscoNexentaStor5.xReferenceArchitectureGuide
2 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
TableofContents
TableofContents.............................................................................................................................2
Preface.............................................................................................................................................3IntendedAudience.................................................................................................................................................................................3Comments..................................................................................................................................................................................................3Copyright,Trademarks,andCompliance.....................................................................................................................................31 CiscoReferenceArchitectures....................................................................................................41.1 CiscoAll-FlashConfigurations..............................................................................................................................................41.1.1 CiscoC240andHGST2U24All-Flash...............................................................................................................................4
1.2 CiscoHybrid/All-DiskConfigurations.............................................................................................................................51.2.1 CiscoC240StandaloneHybrid............................................................................................................................................51.2.2 CiscoC240andSeagateHybrid/All-Disk.....................................................................................................................61.2.3 CiscoC240andHGST4U60G2Hybrid/All-Disk........................................................................................................7
2 AboutNexenta...........................................................................................................................8
AppendixB:LegacyConfigurations...................................................................................................9B.1 CiscoLegacyConfigurations..................................................................................................................................................9B.1.1 CiscoC240andSanDiskInfiniFlashAll-Flash..............................................................................................................9
CiscoNexentaStor5.xReferenceArchitectureGuide
3 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
PrefaceIntendedAudienceThisdocumentisintendedforNexentapartnersandNexentacustomer-facingorganizations.ThelatestversionofthisdocumentisavailablethroughtheNexentaPartnerPortal.
CommentsForcommentsandinquiries,[email protected],sections,andparagraphswheneverpossible.
Copyright,Trademarks,andComplianceCopyright©2018NexentaSystems™,ALLRIGHTSRESERVEDNotice:Nopartofthispublicationmaybereproducedortransmittedinanyformorbyanymeans,electronicormechanical,includingphotocopyingandrecording,orstoredinadatabaseorretrievalsystemforanypurposewithouttheexpresswrittenpermissionofNexentaSystems(hereinafterreferredtoas“Nexenta”).Nexentareservestherighttomakechangestothisdocumentatanytimewithoutnoticeandassumesnoresponsibilityforitsuse.NexentaproductsandservicesonlycanbeorderedunderthetermsandconditionsofNexentaSystems’applicableagreements.Allofthefeaturesdescribedinthisdocumentmaynotbeavailablecurrently.RefertothelatestproductannouncementorcontactyourlocalNexentaSystemssalesofficeforinformationonfeatureandproductavailability.Thisdocumentincludesthelatestinformationavailableatthetimeofpublication.Nexenta,NexentaStor,NexentaFusion,NexentaEdgeandNexentaCloudareregisteredtrademarksofNexentaSystemsintheUnitedStatesandothercountries.Allothertrademarks,servicemarks,andcompanynamesinthisdocumentarepropertiesoftheirrespectiveowners.
CiscoNexentaStor5.xReferenceArchitectureGuide
4 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
1 CiscoReferenceArchitectures
1.1 CiscoAll-FlashConfigurationsNexentaStorAll-FlashconfigurationsdeliververyhighIOPSandsubmillisecondlatencyforsmallrandomIOworkloadsthataretypicalofdatabases,enterpriseapplicationsandhighperformanceprivatecloud(VMware,OpenStackandHyper–V)environments.
1.1.1 CiscoC240andHGST2U24All-FlashThefollowingreferencearchitecturesarebasedonthefollowingHGST2U24FlashStoragePlatforms:
HGSTModelNumber Configuration1ES0107 12x3.84TB1DWPDSASSSDs1ES0110 24x3.84TB1DWPDSASSSDs1ES0108 12x7.68TB1DWPDSASSSDs1ES0111 24x7.68TB1DWPDSASSSDs
CiscoandHGSTRA
NCH-AF-24 NCH-AF-48 NCH-AF-72 NCH-AF-96
RawCapacity Upto184TB Upto368TB Upto552TB Upto737TBDeviceSlots 24 48 72 96FormFactor(HA)
6U 8U 10U 12U
Memory(HA)
512GB
10GbEPorts 4Software NexentaStor5.x
CiscoandHGSTRA NCH-AF-24 NCH-AF-48 NCH-AF-72 NCH-AF-96
Controller 1xor2xC240M4SXCPU E5-2643v43.4GHz,6cores,2socketDRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)
1xCisco9300-8e12GbSAS
2xCisco9300-8e12GbSAS
3xCisco9300-8e12GbSAS
4xCisco9300-8e12GbSAS
NIC IntelX52010GbEDualPortSFP+IntelX54010GbEDualPortBaseT
FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562.QLE2672
StorageEnclosure
1xHGST2U24 2xHGST2U24 3xHGST2U24 4xHGST2U24
DataDevice# Upto24 Upto48 Upto72 Upto96
FlashDevice 3.84TBSASSSD(1DWPD)7.68TBSASSSD(1DWPD)
L2ARC n/aZIL/SLOG n/a
Note1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2: ThereisnoneedforseparateZILorL2ARCdevicesinall-SSDconfigurations.Note3: ChassismanagementfortheHGST2U24enclosureistargetedforNexentaStor5.1.1.
CiscoNexentaStor5.xReferenceArchitectureGuide
5 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
1.2 CiscoHybrid/All-DiskConfigurationsNexentaStorHybridconfigurationsdelivergreatsyncwriteperformanceandarebestsuitedformixedread/writeworkloadswithsmallrandomIOthataretypicalofprivatecloud(VMware,OpenStackandHyper-V)storagebackend,genericfileservicesandhighperformancebackupandarchiveusecases.NexentaStorAll-Diskconfigurationsarebestsuitedforbackupandarchivetypeusecases,sequentialworkloadsandreadintensiveworkloads.Ciscoserverandstorageenclosurepairingsarelimitedtothefollowingbuildingblocksonly.Variationsinthefollowingcomponentsarepermitted:Controller:CPUtype,DRAMcapacity,typeandcountforSASHBA,NICandFCHBAStorageenclosure:HDDtypeandcount,SSDtypeandcount
1.2.1 CiscoC240StandaloneHybridSinglenode(non-HA)storageappliancebasedonasingleCiscoC240M4SXrunningNexentaStor5.xina2Uchassis.
CiscoStandaloneRA
NC-H-24(Non-HA)
MaxRawCapacity Upto44TB(22x2TB)DeviceSlots 24FormFactor(total) 2UMemory(total) 128GBReadCache n/a10GbEPorts 2Software NexentaStor5.x
CiscoStandaloneRA NC-H-24(Non-HA)
Controller 1xCiscoC240M4SX
CPU E5-2680v32.5GHz,12cores,2socketE5-2643v43.4GHz,6cores,2socket
DRAM 128GB(8x16GB)BootDrive 2x480GBinternalSSDSASHBA n/aBuilt-inEthernet Inteli350dual-portonthemotherboard
NIC IntelX52010GbEDualPortSFP+IntelX54010GbEDualPortBaseT
FCHBA EmulexLPe12002,LPe16002-MC QLogicQLE2562,QLE2672
Storage
24x2.5”Data+internalBootdevices
DataHDD SeeCiscosupporteddeviceshereNotethatPCIedevicesarenotsupported.
DataDrive# Upto22L2ARC n/aZIL/SLOG 2x200GBHighEnduranceSSDdevice
Note1:Nochassismanagementprovided.Note2:BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.
CiscoNexentaStor5.xReferenceArchitectureGuide
6 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
1.2.2 CiscoC240andSeagateHybrid/All-DiskCiscoandSeagateRA NCS-84 NCS-168 NCS-252 NCS-336
MaxRawCapacity
Upto840TB Upto1,680TB Upto2,520TB Upto3,360TB
DeviceSlots 84 168 252 336FormFactor(HA)
9U 14U 19U 24U
Memory(HA) 512GB
ReadCache Upto400GB Upto800GB10GbEPorts 4Software NexentaStor5.x
CiscoandSeagateRA NCS-84 NCS-168 NCS-252 NCS-336
Controller 2xC240M4SX
CPU E5-2680v32.5GHz,12cores,2socketE5-2643v43.4GHz,6cores,2socket
DRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)
1xCisco9300-8e12GbSAS
2xCisco9300-8e12GbSAS
3xCisco9300-8e12GbSAS
4xCisco9300-8e12GbSAS
NIC IntelX52010GbEDualPortSFP+IntelX54010GbEDualPortBaseT
FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562,QLE2672
StorageEnclosure
1xSeagateSP-2584 2xSeagateSP-2584 3xSeagateSP-2584 4xSeagateSP-2584
DataDrive# Upto84 Upto168 Upto252 Upto336
DataHDD
Seagate2TBNLSAS7.2PN:ST2000NM0135Seagate4TBNLSAS7.2PN:ST4000NM0125Seagate6TBNLSAS7.2PN:ST6000NM0095Seagate8TBNLSAS7.2PN:ST8000NM0075
Seagate10TBNLSAS7.2PN:ST10000NM0086L2ARC(Optional)
Seagate1200.2400GBSSD3DWPDperpoolPN:ST400FM0303
ZIL/SLOG(Optional)
PairofSeagate1200.2200GB25DWPDSSDperpoolPN:ST200FM0133
Note1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2:Inordertosupportthehighestlevelsofperformance,resilienceandredundancyforaNexentaStordeployment,SAScabling
fromtheheadnodestotheJBODshouldtrackthefollowingrulesofthumb:• Unlessotherwisespecified,allJBODsshouldbedirectconnectedtoSASHBAs,nointermediateSASswitches,nochaining
ofJBODs.• CablingforHAconfigurationsshouldbeconnectedtoberedundantacrossHBAs,JBODsandJBODcontrollers/expanders.• CablingforHAconfigurationsshouldbeconsistentwiththeportsusedoneachnodefromtheHBAtotheportsonthe
JBODcontroller/expander.
CiscoNexentaStor5.xReferenceArchitectureGuide
7 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
1.2.3 CiscoC240andHGST4U60G2Hybrid/All-DiskCiscoandHGSTRA NCH-60 NCH-120 NCH-180 NCH-240
MaxRawCapacity
Upto696TB Upto1,416TB Upto2,136TB Upto2,856TB
DeviceSlots 60 120 180 240FormFactor(HA)
8U 12U 16U 20U
Memory(HA) 512GB
ReadCache 800GB Upto1.6TB10GbEPorts 4Software NexentaStor5.x
CiscoandHGSTRA NCH-60 NCH-120 NCH-180 NCH-240
Controller 2xC240M4SXCPU E5-2643v43.4GHz,6cores,2socketDRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)
1xCisco9300-8e12GbSAS
2xCisco9300-8e12GbSAS
3xCisco9300-8e12GbSAS
4xCisco9300-8e12GbSAS
NIC IntelX52010GbEDualPortSFP+IntelX54010GbEDualPortBaseT
FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562,QLE2672
StorageEnclosure
1xHGST4U60G2 2xHGST4U60G2 3xHGST4U60G2 4xHGST4U60G2
DataDrive# Upto60 Upto120 Upto180 Upto240
DataHDD
HGSTUltrastar6TBairHDDsHGSTUltrastar8TBheliumHDDsHGSTUltrastar10TBheliumHDDsHGSTUltrastar12TBheliumHDDs
L2ARC(Optional)
800GBSASSSD(3DWPD)perpool
ZIL/SLOG 2x400GBSASSSD(10DWPD)perpoolNote1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2: UsedualSASpathforconfigurationswithupto4enclosures.Note3: ChassismanagementfortheHGST4U60G2enclosureissupportedinNexentaStor5.1andup.
CiscoNexentaStor5.xReferenceArchitectureGuide
8 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
2 AboutNexentaNexentaisthegloballeaderinOpenSource-drivenSoftware-DefinedStorage(OpenSDS).Foundedin2005with6,000+customersandmorethan2,000petabytesofstorageundermanagement,ourprivatelyheldcompanydelivers100%Software-basedstoragesolutions,providingorganizationswithTotalFreedomtochooseaneasy-to-use,secureandultra-lowcoststoragesolutiontofittheirneeds.Nexentaenableseverydayapps;fromtheInternetofThingstoBigData;fromOpenStacktoContainers–andalltypesofClouds–Private,Public,andHybrid.Foundedaroundanopensourceplatformandindustry-disruptingvision,Nexentadeliversitsaward-andpatent-winningsoftware-onlyunifiedstoragemanagementsolutions24x7-aroundtheglobe-serviceandsupport.NexentahasanAllLoveapproachwithitsglobalpartnernetwork,includingsolutionintegrationwithtophardwarepartnerstodelivervalidatedandcertifiedOpenSDSsolutionstofityourbusinessrequirements.Formoreinformation,visitwww.nexenta.com,Twitter,Facebook,LinkedInandYouTube.Nexenta,NexentaStor,NexentaFusion,NexentaEdgeandNexentaCloudaretrademarksorregisteredtrademarksofNexentaSystemsInc.,intheUnitedStatesandothercountries.Allothertrademarks,servicemarksandcompanynamesmentionedinthisdocumentarepropertiesoftheirrespectiveowners.
CiscoNexentaStor5.xReferenceArchitectureGuide
9 Copyright©2018NexentaSystems,ALLRIGHTSRESERVEDwww.nexenta.com
AppendixB:LegacyConfigurationsThissectiondocumentslegacyconfigurations:configurationsthatcontinuetobesupportedeventhoughtheyarenolongerthepreferredsolutionsfornewdeployments.
B.1 CiscoLegacyConfigurations
B.1.1 CiscoC240andSanDiskInfiniFlashAll-FlashCiscoandSanDiskRA NCIF-AF-512 NCIF-AF-1024 NCIF-AF-1536 NCIF-AF-2048
RawCapacity Upto512TB Upto1024TB Upto1536TB Upto2048TBDeviceSlots 64 128 192 256FormFactor(HA)
7U 10U 13U 16U
Memory(HA)
512GB
10GbEPorts 4Software NexentaStor5.x
CiscoandSanDiskRA NCIF-AF-512 NCIF-AF-1024 NCIF-AF-1536 NCIF-AF-2048
Controller 1xor2xC240M4SX
CPU E5-2680v32.5GHz,12cores,2socketE5-2643v43.4GHz,6cores,2socket
DRAM 256GB(16x16GB)BootDrive 2x480GBinternalSSDSASHBA(external)
1xCisco9300-8e12GbSAS
2xCisco9300-8e12GbSAS
3xCisco9300-8e12GbSAS
4xCisco9300-8e12GbSAS
NIC IntelX52010GbEDualPortSFP+IntelX54010GbEDualPortBaseT
FCHBA EmulexLPe12002,LPe16002-MCQLogicQLE2562.QLE2672
StorageEnclosure
1xInfiniFlashIF150 2xInfiniFlashIF150 3xInfiniFlashIF150 4xInfiniFlashIF150
DataDevice# Upto64 Upto128 Upto192 Upto256FlashDevice 4TBor8TBFlashModuleL2ARC n/aZIL/SLOG n/a
Note1: BIOSversionforCiscoC240M4SXisC240M4.2.0.6a.0.051220151501orlater.Note2: SanDiskInfiniFlashIF150SAScontrollerfirmwareversionisA01Eorlater.SeesupportedgeneralpurposeBSSDsinAppendixA.Note3:SAScablingbetweentheNexentaStornodeandtheInfiniFlashIF150enclosureshouldfollowIF150A.2cablingtopologywhere
eachNexentaStornodeisconnectedtoasingleSAScontrollerontheIF150.Note4: ThereisnoneedforseparateZILorL2ARCdevicesinall-SSDconfigurations.Nexentarequiresaminimumof128TBofrawflash
forNexentaStorandSanDiskIF150configurationsdeployedinproductionenvironments.