View
7
Download
0
Category
Preview:
Citation preview
Property of SwiftStack Inc.
Swi$Stack:HardwareReferenceArchitectures
ChrisNelsonDirector,SystemsEngineering
November2015
Slide 2
ImportantNotes
• ThefollowingslidesprovideexamplehardwareconfiguraGonsforcommonSwiHStackdeployments;whiletheymaybeagreatstarGngpointtoahardwaredesignconversaGon,theyarenotfixedinstone,andmanyothercombinaGonsofhardwaremayalsobeappropriateforagivenapplicaGonworkload.
• ThebestguidanceforhardwaredesignforSwiHStackdeploymentsis,“don’tovercomplicateit!”
• Tounderstandthelogicbehindthefollowingexamplearchitectures,readhPps://swiHstack.com/docs/admin/hardware.html
• Mostimportantly,contactSwiHStackifyouhavequesGons,andwewouldbegladtohelpyouplanforsuccess.
Slide 3
HardwareBuildingBlocksPhase Size
ExpandbyAdding... GeneralUseCases ArchiveUseCase HighPerformanceUseCases
TesFng
Small
Nodes
1-Fermodel:PACO3zonesx1+PACOnodeperzone
=3+nodesEachnodehas3+harddrives X
Prod
ucFon
Small
100TButo
1PBu
Nodes
1-Fermodel:PACO3zonesx3+PACOnodesperzone
=9+nodesEachnodehas12-24harddrives
PACONode: LoworMed-PerfCPU,32-64GBRAM
2xSSDs12-24HDDspernode
X
Medium
1PButo
10PBu
Racks
2-Fermodel:P/ACO1zoneperrack
Eachrackcontains:• 1MgmtSwitch• 1Top-of-Rackswitch• 2ProxyNodes• 10-15ACONodes
PNode: MedorHigh-PerfCPU,64-128GBRAMACONode: MedorHigh-PerfCPU,64-128GBRAM
2xSSDs~30HDDspernode
2-Fermodel:P/ACO1zoneperrack
Eachrackcontains:• 1MgmtSwitch• 1Top-of-Rackswitch• 1ProxyNode• 7-10ACONodes
PNode: Low-perfCPU,32-64GBRAMACONode: Low-perfCPU,32-64GBRAM
2xSSDs~60HDDspernode
3-Fermodel:P/AC/O1zoneperrack
Eachrackcontains• 1MgmtSwitch• 1Top-of-Rackswitch• 4PNodes• 4ACNodes• 10-20Onodes
PNode: High-perfCPU,64-128GBRAMACNode: High-perfCPU,64-128GBRAM
3xSSDsONode: High-perfCPU,64-128GBRAM
~12HDDspernode
Large
5PButo
>100PBu
Manyracks
CUSTOM:
2-Ger(P/ACO)or3-Ger(P/AC/O)designCustomzones
CustomrackdesigntunedforusecaseandgrowthpaPern
Slide 4
Small:TesGng&General/MixedUseCases
Vendor Generic Supermicro Quanta HP Cisco Seagate Dell
UseCases• TesGng• Sub-petabyteproducGonenvironments
Benefits• Startsmall(~150TBuseable),andgrowfromthere• Buy“bythenode”• Single-Gerarchitectureletsyouscalesimply
GeneralDesign • Inthissingle-Germodel,eachnodeperformsallservices—includingproxy,account/container,andobjectservices.
ExamplePACONodes*
• 2xCPUs(e.g.,E5-2620v3)• 32-64GBDRAM• Bootdrives/SATADOM• 12x3.5”HHD• 1xdual-port1GbE• 1x1GbEmgmtport
826BE16-R920LPB S210-X22RQ
DL380-or-
DL360+D3600C240
Generic1uServer+
Seagate4u24JBOD
R730XD
CPU&SSDRaFos• Forlargeobjectcounts(i.e.,1–10millionobjectsinasinglecontainer),add1xSSD(atleast100GB)pernodeforaccount/containerdata• ForCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast2:3
RecommendaFons• FortesGngenvironments,startwith3nodes• ForproducGonenvironments,startwith9nodes(3zones,3nodesperzone),andaddcapacity3nodesataGme.
NetworkSwitches&RackConfiguraFon
• 1xTop-of-Rack(ToR)Switchwith48x1GbEportsand4x10GbEuplinkports• 1xManagementSwitchwith48x1GbEports• PACONodes(andloadbalancer(s)ifnotinstalledelsewhere)
*Hardware vendors may offer newer or different models which are perfectly appropriate. SwiftStack is very flexible; find hardware that roughly matches the “Generic” requirements, and deploy with confidence.
Slide 5
Medium:General/MixedUseCases
Vendor Generic Supermicro Quanta HP Cisco Seagate Dell
UseCases• MostobjectstorageusecasesuptoandincludingliveapplicaGoncontentstorage• GreatforrepatriaGonofdatafrompublic-cloudobjectstorageproviders
Benefits• CapaciGesvarybydensityofvendorchassis,• Buy“bytherack”at~500TBusableperrack(with4TBdrives)• Typicallystrongcost/performanceraGos
GeneralDesign
• 2Proxynodesperrack• FilluptoremainingrackspacewithAccount/Container/Object(ACO)nodes
ExampleProxyNodes*
• 2xCPUs(e.g.E5-2620v3)• 64-128GBDRAM• Bootdrives/SATADOM• 1xdual-port10GbE• 1x1GbEmgmtport
SYS-6017R-TDLRF
S810-X52L(1node) DL360 C220 Generic1uServer R630
ExampleACONodes*
• 2xCPUs(e.g.,E5-2620v3)• 64-128GBDRAM• Mirroredbootdrives• 1xdual-port10GbE• 1x1GbEmgmtport• 1xSASHBA• JBODwithHDDs(andSSDs)
SSG-6047-E1R36L
S810-X52L(1node)+½M4600H
DL360+½D6000-or-
DL360+2xD3600
C3160(equivalentto
2nodes)
Generic1uServer+
½Seagate5u84JBOD
R630+½MD3060e
CPU&SSDRaFos• IncludeSSDsinproxyorACOnodesforaccount/containerdatasuchthattheraGoofSSDstoobjectHDDsisapproximately1:15• ForobjectserverCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast2:3
RecommendaFons• Startwith3racks(1zoneperrack)• Expandbyadding3racksataGme
NetworkSwitches&RackConfiguraFon
• 1xTop-of-Rack(ToR)Switchwith48x10GbEports• 1xManagementSwitchwith48x1GbEports• Proxy&ACOnodes(andloadbalancer(s)ifnotinstalledelsewhere)
*Hardware vendors may offer newer or different models which are perfectly appropriate. Swift is very flexible; find hardware that roughly matches the “Generic” requirements, and deploy with confidence.
Slide 6
Medium:ArchiveUseCases
Vendor Generic Supermicro Quanta HP Cisco Seagate Dell
UseCases• Archive(writeonce,readrarely)• Greatforstoringpreviouslyofflineornear-linecontent
Benefits• CapaciGesvarybydensityofvendorchassis• Buy“bytherack”at~500TBusableperrack(with4TBdrives)• Typicallystrongcost/capacityraGos
GeneralDesign
• 1Proxynodeperrack• FilluptoremainingrackspacewithAccount/Container/Object(ACO)nodes
ExampleProxyNodes*
• 2xCPUs(e.g.,E5-2620v3)• 32-64GBDRAM• Bootdrives/SATADOM• 1xdual-port10GbE• 1x1GbEmgmtport
SYS-6017R-TDLRF
S810-X52L(1node) DL360 C220 Generic1uServer R630
ExampleACONodes*
• 2xCPUs(e.g.,E5-2620v3)• 32-64GBRAM(128for>60HDDs)• Mirroredbootdrives• 1xdual-port10GbE• 1x1GbEmgmtport• 1xSASHBA• JBODwithHDDs(andSSDs)
2xSSG-6047-E1R36L
S810-X52L(1node)+M4600H
DL360+D6000-or-
DL380+5xD3600
C3160
Generic1uServer+
Seagate5u84JBOD
R630+MD3060e
CPU&SSDRaFos• IncludeSSDsinproxyorACOnodesforaccount/containerdatasuchthattheraGoofSSDstoobjectHDDsisapproximately1:30• ForobjectserverCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast1:3
RecommendaFons• Startwith3racks(1zoneperrack)• Expandbyadding3racksataGme
NetworkSwitches&RackConfiguraFon
• 1xTop-of-Rack(ToR)Switchwith48x10GbEports• 1xManagementSwitchwith48x1GbEports• Proxy&ACOnodes(andloadbalancer(s)ifnotinstalledelsewhere)
*Hardware vendors may offer newer or different models which are perfectly appropriate. Swift is very flexible; find hardware that roughly matches the “Generic” requirements, and deploy with confidence.
Slide 7
Medium:High-PerformanceUseCasesVendor Generic Supermicro Quanta HP Cisco Seagate Dell
UseCases• Highconcurrency,large-fileread/write,high-volumeread/writeworkloads• Greatforvideostorage,public-facingobjectstorage,andotherhigh-performanceworkloads
Benefits• CapaciGesvarybydensityofvendorchassis• Buy“bytherack”at~250TBusableperrack(with4TBdrives)• ScalethreeGersindependentlyforopGmalperformance
GeneralDesign
• 4Proxynodesperrack• 4Account/Containernodesperrack• ~16Objectnodesperrack
ExampleProxyNodes*
• 2xCPUs(e.g.,E5-2650v3)• 64-128GBDRAM• Bootdrives/SATADOM• 1xdual-port10GbE• 1x1GbEmgmtport
SYS-6017R-TDLRF
S810-X52L(1node) DL360 C220 N/A R630
ExampleAccount/Container
Nodes*
• 2xCPUs(e.g.,E5-2650v3)• 64-128GBDRAM• Mirroredbootdrives• 1xdual-port10GbE• 1x1GbEmgmtport• 3xSSDsw/1xSASHBA
SYS-6017R-TDLRF
S810-X52L(1node) DL360 C220 N/A R630
ExampleObjectNodes*
• 2xCPUs(e.g.,E5-2650v3)• 64-128GBDRAM• Mirroredbootdrives• 1xdual-port10GbE• 1x1GbEmgmtport• 12xHDDs
826BE16-R920LPB S210-X22RQ
DL380-or-
DL360+D3600C240 N/A R730XD
RaFos• TheraGoofSSDsintheaccount/containernodestoHDDsintheobjectnodesshouldbeapproximately1:15• ForobjectserverCPUs,choosemodelssuchthattheraGoof(sockets*cores*speed):HDDsisatleast1:1
RecommendaFons• Startwith3racks(1zoneperrack)• Expandbyadding3racksataGme
NetworkSwitches&RackConfiguraFon
• 1xTop-of-Rack(ToR)Switchwith48x10GbEports• 1xManagementSwitchwith48x1GbEports• Proxy,A/C,&Objectnodes(andloadbalancer(s)ifnotinstalledelsewhere)
*Hardware vendors may offer newer or different models which are perfectly appropriate. Swift is very flexible; find hardware that roughly matches the “Generic” requirements, and deploy with confidence.
Recommended