Download pdf - SPC performance report - Silverton Consultingsilvertonconsulting.com/nwsa/SCISPC160226-010.pdf · SPC performance report ... there’s a slight advantage to the pricing here for the

TWITTER.COM/RAYLUCCHESI|RAYONSTORAGE.COM|GREYBEARDSONSTORAGE.COM|1-720-221-7270|SILVERTONCONSULTING.COM©2016SILVERTONCONSULTING,INC.ALLRIGHTSRESERVED

SPC performance report SilvertonConsulting,Inc.StorInt™DispatchThisStorageIntelligence(StorInt™)dispatchcoversStoragePerformanceCouncil(SPC)results1.Therehavebeenthreenew(andoneupdated)SPC-1/1EandonenewSPC-2submissionssinceourlastreportlastNovember.ThenewSPC-1/1EresultsarefortheDataCoreSANSymphoneyV10,theMacroSANMS5520andtheNECStorageM510andthenewSPC2submissionwasHuaweiOceanStor6800V3.Wehaveamixofallflash,hybridandalldiskstoragesystemsthistime.

SPC-1resultsWebeginourdiscussionwithtoptenSPC-1LRT™(LeastResponseTime)resultsshowninFigure1.

Figure1Top10SPC-1LRTresults

ThenewDataCoreSANSymphonyV10isournew#1withanLRTof80µsec.SANSymphonyinthissubmissionactedasahyperconverged,softwaredefinedstoragesystem,onlywith16SATAattached,SFFSamsung480GBSSDsand815Krpm300GBdiskdrives,withabout419GBofDRAMcache.Evenat100%ofIOworkloadtheirresponsetimewasonly0.32msec.TherearesomeadvantagestousinghyperconvergedsolutionforSPC:1)there’snostoragenetworkyouhavetotraverse,theywereusingainternalloopbackVirtualiSCSIlogical1AllSPCresultsavailablefromhttp://www.storageperformance.org/home/asof26Feb2016

26February2016 SCISPCPERFORMANCEREPORT PAGE2OF6


interfacetothestorageand2)theygettosharethememorywiththeSPCbenchmarkdriver,sooncethedatawasincacheitwasamemorytomemorytransfertoreadorwriteitfrom/tothestoragesystem.WetalkedwithDataCoreonthisSPC-1submissionandtheysaidtheotherthingwhichhelpedthemisenhancedparallelism.Itseemsliketheyhavere-discoveredmulti-thread/multi-corecodedesign.DataCoreseemedtohavecomeofageinhighperformancecomputingenvironmentandwhentheywenttostoragevirtualizationtheyhadtolimittheirmulti-processing/parallelism.Butwithallthecoresintoday’s,offtheshelf,servers,theywereabletoeliminatemost,ifnotalltheselimitationsandtheresultsarewhatyouseeabove.Iamjustnotsurethisisentirelyfairtotheothervendors,manymajor[andminor]vendorsoffersoftwaredefinedstorageoptionsoftheirsystemsandanyofthemcouldhavesubmittedaSPC-1benchmark.ButIwillgiveDataCorecreditforbeingthefirsthereandseewhattheindustryresponselookslikeovertime.Next,weturntooneofSCI’sflashbasedmetrics,toptenSPC-1IOPS/GB-NANDinFigure2.

Figure2SPC-1Top10IOPS™/GB-NAND



Firstletmeclarify,whenIclaimaSPC-1submissionas“all-SSD”or“all-flash”Iamconsideringanysystemwithmorethan50%ofASUcapacityinSSDsasanall-flashsystem.Yesmanyofthesehavediskdrives(e.g.DataCore)butthevastmajorityoftheircapacityisinflashandIbelieveit’sonlyfairtoplacethemintheallflashbucket.InFigure2,againwecanseetheresultsfromDataCore’ssubmission,whichcameinat#5ontheIOPS/GB-NANDmetric.HistoricallywehaveusedaIOPS/drivemetrictogaugetheefficiencyofdisk-onlystoragesystemsbutwehaveyettosettleononemeasureforflashorhybridbasedsystemsbuthavebeenmigratingtoIOPS/GB-NAND,asNANDiscommoditypricedraw-storageandseemstobeareasonablecounterparttodrivenormalization.WehaveusedSSDsinthepastaswell.Butforsomereasonthischartseemstodisplayamorediverseproductlistfromhigh-endenterprisesolutionsdowntoSMBstorageareallonthistop10.TheotherthingthatarguesforIOPS/GB-NANDvs.IOPS/SSDisthatsomevendorscreatetheirownflashmodulesandassuchhaveanunfairadvantagewhenitcomestoSSDs.ButthedebateisstillonandlastquarterweshowedIOPS/SSDsothisquarterwewentwithIOPS/GB-NAND.ThelastSPC-1chartisthetopten$/IOPSorSPC-1PricePerformanceinFigure3.



Figure3SPC-1Top$/IOPS

InFigure3,wedisplaySPC-1’sPricePerformancetoptenandDataCoreisournew#1hereaswell.With~460KIOPSandapriceunder$40Ktheywereabletoreach$0.08$/IOPS.Yetagainthere’saslightadvantagetothepricinghereforthesoftwaredefinedstoragesystembuttheydidincludetheLenovahardware,storage,andvarioussoftwarelicenses,soit’shardtofaultthem.ButtheyhadnoneedforHBA/NICsorFClinecardsthatothersystemswouldneedtodostandardstoragebenchmarks.Butevenat$8Kforapairofthem,itwouldn’tmakemuchofadentintheirplacementhere,theymightreachallthewayupto$0.10/IOPS.



SPC-2resultsInFigure4weshowourSPC-2MBPSspiderorradarchart,whichdepictstheachievementsforthethreeworkloadswhichmakeuptheSPC-2aggregateMBPS.

Figure4Top10SPC-2MBPSresults,spiderchart

ThenewHuaweiOceanStore6800V3camein4thplacewithanimpressiveMBPS42.8GB/sec.TheywouldhavedoneevenbetterwithalittleimprovementintheirVoDworkloadperformance.It’salsoimpressivethattheydidthiswith800diskdrivesratherthanflashthatthe#1&#2used.Thereappearstobeacontinuingmarketforall-disksystemsatleastforbandwidthintensiveworkloads..

SignificanceIt’salwaysgoodtoseenewSPC-1and-2submissions.Wehadagoodmixofflashanddiskonlysystemsthisquarterandoneofthedisk-onlysystemsmadeitintothetopten(forthroughput).DataCore’ssoftwaredefinedstoragerepresentsanewclassofsystemsatleastforSPC-1submissionsanditcameinwithimpressiveeconomicsaswellasresponsetime,anyresponsetimesub0.1msecseemsalmostmagicalinastoragesystem.

(5,000)

15,000

35,000

55,000

75,000HP3PARStoreServ20850

EMCVMAX400K

HPXP7

HuaweiOceanStor6800v3

Kaminario K2

OracleZFSStorageZS4-4Appliance

OracleZFSStorageZS3-4

OracleZFSStorageZS3-2appliance

FujitsuETERNUSDX8700S2

IBMDS8870

Top10SPC-2*SubsystemMB/sforworkloadsasof24Feb2016

LDQMB/s LFPMB/s VODMB/s



Wearestillplayingwithhowtomeasureflasheffectiveness.ThisquarterweusedIOPS/GB-NANDlastquarterIOPS/SSD.It’sunclearwhichisthesuperiormetricbuthopefullysomedaywewillreachclarityonthis.Asalways,suggestionsonhowtoimproveanyofourperformanceanalysesarewelcomed.Additionally,ifyouareinterestedinmoreblockstorageperformanceinformation,checkoutourrecentlyupdated(February,2016),SANStorageBuyingGuideavailableforpurchasefromourwebsite2.IntheBuyingGuidewenowprovidetop30resultsforsomeofourSPCperformancechartsandnew,SCIderived,OLTP,ThroughputandEmailChampionsCharts™forenterprise,all-flash,mid-rangeandSMBclassSANstoragesystems.

Silverton Consulting, Inc., is a U.S.-based Storage, Strategy & Systems consulting firm offering products and services to the data storage community

SANStorageBuyingGuideURLinQRcodeNewslettersignupURLinQRcode)

2Availableathttp://silvertonconsulting.com/cms1/products/san-storage-briefing/