IOmark VDI · 2019. 8. 8. · 2 IOmark-VDIVM Test Report! 9AB4(C0DE9DFK!L?>,!9@?:,)G)?(K!DE9DF0/1"#.104!! M?&%(,!E4,?K!.18!=6*6>,!."/1! Table of Contents 2N?;6,)3?!I6BB4(’!

w w w . i o m a r k . o r g

08Fall

IOmark-VDI

TintriT5060StorageSystemTestReport:VDI-160826-a

TestReportDate:26,August2016

Copyright©2010-2016EvaluatorGroup,Inc.Allrightsreserved.IOmark-VDIVM,IOmark-VDI,VDI-IOmark,andIOmarkaretrademarksofEvaluatorGroup,Inc.intheUnitedStatesandotherjurisdictions.

2 IOmark-VDIVMTestReport

IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016

TableofContentsExecutiveSummary.....................................................................................................................................3VendorSuppliedProductDescription.........................................................................................................3IOmark-VDITestSummary..........................................................................................................................4IOmark-VDIResults......................................................................................................................................5TestedConfigurationDetails.......................................................................................................................6

HypervisorConfigurationforIOmark-VDIWorkload...............................................................................6StorageConfigurationforIOmark-VDIWorkload....................................................................................7ConfigurationDiagram.............................................................................................................................8Connectivity.............................................................................................................................................9TestedConfigurationPricing..................................................................................................................10DetailedResults.....................................................................................................................................11WhytheNeedforIOmark-VDI...............................................................................................................12HowIOmark-VDIOperates....................................................................................................................12BenchmarkApplicationWorkloadSet...................................................................................................13

VDIWorkload.....................................................................................................................................13UnderstandingResults...........................................................................................................................14

BenchmarkCriteria............................................................................................................................14MoreInformationaboutIOmark-VDI....................................................................................................14AboutEvaluatorGroup..........................................................................................................................14

IOmark-VDIVMTestReport 3

IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016

ExecutiveSummaryThisdocumentistheofficialbenchmarkreportforthetestedconfigurationwithaTintriT5060all-flashstoragesystemrunningtheIOmark-VDIbenchmark.IOmarkisastoragespecificworkloadandbenchmarkdesignedtoteststoragesystemsperformanceusingavarietyofrealworld,applicationcentricworkloads.TheIOmark-VDIbenchmarkisaspecificworkload,whichmeasuresvirtualdesktopworkloads(VDI)runagainststoragesystems.ResultsarepublishedafterauditandcertifiedapprovalbyIOmarkauthorizedauditors.IOmark-VDIisabenchmarkthatcertifiesstoragesystemsforvirtualdesktopworkloads.Themeasurementcriterionisstorageperformance,withtherestrictionthatallstorageworkloadsmustbesupportedbythetestedsystem.AlthoughthereareCPUandmemoryconsiderations,theseaspectsarenottestedbytheIOmark-VDIworkload.

TheresultsachievedbytheTintrisystemrunningIOmark-VDIareasfollows:• TheT5060supported3,000IOmark-VDIOfficeatacostof$75.00perVDIinstance

Afulldescriptionoftheconfigurationstestedalongwithpricinginformationisprovidedinthisdocument.Thecriteriaandperformancerequirementsareasfollows:

• Forallapplicationworkloads:o Allworkloadsmustresideentirelyonthetestedsystemo 70%ofresponsetimesforI/O’smustnotexceed30mso Thereplaytimemustcompletewithin1hourand15secondsforeach1-hourworkload

VendorSuppliedProductDescription

Tintrisimplystoresvirtualizedworkloads—offeringafullyintegratedVM-AwareStorage(VAS)systemforvirtualizedenterprisesandcloud.Balanceyourprojectsandworkloadsacrosshigh-performanceAll-Flashandaward-winningHybrid-Flash.Encrypteverythingwithasingleclick.ReplicateindividualVMstoremotelocations.SyncchildVMswithmasterVMstospeeddevelopmentcycles.AndmanageitALLfromasinglepaneofglass.That’showyoukeepstoragesimple.

Systemdesign,including:

• TintriVMstoreUI,drilldowntoVMandvirtualdisk,inTintriweb-consoleorHypervisorplugin• Supportformultiple,concurrentHypervisors(VMware,Hyper-V,KVMandXenServer)• Hypervisor-embeddedstorageforeaseofmanagementanddeploymentusingexistingtools• Consistentperformanceandlatencywithall-flashT5000series• OperationsmanagedperVM,includingQoS,snapshots,clonesandreplication

Tintriall-flashT5000seriessystemsprovidethefollowingenterprisestoragefeatures:

• Capacityfrom6TBto92TBraw,and17-308TBeffectivecapacitywithdatareduction• Tintriall-flasharraysassignI/OonaperVMbasis• Qualityofservice(QoS)settingsonindividualVMstoguaranteeperformance• Datareductionincludesdeduplication,compression,thinprovisioning,andzerocopy

optimization



IOmark-VDITestSummaryForthetestedconfiguration,thefollowingdataisprovided

Item Value

TestingIdentifier: VDI-160826-a

Product(s): TintriT5060

TestSponsor: Tintri

Auditor: EvaluatorGroupInc.

Table1:TestIdentifierInformation

Item Value

IOmark-VDIVersion: Version:IOmark-VDI3.8

TestingCompleted: July2016

EquipmentAvailability: August2015

AuditCertificationDate: 26,August2016

ReportDate: 26,August2016

Table2:TestRevisionandDates



IOmark-VDIResultsShownbelowaretheIOmark-VDIresultsforthesystemundertest.ThedefinitionandworkloadcharacteristicsofthebenchmarkareprovidedinAppendixA.PriceinformationprovidedbelowisexplainedindetailinTable8inthisreport.AVDIusermaybeconfiguredtoruninoneoftwomodes:

• FullyProvisioned(Noclones-Requiresatleast14GBofhostprovisionedcapacity/VDIuserbeforecompression)

• LinkedClones(Hypervisorbasedclones-Requires4GBofhostcapacity/VDIuser)• Note:Actualcapacityutilizationonstoragemaybelower,dependingondatareductionrates

Foreachconfigurationrun,theresultsarereported.Tables3and4belowshowthenumberofuserssupported(asdefinedinAppendixA).

VDIMode IOmark-VDIOfficeWorker

TestedLogicalCapacity

TotalPrice Price/User

LinkedClone N/A N/A N/A N/A

FullyProvisioned 3,000 132.0TB $225,000.00 $75.00

Table3:IOmark-VDIOfficePrice-PerformanceResults

The“Office”workloadismeasuredduringasteady-stateperiodduringtheVDIworkload.Themeasurementperiodforthe“Office”workloaddiscardsthestartupandendportionsoftheworkloadandmeasuresa60-minutewindowduringthemiddleofa180-minuteworkload.TheresponsetimesummaryisshownbelowinTable4,withfurtherdetailsshowninFigures3and4.

VDIMode TestRAIDLevel AverageReadResp.Time

AverageWriteResp.Time

AverageResponseTime/VDIUser

LinkedClone N/A N/A N/A N/A

FullyProvisioned RAID6 2.33ms 2.23ms 2.41ms

Table4:IOmark-VDIOfficeResultDetails

AsshownaboveinTable4,the3,000FullyProvisionedOfficeusershadanaverageresponsetimeof2.41ms,whichislower(better)thantherequiredresponsetime.



TestedConfigurationDetailsThissectioncoverstheconnectivity,configurationandpricinginformationforthesystemundertest.

HypervisorConfigurationforIOmark-VDIWorkload• AsingleTintriT5060systemwasused• Multiplemountpointswerecreatedtothetwohostsusedfortesting• AvirtualdiskwascreatedforeachofthereportedIOmark-VDI’scertified(3000total)• Datareductionwasenabled

o UtilizedTintriclonesfordatadeduplicationratesofapproximately10:1o Datageneratedwas2:1compressibleo Thinprovisioningwasenabled,savingadditionalcapacityo RAIDlevelutilizedisnotuserselectable,usedTintridefaultsettings

Detailedconfigurationparametersforthesystemundertest,includingconnectivityareprovidedbelowinTable5.

StorageSystemParameter Value

Hypervisor VMwarevSphere™ESXi6

Numberofinterfacestothestoragesystem: 4PerNode(2/controller=4total)

Connectivitytostoragesystem: 2@10GbEthernet/controller

Hypervisorstorageprotocolused: NFSv3

Hypervisorversion: VMwareESXi6.0U2(3620759)

Thinprovisioning: UtilizedinTintridatastore

HypervisorStorageAccess: NFSdatastore

DatastoreFilesystem: NFS-filesystemaccesstoTintri

VAAI: Yes,usingTintriVAAIplugindrivers

SATP: N/A

PSP: N/A

TotalcapacityofsystemallocatedtoIOmark-VM: 6.6TiBusable(7.2TB)

Table5:HypervisorConfigurationParameters

NOTE:PerIOmarkrequirements,a“write-only”workloadisrunpriortotheactualworkload.Thispre-writesdatatoallstoragelocationsreferencedduringtesting.Bypre-writingdatapriortoactualworkloadtesting,thereisnowriteallocationpenaltyassociatedwiththinprovisioning.Thisalsoensuresthatwhenreadsareperformedthestoragesystemreadsthemedia,ratherthanreturningzero’sforunallocatedaddresses.



StorageConfigurationforIOmark-VDIWorkload• AsingleTintriT5060providedthepooledcapacityacrossbothofthehosttestnodes• 6datastoreswerecreatedoneachhostfortesting(12total)• EachVM’sVMDKwasallocatedusing“thinprovisioning”perTintriandNFSdefault

DetailedStorageSystemconfigurationparametersforthestoragesystemundertest,includingconnectivityisprovidedbelowinTable6.

StorageSystemParameter Value

StorageSystemfirmware Tintri4.2.0.6

HighAvailabilityAccess Yes(active/standby)

Totalrawcapacityofsystemundertest(SUT) 12TB

Totalusablecapacityofsystemundertest(SUT) 6.6TiB(7.2TB)usable,upto35+TBeffectivewithdatareduction

Datastores Totalof6datastores/host(NoLUNsrequired)

Thinprovisioning: Yes

RAIDLevel(s) Tintridefault,RAID6

TotalCacheCapacity: N/A

ReadCache: N/A

WriteCache: N/A

VAAIFeaturesEnabled: Yes

-NFSFullClone Yes

-NFSExtendedStats Yes

-NFSReserveSpace Yes

Automatedtieringwithinthestoragesystem: N/A(T5060isall-flash)

Deduplicationorcompressionofdata: Yes,bothin-lineandalwayson

Storagesystemclones/writeablesnapshots: Yes,utilizedstorageclonesduringtesting

Typeofstoragesystemclone: Tintrinativeclones

StorageMediaUtilized: -

-SSD’s 24x480GB(includesspares)

-15KRPM NA

-10KRPM NA

-7.2KRPM NA

Table6:StorageSystemConfigurationParameters



ConfigurationDiagramThelogicaldatalayoutofthetestconfigurationisshownbelowinFigure1.SinceTintriisanNFSdatastore,blockLUNsorvolumeswerenotutilized.Instead,individualvirtualdiskswereassignedtoVM’sasrequired,distributedacrossthe12logicalmountpoints.TheVMDK’sforeachVM’sworkloadwereallallocatedfromthesameTintriDatastorecapacitypoolcreatedbyTintriacrossthecomputenodes.

Figure1:LogicalSystemConfiguration

Note:AlthoughasingleNFSdatastorecouldhavebeenused,itwasdeterminedthatutilizingmoremountpointsimprovedperformance.Atotalof12mountpointswereused,whichequatesto12hostsystemsmountingasingleTintrishareddatastore.

TintriStoragePool–(12TBRawCapacity)

PooledCapacityfromTintriT5060Storage

IOmark-VDIWorkloadNodes

NFSMountPoints(6/Host)

32GB

VDIOfficeVirtualDisks

3000@



ConnectivityStorageconnectivityusedwas10GbE,usingLACPtobondthetwonetworkinterfacespercontroller.Eachtesthostused210GbElinkstoa10GbEthernetswitch,foratotalof8connectionsacrossboththetwohostsandthedualcontrollerT5060.TestingdidnotutilizearedundantHAconfiguration,althoughproductiondeploymentassumesconnectivitytoaHAnetworkinfrastructure.ThetestedconfigurationconnectivitydiagramisshownbelowinFigure2.

Figure2:PhysicalSystemConnectivity



TestedConfigurationPricing

Item Description Qty. Ext.ListPrice

1 TintriT5060(Includesbasesoftware) 1system $225,000.00

2 Tintri3yearsmaintenance Included N/A

Total ListPriceHW+SW+3yearservice&support $225,000.00

Table7:IOmark-VDIPriceInformationforTestedTintriT5060Configuration

Note:Supportincludedforallhardwareandsoftware



DetailedResultsIOmark-VDIperformanceresultsaremeasuredbyapplicationworkload.Thecumulativeresponsetimesofall3,000OfficeVDIusersthatcomprisedthetestworkloadareshownbelowinFigure3.

Figure3:PercentageofTotalResponseTimesatMeasuredValue

FromFigure3above,theprimaryresponsetime(s)ofinterestare:

• Morethan90%ofresponsetimeswerelessthan5ms.• 99.82%ofresponsetimeswerelessthan30ms.(exceedingrequirementsof70%)

0

0.2

0.4

0.6

0.8

1

1.2

2 5 10 20 30 60 100

Percen

tageofV

alue

s

ResponseTimeinms.

CumuladveResponseTimes

Tintri3000VDI



AppendixA-IOmark-VDIOverviewTheabilitytorecreateaknownworkloadisimportantforcomparingasystemagainstpotentialalternatives.EstablishingareferenceorbenchmarkworkloadenablessystemvendorsaswellasresellersandITuserstocompareseveralsystemsutilizingaknownworkload.Specifically,theIOmark-VDIbenchmarkrecreatesastorageworkloadthattypicallyoccursinvirtualdesktopinfrastructureenvironments.Theworkloadisnon-syntheticandrecreatesseveralapplicationsthatarecommonlyfoundinvirtualizedserverenvironments.

WhytheNeedforIOmark-VDICurrently,severalapplicationgeneratorshavebeendevelopedthatareabletogenerateVDIworkloads.However,thereisnostandardreferenceconfiguration,withtheprimaryfocusisontheserverinfrastructure.TherearenoexistingbenchmarkworkloadsfocusingonstorageandstoragesystemperformancewhilerunningVDIapplications.ByestablishingasetofstandardapplicationsandcapturingtheirI/Ostreams,itispossibletorecreateapplicationbasedstorageworkloadsforthesecomplexenvironments.IOmark-VDIisdesignedutilizingtheseconcepts,andassuchisthefirstbenchmarkdesignedtoaccuratelygenerateapplicationworkloadsforstoragesystems,enablingdirectcomparisonofstoragesystemconfigurationsandtheirabilitytosupportaspecificnumberofapplications.

HowIOmark-VDIOperatesIOmark-VDIusestheconceptofworkloadreplay.I/Ostreamsarecapturedfromactualrunningapplicationsandthen“replayed”sothattheexactsequenceandI/Ocommandsareissued.Thisallowsthecreationofaworkloadthatisindistinguishablefromanactualworkloadtothesystemundertest,whilebeingreproducibleandrequiringfewerresources.Additionally,thetestenvironmentislessexpensive,easierandfastertocreatesinceactualapplicationsarenotrequired.BecauseCPUandmemoryarenotconsumedrunningapplications,amuchhigherI/Oworkloadmaybegeneratedwithasetofserverresourcesthanispossibleusingnativeapplications.Thisratioistypically10:1,butmayvary.Inordertoscaleuptheworkloadonastoragesystem,additionalVDIworkloadsmaybeaddedtothesame,ortootherphysicalhosts.Theonlylimitationtothescaleofthetestisthephysicalinfrastructuresupportingtheworkload.Sufficient,CPU,memoryandI/Ocapabilitiesmustbeavailabletorunadditionalworkloadsets.Unlikeartificialworkloadgenerationtools,IOmark-VDIrecreatesaccuratereadvs.writeandrandomvs.sequentialI/Orequests.AnotherbenefitofIOmark-VDIisthefactthatitcreatesaccurateaccesspatterns,thusenablingstoragecachealgorithmstoworkproperly.Finally,IOmark-VDImaintainsanaccurateratioofperformancetocapacityasworkloadsarescaled,ensuringthatstorageperformanceismeasuredwithrespecttostoragecapacityaccurately.Asaresult,IOmark-VDImaintainsanaccurateratioofI/Otocapacity,producingresultsapplicabletoITusers.



BenchmarkApplicationWorkloadSet

VDIWorkload1. Viewsteadystateoperation

a. HeavyWorkerProfile–Average/VDIUseri. 12.52iops./Userii. 1.06MBps/User

b. StandardWorkerProfile–Average/VDIUseri. 6.26iops./Userii. 0.53MBps/User

2. BenchmarkCriteria:• 70%ofI/Oresponsetimesmustnotexceed30ms• Allstorageutilizedmustresideon/withinthestoragesystemundertest

VDIBenchmarkParameters• OperatingSystemdisksizeis20GB(thinlyprovisioned)• AllusersessionswererunningWindows7astheirguestOS• Nouserdatadiskutilized• VMwareLinkedclonesmaybeutilized(asnoted)• Storagelinkedclonesmaybeutilized(asnoted)• HeavyProfile:

o Theworkloadisnonsynthetic,actualI/Opatternsareissuedbasedonapplicationcapture

o ThesizeofI/O’sisvariable,rangingfrom512,upto2MBtransfersbasedonapplication• StandardUserProfile:

o Theworkloadisnonsynthetic,actualI/Opatternsareissuedascapturedo Ratesare50%of“Heavy”userprofileo ThesizeofI/O’sisvariable,rangingfrom512,upto2MBtransfers

VDIWorkloadGenerationTheworkloadgeneratorusedtogeneratetheVDIworkloadwasVMwareViewPlanner.Thisapplicationworkloadgeneratorcontrolledrunningthe8listedapplicationsabove,inaWindows764bitOSenvironment,runningasaguestVMinahypervisorenvironment.



VDIWorkloadDetailsThespecificapplicationscomprisingaVDIworkloadsetaredetailedbelowinTable8.

Application StorageCapacity/Instance

GuestOS(MicrosoftWin764bit) 20GB

MSOffice(Word,Excel,PowerPointandOutlook) N/A

MSInternetExplorer N/A

AdobeAcrobatReader N/A

WindowsMediaServer N/A

Windows7zip N/A

TotalVDIGuestEnvironment Total=20GB

Table8:IOmark-VDIGuestApplicationOverview

ThetotalcapacityrequiredforeachVDIuserisapproximately20GBoflogicalcapacity.Thecapacityrequiredforlinkedcloneusersis4GB,andthecapacityrequiredforfullyprovisionedusersis14GBwithoutdatadeduplicationorcompression.

UnderstandingResultsIOmark-VDIproducesresultsindicatingtheresponsetimeofastoragesystemgivenaparticularworkload.Basedonestablishedcriteria,theseresultsindicatehowmanyVDIsessionsaresupportedbyaspecificstorageconfigurationwithamaximumallowedresponsetime.ThereportisauditedforaccuracyandissuedbyEvaluatorGroup,Inc.,anindependentstorageanalystfirm.

BenchmarkCriteriaIOmarkhasestablishedthebenchmarkcriteriafortheIOmark-VDIworkload.Theperformancerequirementsareestablishedasfollows:

• Forallapplicationworkloads:o 70%ofresponsetimesforI/O’smustnotexceed30mso Allstoragemustresideonthestoragesystemundertesto Thereplaytimemustcompletewithin1hourand15secondsforeach1hourworkload

MoreInformationaboutIOmark-VDIFormoreinformationabouttheIOmarkbenchmark,atheoryofoperationsguide,publishedresultsandmore,visittheofficialwebsiteathttp://www.iomark.org.Somecontentisrestrictedtoregisteredusers,sopleaseregisteronthesitetoobtainallavailableinformationandthelatestresults.

AboutEvaluatorGroupEvaluatorGroupInc.isatechnologyresearchandadvisorycompanycoveringInformationManagement,StorageandSystems.ExecutivesandITManagersuseusdailytomakeinformeddecisionstoarchitectandpurchasesystemssupportingtheirdigitaldata.Wegetbeyondthetechnologylandscapebydefiningrequirementsandknowingtheproductsin-depthalongwiththeintricaciesthatdictatelong-termsuccessfulstrategies.Web:www.evaluatorgroup.comTwitter:@evaluator_group

Table of ContentsExecutive SummaryIOmark-VDI Test SummaryIOmark-VDI ResultsTested Configuration DetailsConfiguration DiagramTested Configuration PricingDetailed ResultsAppendix A - IOmark-VDI Overview

Documents

IOmark VDI · 2019. 8. 8. · 2 IOmark-VDIVM Test Report! 9AB4(C0DE9DFK!L?>,!9@?:,)G)?(K!DE9DF0/1"#.104!! M?&%(,!E4,?K!.18!=6*6>,!."/1! Table of Contents 2N?;6,)3?!I6BB4(’!