w w w . i o m a r k . o r g
08Fall
IOmark-VDI
TintriT5060StorageSystemTestReport:VDI-160826-a
TestReportDate:26,August2016
Copyright©2010-2016EvaluatorGroup,Inc.Allrightsreserved.IOmark-VDIVM,IOmark-VDI,VDI-IOmark,andIOmarkaretrademarksofEvaluatorGroup,Inc.intheUnitedStatesandotherjurisdictions.
2 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
TableofContentsExecutiveSummary.....................................................................................................................................3VendorSuppliedProductDescription.........................................................................................................3IOmark-VDITestSummary..........................................................................................................................4IOmark-VDIResults......................................................................................................................................5TestedConfigurationDetails.......................................................................................................................6
HypervisorConfigurationforIOmark-VDIWorkload...............................................................................6StorageConfigurationforIOmark-VDIWorkload....................................................................................7ConfigurationDiagram.............................................................................................................................8Connectivity.............................................................................................................................................9TestedConfigurationPricing..................................................................................................................10DetailedResults.....................................................................................................................................11WhytheNeedforIOmark-VDI...............................................................................................................12HowIOmark-VDIOperates....................................................................................................................12BenchmarkApplicationWorkloadSet...................................................................................................13
VDIWorkload.....................................................................................................................................13UnderstandingResults...........................................................................................................................14
BenchmarkCriteria............................................................................................................................14MoreInformationaboutIOmark-VDI....................................................................................................14AboutEvaluatorGroup..........................................................................................................................14
IOmark-VDIVMTestReport 3
IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016
ExecutiveSummaryThisdocumentistheofficialbenchmarkreportforthetestedconfigurationwithaTintriT5060all-flashstoragesystemrunningtheIOmark-VDIbenchmark.IOmarkisastoragespecificworkloadandbenchmarkdesignedtoteststoragesystemsperformanceusingavarietyofrealworld,applicationcentricworkloads.TheIOmark-VDIbenchmarkisaspecificworkload,whichmeasuresvirtualdesktopworkloads(VDI)runagainststoragesystems.ResultsarepublishedafterauditandcertifiedapprovalbyIOmarkauthorizedauditors.IOmark-VDIisabenchmarkthatcertifiesstoragesystemsforvirtualdesktopworkloads.Themeasurementcriterionisstorageperformance,withtherestrictionthatallstorageworkloadsmustbesupportedbythetestedsystem.AlthoughthereareCPUandmemoryconsiderations,theseaspectsarenottestedbytheIOmark-VDIworkload.
TheresultsachievedbytheTintrisystemrunningIOmark-VDIareasfollows:• TheT5060supported3,000IOmark-VDIOfficeatacostof$75.00perVDIinstance
Afulldescriptionoftheconfigurationstestedalongwithpricinginformationisprovidedinthisdocument.Thecriteriaandperformancerequirementsareasfollows:
• Forallapplicationworkloads:o Allworkloadsmustresideentirelyonthetestedsystemo 70%ofresponsetimesforI/O’smustnotexceed30mso Thereplaytimemustcompletewithin1hourand15secondsforeach1-hourworkload
VendorSuppliedProductDescription
Tintrisimplystoresvirtualizedworkloads—offeringafullyintegratedVM-AwareStorage(VAS)systemforvirtualizedenterprisesandcloud.Balanceyourprojectsandworkloadsacrosshigh-performanceAll-Flashandaward-winningHybrid-Flash.Encrypteverythingwithasingleclick.ReplicateindividualVMstoremotelocations.SyncchildVMswithmasterVMstospeeddevelopmentcycles.AndmanageitALLfromasinglepaneofglass.That’showyoukeepstoragesimple.
Systemdesign,including:
• TintriVMstoreUI,drilldowntoVMandvirtualdisk,inTintriweb-consoleorHypervisorplugin• Supportformultiple,concurrentHypervisors(VMware,Hyper-V,KVMandXenServer)• Hypervisor-embeddedstorageforeaseofmanagementanddeploymentusingexistingtools• Consistentperformanceandlatencywithall-flashT5000series• OperationsmanagedperVM,includingQoS,snapshots,clonesandreplication
Tintriall-flashT5000seriessystemsprovidethefollowingenterprisestoragefeatures:
• Capacityfrom6TBto92TBraw,and17-308TBeffectivecapacitywithdatareduction• Tintriall-flasharraysassignI/OonaperVMbasis• Qualityofservice(QoS)settingsonindividualVMstoguaranteeperformance• Datareductionincludesdeduplication,compression,thinprovisioning,andzerocopy
optimization
4 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
IOmark-VDITestSummaryForthetestedconfiguration,thefollowingdataisprovided
Item Value
TestingIdentifier: VDI-160826-a
Product(s): TintriT5060
TestSponsor: Tintri
Auditor: EvaluatorGroupInc.
Table1:TestIdentifierInformation
Item Value
IOmark-VDIVersion: Version:IOmark-VDI3.8
TestingCompleted: July2016
EquipmentAvailability: August2015
AuditCertificationDate: 26,August2016
ReportDate: 26,August2016
Table2:TestRevisionandDates
IOmark-VDIVMTestReport 5
IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016
IOmark-VDIResultsShownbelowaretheIOmark-VDIresultsforthesystemundertest.ThedefinitionandworkloadcharacteristicsofthebenchmarkareprovidedinAppendixA.PriceinformationprovidedbelowisexplainedindetailinTable8inthisreport.AVDIusermaybeconfiguredtoruninoneoftwomodes:
• FullyProvisioned(Noclones-Requiresatleast14GBofhostprovisionedcapacity/VDIuserbeforecompression)
• LinkedClones(Hypervisorbasedclones-Requires4GBofhostcapacity/VDIuser)• Note:Actualcapacityutilizationonstoragemaybelower,dependingondatareductionrates
Foreachconfigurationrun,theresultsarereported.Tables3and4belowshowthenumberofuserssupported(asdefinedinAppendixA).
VDIMode IOmark-VDIOfficeWorker
TestedLogicalCapacity
TotalPrice Price/User
LinkedClone N/A N/A N/A N/A
FullyProvisioned 3,000 132.0TB $225,000.00 $75.00
Table3:IOmark-VDIOfficePrice-PerformanceResults
The“Office”workloadismeasuredduringasteady-stateperiodduringtheVDIworkload.Themeasurementperiodforthe“Office”workloaddiscardsthestartupandendportionsoftheworkloadandmeasuresa60-minutewindowduringthemiddleofa180-minuteworkload.TheresponsetimesummaryisshownbelowinTable4,withfurtherdetailsshowninFigures3and4.
VDIMode TestRAIDLevel AverageReadResp.Time
AverageWriteResp.Time
AverageResponseTime/VDIUser
LinkedClone N/A N/A N/A N/A
FullyProvisioned RAID6 2.33ms 2.23ms 2.41ms
Table4:IOmark-VDIOfficeResultDetails
AsshownaboveinTable4,the3,000FullyProvisionedOfficeusershadanaverageresponsetimeof2.41ms,whichislower(better)thantherequiredresponsetime.
6 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
TestedConfigurationDetailsThissectioncoverstheconnectivity,configurationandpricinginformationforthesystemundertest.
HypervisorConfigurationforIOmark-VDIWorkload• AsingleTintriT5060systemwasused• Multiplemountpointswerecreatedtothetwohostsusedfortesting• AvirtualdiskwascreatedforeachofthereportedIOmark-VDI’scertified(3000total)• Datareductionwasenabled
o UtilizedTintriclonesfordatadeduplicationratesofapproximately10:1o Datageneratedwas2:1compressibleo Thinprovisioningwasenabled,savingadditionalcapacityo RAIDlevelutilizedisnotuserselectable,usedTintridefaultsettings
Detailedconfigurationparametersforthesystemundertest,includingconnectivityareprovidedbelowinTable5.
StorageSystemParameter Value
Hypervisor VMwarevSphere™ESXi6
Numberofinterfacestothestoragesystem: 4PerNode(2/controller=4total)
Connectivitytostoragesystem: 2@10GbEthernet/controller
Hypervisorstorageprotocolused: NFSv3
Hypervisorversion: VMwareESXi6.0U2(3620759)
Thinprovisioning: UtilizedinTintridatastore
HypervisorStorageAccess: NFSdatastore
DatastoreFilesystem: NFS-filesystemaccesstoTintri
VAAI: Yes,usingTintriVAAIplugindrivers
SATP: N/A
PSP: N/A
TotalcapacityofsystemallocatedtoIOmark-VM: 6.6TiBusable(7.2TB)
Table5:HypervisorConfigurationParameters
NOTE:PerIOmarkrequirements,a“write-only”workloadisrunpriortotheactualworkload.Thispre-writesdatatoallstoragelocationsreferencedduringtesting.Bypre-writingdatapriortoactualworkloadtesting,thereisnowriteallocationpenaltyassociatedwiththinprovisioning.Thisalsoensuresthatwhenreadsareperformedthestoragesystemreadsthemedia,ratherthanreturningzero’sforunallocatedaddresses.
IOmark-VDIVMTestReport 7
IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016
StorageConfigurationforIOmark-VDIWorkload• AsingleTintriT5060providedthepooledcapacityacrossbothofthehosttestnodes• 6datastoreswerecreatedoneachhostfortesting(12total)• EachVM’sVMDKwasallocatedusing“thinprovisioning”perTintriandNFSdefault
DetailedStorageSystemconfigurationparametersforthestoragesystemundertest,includingconnectivityisprovidedbelowinTable6.
StorageSystemParameter Value
StorageSystemfirmware Tintri4.2.0.6
HighAvailabilityAccess Yes(active/standby)
Totalrawcapacityofsystemundertest(SUT) 12TB
Totalusablecapacityofsystemundertest(SUT) 6.6TiB(7.2TB)usable,upto35+TBeffectivewithdatareduction
Datastores Totalof6datastores/host(NoLUNsrequired)
Thinprovisioning: Yes
RAIDLevel(s) Tintridefault,RAID6
TotalCacheCapacity: N/A
ReadCache: N/A
WriteCache: N/A
VAAIFeaturesEnabled: Yes
-NFSFullClone Yes
-NFSExtendedStats Yes
-NFSReserveSpace Yes
Automatedtieringwithinthestoragesystem: N/A(T5060isall-flash)
Deduplicationorcompressionofdata: Yes,bothin-lineandalwayson
Storagesystemclones/writeablesnapshots: Yes,utilizedstorageclonesduringtesting
Typeofstoragesystemclone: Tintrinativeclones
StorageMediaUtilized: -
-SSD’s 24x480GB(includesspares)
-15KRPM NA
-10KRPM NA
-7.2KRPM NA
Table6:StorageSystemConfigurationParameters
8 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
ConfigurationDiagramThelogicaldatalayoutofthetestconfigurationisshownbelowinFigure1.SinceTintriisanNFSdatastore,blockLUNsorvolumeswerenotutilized.Instead,individualvirtualdiskswereassignedtoVM’sasrequired,distributedacrossthe12logicalmountpoints.TheVMDK’sforeachVM’sworkloadwereallallocatedfromthesameTintriDatastorecapacitypoolcreatedbyTintriacrossthecomputenodes.
Figure1:LogicalSystemConfiguration
Note:AlthoughasingleNFSdatastorecouldhavebeenused,itwasdeterminedthatutilizingmoremountpointsimprovedperformance.Atotalof12mountpointswereused,whichequatesto12hostsystemsmountingasingleTintrishareddatastore.
TintriStoragePool–(12TBRawCapacity)
PooledCapacityfromTintriT5060Storage
IOmark-VDIWorkloadNodes
NFSMountPoints(6/Host)
32GB
VDIOfficeVirtualDisks
3000@
IOmark-VDIVMTestReport 9
IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016
ConnectivityStorageconnectivityusedwas10GbE,usingLACPtobondthetwonetworkinterfacespercontroller.Eachtesthostused210GbElinkstoa10GbEthernetswitch,foratotalof8connectionsacrossboththetwohostsandthedualcontrollerT5060.TestingdidnotutilizearedundantHAconfiguration,althoughproductiondeploymentassumesconnectivitytoaHAnetworkinfrastructure.ThetestedconfigurationconnectivitydiagramisshownbelowinFigure2.
Figure2:PhysicalSystemConnectivity
10 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
TestedConfigurationPricing
Item Description Qty. Ext.ListPrice
1 TintriT5060(Includesbasesoftware) 1system $225,000.00
2 Tintri3yearsmaintenance Included N/A
Total ListPriceHW+SW+3yearservice&support $225,000.00
Table7:IOmark-VDIPriceInformationforTestedTintriT5060Configuration
Note:Supportincludedforallhardwareandsoftware
IOmark-VDIVMTestReport 11
IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016
DetailedResultsIOmark-VDIperformanceresultsaremeasuredbyapplicationworkload.Thecumulativeresponsetimesofall3,000OfficeVDIusersthatcomprisedthetestworkloadareshownbelowinFigure3.
Figure3:PercentageofTotalResponseTimesatMeasuredValue
FromFigure3above,theprimaryresponsetime(s)ofinterestare:
• Morethan90%ofresponsetimeswerelessthan5ms.• 99.82%ofresponsetimeswerelessthan30ms.(exceedingrequirementsof70%)
0
0.2
0.4
0.6
0.8
1
1.2
2 5 10 20 30 60 100
Percen
tageofV
alue
s
ResponseTimeinms.
CumuladveResponseTimes
Tintri3000VDI
12 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
AppendixA-IOmark-VDIOverviewTheabilitytorecreateaknownworkloadisimportantforcomparingasystemagainstpotentialalternatives.EstablishingareferenceorbenchmarkworkloadenablessystemvendorsaswellasresellersandITuserstocompareseveralsystemsutilizingaknownworkload.Specifically,theIOmark-VDIbenchmarkrecreatesastorageworkloadthattypicallyoccursinvirtualdesktopinfrastructureenvironments.Theworkloadisnon-syntheticandrecreatesseveralapplicationsthatarecommonlyfoundinvirtualizedserverenvironments.
WhytheNeedforIOmark-VDICurrently,severalapplicationgeneratorshavebeendevelopedthatareabletogenerateVDIworkloads.However,thereisnostandardreferenceconfiguration,withtheprimaryfocusisontheserverinfrastructure.TherearenoexistingbenchmarkworkloadsfocusingonstorageandstoragesystemperformancewhilerunningVDIapplications.ByestablishingasetofstandardapplicationsandcapturingtheirI/Ostreams,itispossibletorecreateapplicationbasedstorageworkloadsforthesecomplexenvironments.IOmark-VDIisdesignedutilizingtheseconcepts,andassuchisthefirstbenchmarkdesignedtoaccuratelygenerateapplicationworkloadsforstoragesystems,enablingdirectcomparisonofstoragesystemconfigurationsandtheirabilitytosupportaspecificnumberofapplications.
HowIOmark-VDIOperatesIOmark-VDIusestheconceptofworkloadreplay.I/Ostreamsarecapturedfromactualrunningapplicationsandthen“replayed”sothattheexactsequenceandI/Ocommandsareissued.Thisallowsthecreationofaworkloadthatisindistinguishablefromanactualworkloadtothesystemundertest,whilebeingreproducibleandrequiringfewerresources.Additionally,thetestenvironmentislessexpensive,easierandfastertocreatesinceactualapplicationsarenotrequired.BecauseCPUandmemoryarenotconsumedrunningapplications,amuchhigherI/Oworkloadmaybegeneratedwithasetofserverresourcesthanispossibleusingnativeapplications.Thisratioistypically10:1,butmayvary.Inordertoscaleuptheworkloadonastoragesystem,additionalVDIworkloadsmaybeaddedtothesame,ortootherphysicalhosts.Theonlylimitationtothescaleofthetestisthephysicalinfrastructuresupportingtheworkload.Sufficient,CPU,memoryandI/Ocapabilitiesmustbeavailabletorunadditionalworkloadsets.Unlikeartificialworkloadgenerationtools,IOmark-VDIrecreatesaccuratereadvs.writeandrandomvs.sequentialI/Orequests.AnotherbenefitofIOmark-VDIisthefactthatitcreatesaccurateaccesspatterns,thusenablingstoragecachealgorithmstoworkproperly.Finally,IOmark-VDImaintainsanaccurateratioofperformancetocapacityasworkloadsarescaled,ensuringthatstorageperformanceismeasuredwithrespecttostoragecapacityaccurately.Asaresult,IOmark-VDImaintainsanaccurateratioofI/Otocapacity,producingresultsapplicabletoITusers.
IOmark-VDIVMTestReport 13
IOmark-VDIVMTestIdentifier:VDIVM-160826-a ReportDate:26,August2016
BenchmarkApplicationWorkloadSet
VDIWorkload1. Viewsteadystateoperation
a. HeavyWorkerProfile–Average/VDIUseri. 12.52iops./Userii. 1.06MBps/User
b. StandardWorkerProfile–Average/VDIUseri. 6.26iops./Userii. 0.53MBps/User
2. BenchmarkCriteria:• 70%ofI/Oresponsetimesmustnotexceed30ms• Allstorageutilizedmustresideon/withinthestoragesystemundertest
VDIBenchmarkParameters• OperatingSystemdisksizeis20GB(thinlyprovisioned)• AllusersessionswererunningWindows7astheirguestOS• Nouserdatadiskutilized• VMwareLinkedclonesmaybeutilized(asnoted)• Storagelinkedclonesmaybeutilized(asnoted)• HeavyProfile:
o Theworkloadisnonsynthetic,actualI/Opatternsareissuedbasedonapplicationcapture
o ThesizeofI/O’sisvariable,rangingfrom512,upto2MBtransfersbasedonapplication• StandardUserProfile:
o Theworkloadisnonsynthetic,actualI/Opatternsareissuedascapturedo Ratesare50%of“Heavy”userprofileo ThesizeofI/O’sisvariable,rangingfrom512,upto2MBtransfers
VDIWorkloadGenerationTheworkloadgeneratorusedtogeneratetheVDIworkloadwasVMwareViewPlanner.Thisapplicationworkloadgeneratorcontrolledrunningthe8listedapplicationsabove,inaWindows764bitOSenvironment,runningasaguestVMinahypervisorenvironment.
14 IOmark-VDIVMTestReport
IOmark-VDIVM:TestIdentifier:VDIVM-160826-a ReportDate:26,August2016
VDIWorkloadDetailsThespecificapplicationscomprisingaVDIworkloadsetaredetailedbelowinTable8.
Application StorageCapacity/Instance
GuestOS(MicrosoftWin764bit) 20GB
MSOffice(Word,Excel,PowerPointandOutlook) N/A
MSInternetExplorer N/A
AdobeAcrobatReader N/A
WindowsMediaServer N/A
Windows7zip N/A
TotalVDIGuestEnvironment Total=20GB
Table8:IOmark-VDIGuestApplicationOverview
ThetotalcapacityrequiredforeachVDIuserisapproximately20GBoflogicalcapacity.Thecapacityrequiredforlinkedcloneusersis4GB,andthecapacityrequiredforfullyprovisionedusersis14GBwithoutdatadeduplicationorcompression.
UnderstandingResultsIOmark-VDIproducesresultsindicatingtheresponsetimeofastoragesystemgivenaparticularworkload.Basedonestablishedcriteria,theseresultsindicatehowmanyVDIsessionsaresupportedbyaspecificstorageconfigurationwithamaximumallowedresponsetime.ThereportisauditedforaccuracyandissuedbyEvaluatorGroup,Inc.,anindependentstorageanalystfirm.
BenchmarkCriteriaIOmarkhasestablishedthebenchmarkcriteriafortheIOmark-VDIworkload.Theperformancerequirementsareestablishedasfollows:
• Forallapplicationworkloads:o 70%ofresponsetimesforI/O’smustnotexceed30mso Allstoragemustresideonthestoragesystemundertesto Thereplaytimemustcompletewithin1hourand15secondsforeach1hourworkload
MoreInformationaboutIOmark-VDIFormoreinformationabouttheIOmarkbenchmark,atheoryofoperationsguide,publishedresultsandmore,visittheofficialwebsiteathttp://www.iomark.org.Somecontentisrestrictedtoregisteredusers,sopleaseregisteronthesitetoobtainallavailableinformationandthelatestresults.
AboutEvaluatorGroupEvaluatorGroupInc.isatechnologyresearchandadvisorycompanycoveringInformationManagement,StorageandSystems.ExecutivesandITManagersuseusdailytomakeinformeddecisionstoarchitectandpurchasesystemssupportingtheirdigitaldata.Wegetbeyondthetechnologylandscapebydefiningrequirementsandknowingtheproductsin-depthalongwiththeintricaciesthatdictatelong-termsuccessfulstrategies.Web:www.evaluatorgroup.comTwitter:@evaluator_group
Table of ContentsExecutive SummaryIOmark-VDI Test SummaryIOmark-VDI ResultsTested Configuration DetailsConfiguration DiagramTested Configuration PricingDetailed ResultsAppendix A - IOmark-VDI Overview