ISPT Isilon Fundamentals_SRG

Preview:

DESCRIPTION

EMC Isilon Course Material

Citation preview

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    WelcometoISPTIsilon Fundamentals.Copyright1996,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013EMCCorporation.AllRightsReserved.EMCbelievestheinformationinthispublicationisaccurateasofitspublicationdate.Theinformationissubject tochangewithoutnotice.THEINFORMATIONINTHISPUBLICATIONISPROVIDEDASIS.EMCCORPORATIONMAKESNOREPRESENTATIONSORWARRANTIESOFANYKINDWITHRESPECTTOTHEINFORMATIONINTHISPUBLICATION,ANDSPECIFICALLYDISCLAIMSIMPLIEDWARRANTIESOFMERCHANTABILITYORFITNESSFORAPARTICULARPURPOSE.

    Use,copying,anddistributionofanyEMCsoftwaredescribedinthispublicationrequiresanapplicablesoftwarelicense.EMC2,EMC,DataDomain,RSA,EMCCentera,EMCControlCenter,EMCLifeLine,EMCOnCourse,EMCProven,EMCSnap,EMCSourceOne,EMCStorageAdministrator,Acartus,AccessLogix,AdvantEdge,AlphaStor,ApplicationXtender,ArchiveXtender,Atmos,Authentica,AuthenticProblems,AutomatedResourceManager,AutoStart,AutoSwap,AVALONidm,Avamar,Captiva,CatalogSolution,CClip,Celerra,Celerra Replicator,Centera,CenterStage,CentraStar,ClaimPack,ClaimsEditor,CLARiiON,ClientPak,CodebookCorrelationTechnology,CommonInformationModel,ConfigurationIntelligence,Configuresoft,Connectrix,CopyCross,CopyPoint,Dantz,DatabaseXtender,DirectMatrixArchitecture,DiskXtender,DiskXtender 2000,DocumentSciences,Documentum,elnput,ELab,EmailXaminer,EmailXtender,Enginuity,eRoom,EventExplorer,FarPoint,FirstPass,FLARE,FormWare,Geosynchrony,GlobalFileVirtualization,GraphicVisualization,Greenplum,HighRoad,HomeBase,InfoMover,Infoscape,Infra,InputAccel,InputAccel Express,Invista,Ionix,ISIS,MaxRetriever,MediaStor,MirrorView,Navisphere,NetWorker,nLayers,OnAlert,OpenScale,PixTools,Powerlink,PowerPath,PowerSnap,QuickScan,Rainfinity,RepliCare,RepliStor,ResourcePak,Retrospect,RSA,theRSAlogo,SafeLine,SANAdvisor,SANCopy,SANManager,Smarts,SnapImage,SnapSure,SnapView,SRDF,StorageScope,SupportMate,SymmAPI,SymmEnabler,Symmetrix,Symmetrix DMX,Symmetrix VMAX,TimeFinder,UltraFlex,UltraPoint,UltraScale,Unisphere,VMAX,Vblock,Viewlets,VirtualMatrix,VirtualMatrixArchitecture,VirtualProvisioning,VisualSAN,VisualSRM,Voyence,VPLEX,VSAMAssist,WebXtender,xPression,xPresso,YottaYotta,theEMClogo,andwhereinformationlives,areregisteredtrademarksortrademarksofEMCCorporationintheUnitedStatesandothercountries.

    Allothertrademarksusedhereinarethepropertyoftheirrespectiveowners.

    Copyright2013EMCCorporation.Allrightsreserved.PublishedintheUSA.

    RevisionDate:November2013RevisionNumber:MR7WPISPTISIF_1.0

    1ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    This coursecoversEMCIsilons ScaleoutStoragePlatformpoweredbytheOneFSoperatingsystem. ItalsocoversEMCIsilons productlinesand broadrangeofoptionsandsoftwareapplications.ThiscourseisintendedforanyoneseekingtoestablishabasicunderstandingoftheEMCIsilonplatform.

    2ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    This moduledescribesEMC Isilons scaleoutsolution.BusinessrequirementsbyindustryarealsopresentedalongwithinformationonhowEMCIsilonmeets theserequirements.

    ISPT Isilon Fundamentals 3

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    LetsstartwithLifeSciencesresearch.Capacityandperformancearetwokeyconsiderations.Researchersplanforhundredsofterabytestopetabytes.Storagesystemscanbecomearesearchbottleneckwithouttherightlevelofperformance.Theabilitytodeliverhighperformancedataaccessinparalleltoalargeaggregateofclientsistypicallythedeterminingfactorfortotalprocessingtime.Mostresearchfacilitiessimplydonthavethestafftomanagecomplexstoragesolutions.Themanagementofanidealstoragesystemshouldnotrequireanyadditionalordedicatedworkers.Thesurveillanceindustryisinterestedindatasecurity,inadditiontomassivestoragecapacityrequirements.Protectingvideosurveillancedatafromaccidentalormaliciousalterationordeletionisamust.Videostreams,especiallyhigherresolutionandwithlongerretentionperiods,canconsumestoragerapidly,whichmeansstorageAdministratorsmustbeabletoscaletheirstorageinfrastructurequicklyandnondisruptively.Avideosurveillancestoragesystemcanquicklybecomeoverloadedasmorecamerasarebroughtonline.Systemsthatcannotkeepupwithagrowingsurveillanceworkloadwillcausedatatobedropped.

    ISPT Isilon Fundamentals 4

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Whenitcomestofinancialinstitutions,speedanddepthforperformingquantitativeanalysisisvitalingainingacompetitiveedge.Theseanalysisrequirehighperformanceandscalability.Companiesoftencantaffordworkstoppagesorslowdownstoupgradeequipment.Themediaandentertainmentindustryismadeupofavarietyoforganizationsandworkflows.Broadcastorganizationsneedtoreducecapitalandoperationalexpensesforstorageequipment.Postproductioncompaniesneedtostorevideoandaudiomodelswiththousandsofframesresultinginhundredsofterabytesofdata.Thereisconstantpressuretomeetaggressivetimetoproductiondeadlines,whichaddscomplexitytomanagement.Today,mediafilesizescontinuetoincreaseasresolutionsgrowfromHDto2K,4K,and8K,makingscalabilityanimportantissuetoconsider.

    ISPT Isilon Fundamentals 5

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    WiththetechnologicaladvancesinHealthcareapplications,thedatabeinggeneratedisgrowingatanunprecedentedrate.Applicationsareincreasinglydensewithmillionsofslidesand3Drendering.Havingastoragesystemthatcangrowlargeenoughtosupporttheseapplicationsischallenging.ThedifferentrequirementsforstoragewithintheHealthcareenvironmentareoftensolvedbycreatingmultiple"silos"ofstorage.Datawithdifferentretentionguidelinesorperformanceneedscannotexistwithinthesamestoragesystemintraditionalenvironments.Managingmultiple,differentiatedstoragesolutionsfordifferentdepartmentsrequiresalargeITworkforceandisbecomingincreasinglydifficulttomanage.ThereisahugeamountofdatagrowthintheOilandGasindustryasdemandforenergyhasneverbeenhigher.Inordertomakethemassiveamountsofdatauseful,therearetwokeychallenges;processingthedatainanadequate,timelymannerandenablingmoredetaileddatatobeavailableandcorrelatedwhennecessary.Thesearetechnical,algorithmicandorganizationchallengesandleadtolargeexpendituresofcompute,storage,andnetworkpower.

    ISPT Isilon Fundamentals 6

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    In ordertomeetallthepreviousbusinessrequirements,asolutionshouldbedesignedwith thecapabilitytoscalecapacity,memory,CPUsandnetworkingbysimplyaddingnodestoacluster.Nodescanbeaddedtotheclusterwhenevermoreperformance,connectivity,orcapacityisneeded.Theresourcesofallnodesarepooledtocreateapowerfulaggregatesystem.

    ISPT Isilon Fundamentals 7

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    EMCIsilonprovideshighlyscalable,ultrahighperformance,modularstoragesystems.Instoragesystemswithlimitedprocessingcapabilities,thereisacleartradeoffintermsofIOPSorthroughput.InascaleoutsystemsuchasIsilon,atradeoffisnotnecessary;filesanddirectorieswhichrequirehighIOPScanbeoptimizedforsuch,whereasotherswhichrequirehighthroughputcanbeoptimizedforthroughput.EMCIsiloncancontrolperformanceandlayoutcharacteristicsonaperfile,perdirectorybasisaswellasscaleoutbothCPU,cachememory,anddiskinasinglevolume.EMCIsilonscaleoutstoragesolutionsprovidesignificantvalueintheareasofsimplicity,scalability,performance,efficiency,dataprotectionandsecurity.Pleasetakeamomenttoreviewtheseareasdisplayedontheslide.

    ISPT Isilon Fundamentals 8

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    EMCIsilonwillmeetanyofthebusinessandtechnicalrequirements.Scalability Manyorganizations faceunpredictable storage and capacityrequirements. EMCIsilon scaleout NASsolutionsprovidenondisruptivescaleperformanceandcapacityintherightcombination,dependingontheusageaccesspatternorcontenttype.Availability EMCIsilonofferstheindustry'shighestlevelofendtoenddataprotection.Byofferinguptoquadruplefailureprotection,EMCIsilonensuresthatevenifuptofournodesordrivesfailsimultaneously,100%ofyourdataisstillavailable.Automaticreplicationofdatatoremotesitescanbeperformedwithoutimpactonothernetworkresources.ComplexityoftheEnvironment EMCIsilonissimpletobuy,build,maintain,andgrow.ItseasytomanagescaleoutNASsignificantlyreducesTCO.AdministrationoftheEnvironment WithEMCIsilonscaleoutNASyoudon'tneedtoaddstorageadministratorsasyourstoragegrows.Onepersoncanmanagepetabytesofdata,minimizingoperatingexpendituresandkeepingtheITstafffocusedonmanagingtheirdata,andnottheirstorage.

    ISPT Isilon Fundamentals 9

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ScaleupNetworkAttachedStorageisthetraditionalfilebasedstorageplatform.InaScaleuptechnology,scalabilityisachievedbyaddingmoredisks.ThereisaphysicallimitationtonumberofdisksthatonecanaddtoScaleupNASplatform.ThereperformanceofascaleupNASplatformcanbeimprovedonlybyreplacingtheprocessingsytems (NAShead/filer).EMCofferstwoscaleupNASdevices.TheEMCVNXesystemisaunifiedblockandfileplatform,specificallyIPstorage,i.e.iSCSIandtheNASprotocols.EMCVNXconfigurationsmaybefileonly,blockonly,orunified.CoreITapplicationswithtransactionalworkloads,suchasOracle,SQL,Exchange,orSharePointareagoodfit.AnothergoodfitforVNXistier1or2servervirtualization&endusercomputing/VDI.EMCIsilonfallsintolargescalefileonlyenvironments,startingatgreaterthan50terabytesorsupportinggreaterthanonehundredterabytehomedirectories.Wheneverafilesystemlargerthan16terabytesisneeded,EMCIsilonwouldbethecorrectoption.EMCIsilonisveryeffectiveasalargeNASarchiveorsupportingbigdataneeds.

    ISPT Isilon Fundamentals 10

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThismodulecoveredthebenefitsandusesofanEMCIsilonsolution.

    ISPT Isilon Fundamentals 11

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThismoduledescribesEMCIsilons networkarchitecture andprovidesanintroductionoftheOneFSoperating system.

    12ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Thislessoncovers anoverviewofeachlayeroftheEMCIsilonclusteringarchitecture,includingEMCIsilons networktopology.

    13ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    EMCIsilon's distributedscaleoutstoragesolutioncontainsclusterednodesencapsulatedinaprivatenetwork.Inatruescaleoutarchitecture,thetasksaredistributeduniformlyacrossallnodes enhancingscalability,accesstodata,performance,andavailability.TheEMCIsilonclusteringarchitectureconsistsoffourlayers:theclient/applicationlayer,theexternalnetworklayer,thestoragelayer,andtheinternalnetworklayer.Inthefollowingslideswewillrevieweachlayer.

    14ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    EMCIsilonsupportsseveralclientaccessprotocolsenablinguseraccesstothefilesstoredonacluster.Multipleaccessprotocolscanbeconfiguredifanetworksupportsmanytypesofclients.EMCIsilonprovidesoperationalflexibilitythat includesintegratedsupportforawiderangeofindustrystandardprotocolssuchasNFS,SMB,HTTP,FTP,andHDFS.Theoperationalflexibilityalsoallowsforflexibleclientconnectioncapabilitieswithoutclientsidedrivers.VMware integration,includingVASAandVAAIAPIstosimplifystoragemanagementinyourvirtualizedinfrastructureenvironmentisalsopartoftheflexibility.Asis,aPlatformRESTAPItoenableintegrationwithawiderangeofthirdpartyapplications.

    15ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TheExternalNetworklayer,alsoknownasthefrontendnetwork,providescommunicationbetweenclientsandclusternodes.EMCIsilon nodessupport1GigabitEthernetand10GigabitEthernetconnectionstothecluster.TheInternalNetworkLayer,alsoknownasthebackendnetwork,enablescommunicationbetweennodesinacluster.CommunicationovertheinternalnetworkoccursthroughInfiniBandconnections.InfiniBand isacopperbased,pointtopoint,interconnectavailablein10gigabitspersecond,20gigabitspersecond,and40gigabitspersecond.InfiniBand deliverstheextremelylowlatencythatenablesthenodestoseamlesslyfunctioninasinglechassis.Usingaswitchedstartopology,eachnodeintheclusterisonlyonehopawayfromanyothernode.WhiletheclustercanoperateononeInfiniBand switch,twoswitchesarerecommendedforhighavailability.

    16ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Theinternalnetworkactsasthebackplaneofthecluster,enablingeachnodetobepartofthecluster.Theexternalnetworkenablesclientstoaccessanode.OneFSsupportsnetworksubnets,IPaddresspools,andnetworkprovisioningrulestofacilitatetheexternalnetworkconfigurationprocess.OneFSsupportsbothIPv4andIPv6addressschemes.However,therearesomeexternalservicessuchasActiveDirectoryauthenticationandtheinternalInfiniBand networkthatstillsupportonlyIPv4.Redundantinternalandexternalnetworksshouldbeusedforhighavailability.TheprimaryinternalInfiniBand networkusesasecondInfiniBand switchasastandby.Failovertothestandbyinternalnetworktakesplaceintheeventofprimaryinternalnetworkfailureoranytimeapartona nodeisdisconnected.

    17ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    EMCIsilonStorageincludesallIsilonseriesnodesinacluster.Eachnodeinanclusterisapeertoeveryothernodeinthecluster.Aseachnodeisaddedtoacluster,itincreasestheaggregatedisk,RAM,CPU,andnetworkcapacityofthecluster.Thenodesaddressfilerequestsfromclients.ThekeytoEMCIsilon's storageclustersolutionisthearchitectureofOneFS,whichisadistributedclusteredfilesystem.Asinglefilesystemspansacrosseverynodeinastorageclusterand,asnoesareadded,thatfilesystemautomaticallyredistributescontentacrosstheentirecluster.Thereisnosinglemasterdevicethatcontrolsthecluster.Asthesystemwritesdata,italsoprotectsthedataatthespecifiedprotectionlevel.Thesystemcontinuouslyrebalancesdatabetweenthenodeswhichmakestoragespacemoreefficient.

    18ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThislessoncoversthebasicsofEMCIsilons OneFSdistributedfilesystem.

    19ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    InscaleupNASsystems,thefilesystem,volumemanager,andtheimplementationofRAIDareallseparateentities.Thefilesystemisresponsibleforthehigherlevelfunctionsofauthenticationandauthorization.ThevolumemanagercontrolsthelayoutofthedatawhileRAIDcontrolsprotectionofthedata.OneFScreatesasinglefilesystemfortheclusterthatalsoperformsthedutiesofthevolumemanagerandappliesprotectiontothedata.EMCIsilonusessoftwarebaseprotectionalgorithmsinsteadofhardwarebasedRAID.Thereisnopartitioning,andnoseparatevolumes.Theentirefilesystemisaccessiblebyclientsconnectingtoanynodeinthecluster.Bycombiningthefilesystem,volumemanagement,dataprotection,intooneunifiedsoftwarelayer,managementoftheNASenvironmentissimplified.Sincethesinglefilesystemspanstheentirecluster,managementofasinglenamespacealsosimplifiesadministrativetaskslikemanuallymigrating datatorebalancecontent.

    20ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Therearetwowaystoaccessthecluster.Thefirstisthewebadministrationinterface andthesecondistheCLI.Bothallowtheadministratortomonitorandmanagethecluster.Ifusingthewebadministrationinterface,allanadministratormustdoisentertheIPaddressofoneofthenodesintoawebbrowser.ThenameoftheclustercanalsobeusedinsteadoftheIPaddress.Onceinthewebadministrationinterface,theadministratorisablethemonitor,configure,andmanagetheentireclusterfromasingleinterface.Throughthecommandlineinterface,anadmininstrator hasaccesstothesuiteofisicommandsusedtomonitorandconfigurethecluster.TheOneFSsystemisafreeBSDbasedUnixoperatingsystem.

    21ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TraditionalRAIDsystemsareaggregatedforscaleup,theycompromiseondataprotectionbynotbeingabletoscaleavailabilityalongwithcapacitygrowth.EMCIsilonusesaproprietarysystemjobcalledFlexProtect,whichdetectsandrepairsfilesanddirectoriesthatareinadegradedstate.Protectionisappliedatthefilelevel,nottheblocklevel.FlexProtect distributesalldataandprotectioninformationacrosstheentireclusterandensuresthatalldataremainsintactandaccessibleevenintheeventofoneormoresimultaneousdrivefailures.Protectionsettingscanbechangedwithouttakingtheclusterorfilesystemoffline.OneFSallowsdifferentprotectionlevelsonfiles,directoriesandnodepools.Ifadrivefailuredoesoccur,FlexProtect willonlyreprotect theactualdataondiskandnotthediskitself.Thissignificantlyimprovesrecoverytime.OneFSoffersN+1throughN+4dataprotection.AnN+4schememeansthatupto4drivesornodesoracombinationofbothcanfailwithoutdataloss.

    22ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    DataandmetadatainOneFSarestripedormirroredacrossallnodesinaclusterornodepool,whichprovidesredundancy,availability,andinsomecasesperformancebenefits.TherearetwotypesofprotectionthatcomeswithFlexProtect.DatamaybeprotectedusingFEC(ForwardErrorCorrection)ormirroring.FECissimilartohowparityisusedintraditionalstorageenvironmentsbutisdifferent.FECinformationisdistributedacrossnodesandacrossdrives.Intheeventofadriveornodefailure,themissingdataisrebuiltfromthemirrororcalculatedusingtheFECandtheremainingdata.Mirroringcopiesdatato multiplelocationsthereforecreating redundancy. Withmirroring,youcanhaveupto8copiesofdatainasinglecluster,comparedtoonly1withthetraditionalRAID1.BothmirroringandFECprotectiongenerateadditionalstorageoverhead.ThepercentageofFECoverheadcandeclineastheclusterbecomeslarger,especiallyforlargerfiles.EMCIsilonallowsyoutodefineprotectiononanodepool(groupofsimilarnodes),adirectoryorevenanindividualfile,aswellashavemultipleprotectionlevelsconfiguredthroughoutthecluster.Thisfeaturemakesitpossibletomatchtheprotectionleveltothevalueofthedatathatisbeingprotected.

    23ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    OneFSusesthebackendInfiniBand networktoautomaticallyallocateandstripedataverticallyacrossallnodesinthecluster.Asthesystemwritesthedata,itisalsoprotectingthedataatthespecifiedlevel.Noseparateactionisnecessarytoprotectthedata.Thesystembreaksfilesintosmallerlogicalchunkscalledstripesunitsbeforewritingthemtodisk.EachOneFSblockis8KBandastripeunitconsistsof16blocksforatotalof128KBperstripeunit.Asthesystemwritesdataacrossthecluster,itfillsthestripeunitsuntilthemaximumwidthoftheclusterisreachedandaprotectionstripeunitiscreated.Thestripewidthisdeterminedbythenumberofnodesandtheprotectionsetting.Withsmallfiles,duetothewaythatOneFSappliesprotectioninaclusterwithN+1protection,filesthatare128KBorsmalleraremirrored;inaclusterwithN+2protection,filesaretriplemirrored;andsoon.

    24ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Theprocessofstripingspreadsallwritesfromaclientacrossthenodesofacluster.Eventhoughaclientisconnectedtoonlyonenode,whenthatclientwritesdatatothecluster,thewriteoperationtakes place onmultiplenodes.Thewriteprocessfollowsacertainflow: First,theClientsendsfiledataasawrite,whichisreceivedbythewritecoalescer ontheclient

    connectednode. Then,thenodebreaksthefileinupto128KBstripeunits anda writeplandetermineshowto

    aggregatethedatastripeunitsandcalculatesprotectionstripeunits. Finally,stripeunitsaresenttoparticipantnodesovertheInfiniBand networktodistributethe

    stripeandawriteoccur oneachnode.TheexampleonthisslidedemonstrateshowafileisbrokendownintostripeunitsafterwhichitisstripedacrossdisksintheclusteralongwithFECalsoknownasprotection.

    25ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Whenafilereadisinitiatedbyaclient,thepiecesofthefilesarefetchedfromthenodeswheretheyarestored.Aclientisconnectedtoonlyonenodeatatime;howeverthedataisdistributedacrossnodesonthecluster.Theclient'snoderetrievesandrebuildsthefileacrossthebackendInfiniBand network.Thereassembledfiledataisthensentfromtheclientsnodetotherequestingclientthroughtheexternalnetwork.

    26ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TheOneFSAutoBalance featureenablesadministratorstoaddcapacityorperformancenodestoanexistingclusterwhilethesystemisonlineandinproduction.IncreasingthecapacityorperformanceofaclusterisasimplethreestepprocessFirst,InstallthenewnodeintherackSecond,AttachtheInfiniBand networkcableconnectingthenodesLastly,EnteracommandforOneFStoaddthenewnodetotheclusterTheAutobalance featurethenautomaticallybalancesthenodecapacityacrosstheInfiniBand network.Nointerruptionofserviceorperfromance isexperiencedbytheuser.

    27ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    EMCIsilonsystemscanbeaccessedbyuserson differentplatforms,withWindowsandUNIX/Linuxbeingthemostcommon.EachOShasitsownmechanismforassigninguseridentities,andassigningrightsandpermissionstousers.Asystemcapableofmultiprotocolaccessmustbeabletoallowsimultaneousaccesstofilesfromdifferentplatforms,andcorrectlydeterminewhichactionsindividualusersarepermittedtoperform.OneFSisoptimizedforamixedenvironmentinwhichanyfileordirectorycanbegovernedbyeitheraWindowsaccesscontrollist(ACL)orUNIXpermissions.Regardlessofthesecuritymodel,accessrightsareenforcedconsistentlyacrossaccessprotocols;thatis,auserisgranted(ordenied)thesamerightstoafilewhenusingSMB(Windowsfilesharing)astheywouldwhenusingNFS(POSIXfilesharing).OneFScanconfigurebothUNIXandWindowspermissionsontheclusteratthesametimeforthesamedatabystoringWindowsACLsandPOSIXmodebitsnatively.

    28ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThismodulecoveredtheEMCIsilonclusteringarchitectureincludingthenetworktopologyandtheOneFSoperatingsystem.

    29ISPT Isilon Fundamentals

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    This moduledescribesEMCIsilons hardware,whichincludesstoragenodesandacceleratornodes.

    ISPT Isilon Fundamentals 30

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Thearethree differenttypesofstoragenodes:theSSeries,theXSeries,andtheNLSeries.SSeriesnodesareultraperformanceprimarystorageforhightransactionalandIOPsintensiveapplicationsthatarefortier0andtier1workflows.XSeriesnodesmakeabalancebetweenlargecapacityandhighperformancestorage.Thesenodesarebestforhighthroughputandhighconcurrencyapplicationsfortier1andtier2workflows.NLSeriesnodesaredesignedtoprovideacosteffectivehighdensitystoragesolutionfortier3workflowsthatareaccessedinfrequently,butstillmustbestoredandprotected.Inadditiontothestoragenodes,EMCIsilonofferstwoacceleratornodes:PerformanceandBackupAcceleratornodes.TheformeraddsCPU,memoryandnetworkresourcestothecluster,whilethelatteraddsCPU,memory,andFibreChannelconnectivityforconnectiontotapebackupdevices.

    ISPT Isilon Fundamentals 31

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Storagesolutionscanbeexpensive.Tiering classifiesdatasothatitcanbestoredintheappropriatecostefficientmanner. Inatieredsystem,timelydatathatneedshighertiersneedsfaster,andmoreexpensive,storage.Inasimple3tieredsystem,tier1dataisaccessedoftenandismissioncritical.Tier2datamaybeusedlessfrequentlyormayhavefewerusers,butitisstillimportantdatathatusersneedinatimelymanner.Tier3dataisdefinedasseldomaccesseddatathatisarchivedforhistoricalorregulationpurposes.Additionally,astheuseofsolidstatedrives,orSSDs,increasesthereisalsoatypeofdatathatissotimesensitiveandcriticaltothebusinessthatitneedsthemostefficientstoragetype.InanEMCIsilonstoragecluster,youcancombineSSDandSASorSSDandSATAdrivesinonechassistomeetspecificstoragerequirements.YoucanconfigureaclustertokeepmetadataordataonSSDs,andeventouseSSDsinonepartoftheclustertostoremetadatafornodesthathavenoSSDdrives.

    ISPT Isilon Fundamentals 32

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TheSSeriesispurposebuiltforIOPSintensiveapplications.Itprovidesfastprimarystorageformissioncritical,hightransactionalandrandomaccessfilebasedapplications.SSeriesnodescanuseSSDstostorefilesystemmetadata,whichimprovesperformanceformetadataintensiveoperations,andtostorelatencysensitivefiledata.YoucancombineSSDandSASdrivesinonechassistomeetspecificstoragerequirementsandcreateatier0fordatatiering.EMCIsilonSSeriesnodesaresuitablefordigitalmediacompaniesand financialinstitutionsthatneedhightransactionalIOPsforeditingandpostproduction,aswellascalculationsforbusinessanalysis.EnergyandsurveillanceorganizationswouldalsobenefitfromtheSseriesbyusingnodesforperformanceapplicationsthatneedtier0and1storage.

    ISPT Isilon Fundamentals 33

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TheEMCIsilonXSeriesisaflexibleandcomprehensiveseriesthatstrikestherightbalancebetweenlargecapacityandhighperformancestorage.TheEMCIsilonXSeriesaccelerateshighconcurrentandsequentialthroughputapplications,speedingaccesstomassiveamountsofcriticaldata,dramaticallyreducingthecostandcomplexityofmanagingandstoringdata.Therearetwotypesavailable; the4UX400andthe2UX200platforms.The X400 providesmorecapacityatagivenperformancelevel.Thisnodewouldbeidealforsomeonewhoneedsmorecapacitythenperformanceaccordingtotherequirementstheyhaveprovided. IntheX200space,thisnodeispurchasedbecausethere aremoreperformancerequirementsthancapacity.WiththeX200thereisalsoupgradability,SSDscanbeaddedafterthefact,andmemorycanbeupgradedaswell.TheX400cannotbeupgraded orusedwithSSDs.TheEMCIsilonXSeriessuitableforhomedirectoriesandhealthcareenvironmentsthathavelargefiles.XSeriesnodesarewellsuitedforcompaniesthatproducedigitalmediaordelivervideo,audio,andimageservices.XSeriesnodesarebestusedfororganizationsthatperformheavycomputationsuchaslifesciencecompaniesorenergyorganizations.

    ISPT Isilon Fundamentals 34

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TheNLSeriesispurposebuiltforlargecapacitystorage,enablingnearlinestorageperformanceatneartapestoragecosts.Highdensity,massivecapacityandmaximumcostperTBarethestrengthsoftheNLseries.NoSSDsaresupportedonthisplatform.TheEMCIsilonNLSeriesisidealforcomplementingandimprovingacompanysexistingtapebackup,archiving,dataprotectionstrategies,andprovideseconomicalstorage.ThisseriesuseslowcostSATAdrives.NLSeriesproductshavetheflexibilitytoconfiguredifferentdrivesizes,memory,andnetworkinterfacesgivingcustomerstheabilitytocustomizetheEMCIsilonproductbasedontheenvironment.

    ISPT Isilon Fundamentals 35

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    PerformanceAcceleratorsaredisklessnodeswhichincreaseoverallthroughput,CPUmemory,andnetworkingsupportthroughputworkflows.ByseamlesslyaddingaPerformanceAcceleratortoanexistingEMCIsilonSSeriesorXSeriescluster,youcanaddmorethan400MB/sofsinglestreamthroughoutandupto700MB/sofconcurrentthroughput.Typically,onePerformanceAcceleratorperstoragenodeisrecommendedforsupportingwriteintensiveapplications.Forreadintensiveapplications,uptothreeAcceleratorsperstoragenodeisrecommended.BackupAcceleratorsenablehighspeedbackupoffilesystemdatatolocallyattachedtapelibrariesormediachangerdevices.TheBackupAcceleratorcanbeseamlesslyaddedtoanyexistingEMCIsilonclustertodeliverupto480MB/sofperformanceacrossfourconcurrentstreams,speedingbackupoperationsandreducingtheriskofbusinesscriticaldataloss.ItisusedtoprefetchdatafromthefilesystemandacrosstheInfiniBand networkefficientlypushthedatatotape.EachBackupAcceleratorcansupportuptofourpathsviaFiberChannelports.WhileEMCIsilonsupportstheuseofNetworkDataManagementProtocol(NDMP)forbackups,theuseofaBackupAcceleratorenablessignificantlyfasterbackups.

    ISPT Isilon Fundamentals 36

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Withgreatercapacity,usuallycomesgreaterperformancerequirementsacrossallstorage.Forunstructuredanddynamicdata,EMCIsilons clusteredstorageprovidespredictablegrowthwithpredictableperformance.TheSseriesplatformistheanswerforultraperformanceprimarystorage,purposebuiltforhighIOPSintensiverandomaccessfilebasedapplications.TheEMCIsilonXSeries,isthemostflexibleandcomprehensivestorageproductline,strikingtherightbalancebetweenlargecapacityandhighperformancestorage.TheNLseriesfocusesoncostandcapacitywithmuchlessattentionpaidtoperformance.TheNLSeriescombineshighdensityandefficiency,withmassivecapacitycapabilities.

    ISPT Isilon Fundamentals 37

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThismodulecoveredEMCIsilonstorageandacceleratornodes.Nodetypesmaybemixedinacluster,andoftenwillbeinordertoachievethedesiredbalanceofperformanceandcapacity.PerformancemayalsobeimprovedthroughtheuseofSSDsinsomenodes.

    ISPT Isilon Fundamentals 38

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    This modulefocusesonEMCIsilons OneFSsoftwaremoduleswhichprovidearobustsuiteofmanagementapplications.

    ISPT Isilon Fundamentals 39

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SmartPoolsisasoftwaremodulethatenablesadministratorstodefinesubgroupsofnodeswithinaOneFScluster.UsingSmartPools,multipletiersofEMCIsilonstoragenodescanallcoexistwithinasinglefilesystem,withasinglepointofmanagement.ByusingSmartPools,administratorscanspecifyexactlywhichfilestheywanttoliveonwhichparticularnodesanddisks.SmartPools maincomponentsarenodepoolsandfilepools.Nodepoolsareasetofnodesthatyoucangroupintoasinglepoolofstorage.Filepoolsenableyoutofilterfilesanddirectoriesintospecificnodepools.Filepoolpoliciesalloweasyandpowerfulfiledistributionamongthetiers,costalignmentwithagingorinfrequentlyusedcontent,andeliminatetheneedfordatamigrations.

    ISPT Isilon Fundamentals 40

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SmartPoolsisrecommendedfororganizationswhohavemultiplestoragetierswhowishtoachievecostefficiencyintheirstoragesystem.Also,companieswithmultiplestorageperformancerequirementsandwhowanttheabilitytohaveindividualfilesorsetsofdataonaspecificstoragetier.Forexample,clientsthatwanttohaveolderfilesoncheaper,slower,storageandnewer,frequentlyaccessedfilesonfaststorage.

    ISPT Isilon Fundamentals 41

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SnapshotIQisalicenseddataprotectionsoftwaremoduleforEMCIsilon's OneFSoperatingsystem.Asnapshotrecordsapointintimesnapshotofthedata.Unlikearegularcopyofdatawhichtakessignificantspace,snapshotsonlykeeptrackofchangeddatablocks.Inaddition,SnapshotIQhasunlimitednumberofsnapshotsgivingadministratorsanotheroptiontomeettheirorganization'srecoverypointandrecoverytimeobjectives.SnapshotIQ allowsforthedeletionofoutofordersnapshotsandhasbeenintegratedwithSmartPoolsgivingtheadministratortheabilitytostoresnapdataonlowercosttiersofstorage.WindowsusersmayalsousetheShadowCopy servicetorecoverdeletedfilesordirectories.

    ISPT Isilon Fundamentals 42

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SnapshotIQallowsuserstoeasilyrecoverfilesthemselves. Wealsofindusecaseswherecustomershavestringentdatarecoveryrequirementsandwantlowimpactdataprotection.SnapshotIQisacomplementtoatapeorarchivesolution,butshouldnotbeconsideredasubstitute.

    ISPT Isilon Fundamentals 43

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SyncIQisasimpletomanagefileasynchronousreplicationtoolthatenablesadministratorstosynchronize missioncriticaldatathroughoutagloballydistributednetwork.SyncIQdeliversreplicationoffilesacrossmultipleEMCIsilonclustersovertheWANorLAN.SyncIQ istheindustry'sonlypolicybasedfilereplicationsystemdesignedexclusivelyforscaleoutstorage,combiningarichsetofpoliciesforcreatingandschedulingstoragereplicationjobswithbandwidththrottlingandclusterutilizationcapabilities.Replicationpoliciescanbesetatthecluster,directory,orfilelevels.

    ISPT Isilon Fundamentals 44

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SyncIQusecasesincludedisasterrecover,orDR,wherewehaveahighspeedbackupgoingacrossaWANlink,andavailabilitywheretwoormorecopiesofdataarerequiredacrosssites.Thisisoftenusedforarchivingwheretheproductiondataisreplicatedtoanoffsitelocation,andtieredtotapefromthere.Anotherusecaseiscontentdistributionwheredataissharedbetweensites.

    ISPT Isilon Fundamentals 45

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SmartConnectisaclientconnectionmanagementmodulethatenablesclientconnectionstobebalancedacrossallnodeswithinanEMCIsilonclusteroracrossselectednodesforsecurityorperformancereasons.Itprovidesasinglevirtualhostnameforclientstoconnect.SmartConnects roundrobinmethodworksonarotatingbasis.AsonenodeIPaddressishandedout,itmovestotheendofthelist;thenextnodeIPaddressistheused,andsoon.TheadvancedversionofSmartConnectallowsmultiplenetworkpoolswithinonesubnet.ItsupportsDynamicIPallocationandNFSfailover.ItallowsforpolicydrivenconnectionandfailoverbasedonmetricssuchasCPUutilization,throughput,andconnectioncount.

    ISPT Isilon Fundamentals 46

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Inthisexample,allnodesareofonetype.Wellconfiguredifferentaccesszones,andcreateaperformancezonesimplybycreatingapoolwiththeinterfacesfromthefirstsetofnodesandgivingitadifferentname.Thehighperformanceclientsthenconnecttoanameassociatedwiththatpool,sayperformance.isilon.com.Wethencreateanotherpoolassociatingtheinterfacesfromthenodesonthebottom,andcallthatdesktop.isilon.com,whichwillbeusedforgeneralclients.Wenowhavetheabilitytosegmenttheloadfromdifferenttypesofclients;theideabeingtonotallowdesktopusagetoimpedeanyperformancetothehighperformanceclients.

    ISPT Isilon Fundamentals 47

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SmartQuotas isafeaturethatcanprovision,monitor,andreportdiskstorageusageattheuser,group,anddirectorylevels.Administratorscommonlyusefilesystemquotasasamethodoftracking,andsometimeslimiting,theamountofstoragethatauser,group,oraprojectisallowedtoconsume.SmartQuotas cansendautomatednotificationswhenstoragelimitsareexceededorapproached.SmartQuotas allowsforthinprovisioning(alsoknownasoverprovisioning),enablingadministratorstoassignquotasabovetheactualclustersize.Withthinprovisioning,theclustercanbefullwhilesomeusersordirectoriesarewellundertheirquotalimit.

    ISPT Isilon Fundamentals 48

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    Quotasareausefulwaytoensurethatauserordepartmentdoesnotinfringeontheamountofstoragethatisallocatedtootherusersordepartments.Quotasareusefulinenforcinganinternalchargebacksystem,whichisoftenfoundinthegovernmentandeducationindustries.SmartQuotas containflexiblereportingoptionsthatcanhelpadministratorsanalyzedatausagestatisticsfortheircluster.Bothenforcementandaccountingquotasaresupported,andavarietyofnotificationmethodsareavailable.

    ISPT Isilon Fundamentals 49

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    SmartLockprovidespolicybasedretentionandprotectionagainstaccidentaldeletions.Manybanksandfinancialinstitutionsusethisfeature.BecauseSmartLockisasoftwarebasedapproachtoanenterprisefilelevelretentionsolution,youcanstoreSmartLockprotecteddataalongsideotherdatatypeswithnoeffectonperformanceoravailability,andwithouttheaddedcostofpurchasingandmaintainingspecialtyfilelevelretentioncapablehardware.SmartLockisstoredatthedirectorylevelandsetsdefaultretentiontimesonce.

    ISPT Isilon Fundamentals 50

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    TheusecasesforSmartLockarewhenorganizationsneeddatatoremainavailablebutunchangedoverextendedperiodsoftime.Examplesincludecorerevenueproducingworkflows,productdesigns,softwareschemas,andproductcomponentelementssuchasimagefiles,digitalmasters,legaldocuments,andcriticalcommunications.Legislationmayalsorequirethatdatabekeptunchangedforaspecifictimeperiod.

    ISPT Isilon Fundamentals 51

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    InsightIQprovidesperformanceandfilesystemanalyticstooptimizeapplications,correlateworkflowandnetworkevents,andaccuratelyforecastfuturestorageneeds.Itelaboratesondrilldownsandbreakoutsandprovidesbothhistoricalandneartimedata.ItisastandalonevirtualapplicationthatisnotpartofOneFSbutsellsasaseparateproduct.

    ISPT Isilon Fundamentals 52

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    InsightIQisusefulfororganizationswhowantaneasytouse,yetpowerfulanalyticstool.CompanieswhowanttooptimizetheirEMCIsilonstorageclustersandtheapplicationsthatusethemwithoutrequiringprofessionalservices,andwhowanttooffloadprocessingofanalyticsfromthestoragesystemtoavirtualappliance.

    ISPT Isilon Fundamentals 53

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThismodulecoveredtheadditionalsoftwaremodulessupportedbyOneFSandtheirvarioususes.

    ISPT Isilon Fundamentals 54

  • Copyright 2013 EMC Corporation. Do not copy - All Rights Reserved.

    ThiscoursecoveredtheEMCIsilonscaleoutStoragePlatformpoweredbytheOneFSoperatingsystem.ItintroducedtheEMCIsilonproductlinesanddescribedthebroadrangeofEMCIsilonoptionsandsoftwareapplications.Thisconcludesthetraining.

    ISPT Isilon Fundamentals 55

Recommended