NFSv4.1 — Using pNFS - SNIA · 2019-12-21 · – Part3 – Planning for a Smooth Migraon § The key issues to consider when migrang from NFSv3 or implemen&ng new applicaons with

PRESENTATION TITLE GOES HERE

NFSv4.1—UsingpNFS

Presentedby:AlexMcDonaldCTOOffice,NetApp

© 2013 Storage Networking Industry Association. All Rights Reserved.

Educa&on

WebcastPresenter

AlexMcDonaldjoinedNetAppin2005,a>ermorethan30yearsinavarietyofroleswithsomeofthebestknownnamesintheso>wareindustry.Withabackgroundinso>waredevelopment,support,salesandaperiodasanindependentconsultant,AlexisnowpartofNetApp’sOfficeoftheCTOthatsupportsindustryac&vi&esandpromotestechnology&standardsbasedsolu&ons,andisco-chairoftheSNIACloudStorageIni&a&ve,andco-chairoftheSNIAFileProtocolsSpecialInterestGroup.

AlexMcDonaldOfficeoftheCTO

NetApp


Educa&on

EthernetStorageForumMembers

TheSNIAEthernetStorageForum(ESF)focusesoneduca&ngend-usersaboutEthernet-

connectedstoragenetworkingtechnologies.


Educa&on

 FileProtocolSIGdrivesadop&onandunderstandingofSMBandNFSacrossvendorstocons&tuents– Marke&ng,industryadop&on,OpenSourceupdates

 NetApp,EMC,PanasasandSunfounders Whitepapersonmigra&onfromNFSv3toNFSv4– AnOverviewofNFSv4;NFSv4,NFSv4.1,pNFS,andproposedNFSv4.2features

– Migra&ngfromNFSv3toNFSv4

SNIA’sNFSSpecialInterestGroup

4

Learnmoreaboutusat:www.snia.org/forums/esf


Educa&on

BrightTalkSNIAChannelNFSMiniSeries NFSv4.1,pNFS&FedFSProtocolDevelopment

–  Part1–FourReasonsforNFSv4§  DiscussesthereasonsbehindthedevelopmentofNFSv4andbeyond,andtheneedforabe\er-than-NFSv3protocol

–  Part2–AdvancesinNFS–NFSv4.1andpNFS§  AnoverviewandsomedetailsonNFSv4.1,pNFS(parallelNFS),andFedFS(theFederatedfilesystem);andahighleveloverviewofproposedNFSv4.2features

–  Part3–PlanningforaSmoothMigra&on§  Thekeyissuestoconsiderwhenmigra&ngfromNFSv3orimplemen&ngnewapplica&onswithNFSv4.1;Unicode,securitywithKerberos,statefulness,selec&ngtheapplica&onandotheraspects.

  Slidesavailablefrom–  h\p://snia.org/forums/esf/knowledge/webcasts

PreviousSNIANFSPresenta&ons


Educa&on

TheFourReasonsforNFSv4.1

6

Func&onal BusinessBenefitACLsforauthoriza&onKerberosforauthen&ca&on

Compliance,improvedaccess,storageefficiency,WANuse

Clientandserverleasemanagementwithfailover

HighAvailability,Opera&onssimplicity,costcontainment

Pseudodirectorysystem,FedFS

Reduc&oninadministra&on&management

Mul&pleread,write,deleteopera&onsperRPCcallDelegatelocks,readandwriteprocedurestoclientsParallelisedI/O

Be\ernetworku&liza&onforallNFSclientsLeverageNFSclienthardwareforbe\erI/O

Security

Highavailability

Singlenamespace

Performance


Educa&on

 We’llcover– OverviewofpNFSterminologyandopera&on– Howclients&serversco-operatetoprovideparallelismwhilesuppor&ngdataconsistency

– Someimplementa&onconsidera&ons Thisisahighleveloverview– Butmoretechnicalcontentforbackground– UseSNIAwhitepapersandvendors(bothclient&server)tohelpyouimplement

Agenda

7


Educa&on

You’veDoneNFSv4.1;nowforpNFS

 NFSv4.1(pNFS)canaggregatebandwidth– Modernapproach;relievesissuesassociatedwithpoint-to-pointconnec&ons

8

r  pNFSClientr  Clientread/writea

filer  Servergrants

permissionr  Filelayout(stripe

map)isgiventotheclient

r  ClientparallelR/Wdirectlytodataservers

r  RemovesIOBo\lenecksr  Nosinglestorage

nodeisabo\leneckr  Improveslargefile

performance

r  ImprovesManagementr  Dataandclientsare

loadbalancedr  SingleNamespace Data Servers

pNFS protocol

Control protocol

Storage-access protocol

Metadata Server

NFSv4.1 Client (s)


Educa&on

  RFC3530bis–NetworkFileSystem(NFS)Version4Protocol–  NFSv4(updatedfromRFC3530basedonexperience)

  RFC5661–NetworkFileSystem(NFS)Version4MinorVersion1Protocol–  SpecifiesSessions,DirectoryDelega&ons,andparallelNFS(pNFS)forfiles

  RFC5663-ParallelNFS(pNFS)Block/VolumeLayout  RFC5664-Object-BasedParallelNFS(pNFS)Opera&onspNFSisdependantonsessionsupport,whichisonlyavailableinNFSv4.1

Rela&onshipofpNFStoNFSv4.1

UserApplica&ons

NFSv4.1

GenericpNFSlayout

Filelayout

OSDlayout

Blocklayout

SUNRPC SCSI

TCP FCP


Educa&on

  MetadataServer;theMDS–  Maintainsinforma&onaboutloca&onandlayoutoffiles,

objectsorblockdataondataservers–  Shownasaseparateen&ty,butcommonlyimplementedon

oneoracrossmorethanonedataserveraspartofanarraypNFSprotocol

–  ExtendedprotocoloverNFSv4.1–  ClienttoMDScommunica&on

  Storageaccessprotocol–  Files;NFSopera&ons–  Objects:OSDSCSIobjectsprotocol(OSD2)–  Blocks;SCSIblocks(iSCSI,FCP)

  Controlprotocol–  Notstandardised;eachvendorusestheirowntechnology

todothis  Layout

–  Descrip&onofdevicesandsectormapsforthedatastoredonthedataservers

–  3types;files,blockandobject  Callback

–  AsynchronousRPCcallsusedtocontrolthebehavioroftheclientduringpNFSopera&ons

pNFSTerminology

Data Servers

pNFS protocol

Control protocol


Metadata Server

NFSv4.1 Client (s)


Educa&on

  ClientrequestslayoutfromMDS  Layoutmapsthefile/object/blocktodataserveraddressesandloca&ons  ClientuseslayouttoperformdirectI/Otothestoragelayer  MDSordataservercanrecallthelayoutatany&meusingcallbacks  ClientcommitschangesandreleasesthelayoutwhencompletepNFSisop&onal–  ClientcanfallbacktoNFSv4

pNFSopera&ons–  LAYOUTCOMMITServers

committhelayoutandupdatethemeta-datamaps

–  LAYOUTRETURNReturnsthelayoutorthenewlayout,ifthedataismodified

–  GETDEVICEINFOClientgetsupdatedinforma&ononadataserverinthestoragecluster

–  GETDEVICELISTClientsrequeststhelistofalldataserverspar&cipa&nginthestoragecluster

–  CB_LAYOUTServerrecallsthedatalayoutfromaclientifconflictsaredetected

pNFSOpera&ons


Educa&on

 NFSv4.1andpNFScapableserver– ContactyourNASvendorforavailability– Commercialproductsavailableforalloffiles,blocksandobjecttypes

– OpensourceLinuxpNFSserverindevelopment§ h\p://wiki.linux-nfs.org/wiki/index.php/PNFS_Development

pNFScapableclient– Linuxtodate– SeepreviousBrightTalks

§ Part3–PlanningforaSmoothMigra&on

pNFSPre-requisites


Educa&on

LinuxClientandNFSv4.1

 Upstream(Linus)LinuxNFSv4.1clientsupport– BasicclientinKernel2.6.32– pNFSsupport(fileslayouttype)inKernel2.6.39– Supportforthe'objects'and'blocks'layoutswasmergedinKernel3.0and3.1respec&vely

 Fullreadandwritesupportforallthreelayouttypesintheupstreamkernel– Blocks,filesandobjects– O_DIRECTreadsandwritessupported

13


Educa&on

LinuxClientandNFSv4.1

pNFSclientsupportindistribu&ons–  Fedora15wasfirstforpNFSfiles–  Kernel2.6.40(releasedAugust2011) RedHatEnterpriseLinux(RHEL)

–  “Technicalpreview"supportforNFSv4.1andforthepNFSfileslayouttypeinversion6.2,6.3

–  FullsupportinRHEL6.4,announcedFeb2013 Ubuntu,SUSE&otherdistribu&ons

–  PossibletoupgradetoNFSv4.1 NosupportinSolaris

–  BothserverandclientareNFSv4only14


Educa&on

 RHEL6.4pNFSmount– mount-ominorversion=1server:/filesystem/mnt

 Check–  (outputedited)

pNFSFilesMount

/proc/self/mountstats device 172.16.92.172:/filesystem mounted on /mnt with fstype nfs4 statvers=1.1 opts: …,vers=4.1, … nfsv4: …,sessions,pnfs=nfs_layout_nfsv41_files …


Educa&on

pNFSClientMount

16

ClientandServerhandshaketodeterminerespec&veCapabili&es.TheClusterreplieswithMDSandDSflagsset,indica&ngcapabilityforboth

172.17.40.185–IPaddressofthepNFSclient172.17.40.171–IPaddressoftheserver


Educa&on

pNFSClienttoMDS

17

TheOPENandSETATTRaresenttotheMDS


Educa&on

MDSLAYOUTtopNFSClient

18

Beforereadingorwri&ngdata,thepNFSclientrequeststhelayout

Themapofdataserversandfilehandlesisreturned


Educa&on

pNFSClientDEVICEINFOfromMDS

19

Meta-data node provides the pNFS client with the IP information for the DS. In this example – 172.17.40.173

Information is cached for life of the layout or until recalled (for example, when the data is moved)


Educa&on

pNFSClientUsesDirectDataPath

20

NowthepNFSclientisreachingouttotheremotevolumeonadirectpathusingIPaddress172.17.40.173.


Educa&on

InSummary:TheBenefitsofpNFS

 NFSv4.1(pNFS)canaggregatebandwidth– Modernapproach;relievesissuesassociatedwithpoint-to-pointconnec&ons

21

r  pNFSClientr  Clientread/writea

filer  Servergrants

permissionr  Filelayout(stripe

map)isgiventotheclient

r  ClientparallelR/Wdirectlytodataservers

r  RemovesIOBo\lenecksr  Nosinglestorage

nodeisabo\leneckr  Improveslargefile

performance

r  ImprovesManagementr  Dataandclientsare

loadbalancedr  SingleNamespace Data Servers

pNFS protocol

Control protocol


Metadata Server

NFSv4.1 Client (s)


Educa&on

Trunking(NFSv4.1&pNFS)–  Asingledataserverconnec&onlimitsdatathroughputbasedonprotocol

–  Trunking“bundles”connec&onsintoasinglepipe§  Openmul&plesessionsviadifferentphysicalEthernetconnec&onstothesamefilehandle/dataserverresource

–  Expandsthroughputandcanreducelatency–  Noimplementa&onsasyet  Compoundopera&ons(NFSv4andabove)

–  Example:LOOKUP,OPEN,READ,CLOSEasasingleRPCcall–  BenefitsWANopera&ons  Caching&delega&on(NFSv4andNFSv4.1)

–  Allowsclientandservertoagreeondatathatwillbeprocessedbytheclient

–  ReducesIOandprovidesdatalocality

OtherNFSPerformanceCapabili&es


Educa&on

Summary/CalltoAc&on

 StartusingNFSv4.1today–  NFSv4.2nearingapproval–  pNFSoffersperformancesupportformodernNASdevices Planningiskey

–  Applica&on,issues&ac&onstoensuresmoothimplementa&ons

pNFS–  FirstopenstandardforparallelI/Oacrossthenetwork–  AskvendorstoincludeNFSv4.1andpNFSsupportforclient/servers

–  pNFShaswideindustrysupport–  Commercialimplementa&onsandopensource

23


Educa&on

24

Ques&on&Answer


Educa&on

25

TodownloadthisWebcast

a>erthepresenta&on,goto

h\p://www.snia.org/about/socialmedia/

Documents

NFSv4.1 — Using pNFS - SNIA · 2019-12-21 · – Part3 – Planning for a Smooth Migraon § The key issues to consider when migrang from NFSv3 or implemen&ng new applicaons with