24
Red Hat Enterprise Linux and NFS | Syed M Shaaf 1 Red Hat Enterprise Linux / NFS Syed M Shaaf Solution Architect Red Hat Klaus Oxdal Partner and Alliances, Nordics Red Hat

Red Hat Enterprise Linux and NFS by syedmshaaf

Embed Size (px)

DESCRIPTION

A presentation on NFS and some of the important patches for PNFS

Citation preview

Page 1: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf1

Red Hat Enterprise Linux / NFS

Syed M ShaafSolution ArchitectRed Hat

Klaus OxdalPartner and Alliances, NordicsRed Hat

Page 2: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf2

WHAT WE DO

We offer a range of mission-critical software and services covering:

HOW WE DO IT. THE BENEFITS.We develop everything usingan OPEN SOURCE model.

Shared development reducescosts & accelerates innovation.

Open collaboration offers products that genuinely meet customers' requirements.

Better price & performance

Better quality

Faster technology innovation

Alignment to your needs

Flexibility

IaaS/PaaS OPERATING SYSTEM

VIRTUALIZATION STORAGE

MIDDLEWARE

Page 3: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf3

PRODUCT PROCESS

We participate in & create upstreamprojects.

We build & support open communitiesaround integrated projects.

We enable software & hardware partners to participate at every stage of development.

We commercialize theseinnovations together with a richecosystem of services & certifications.

PARTICIPATE

INTEGRATE

STABILIZE

100,000+PROJECTS

Page 4: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf4

OUR CUSTOMERS

The largest global exchangeon the planet. The largest global distribution

system in the world.

A leading enterprise cloudcomputing vendor.

We are pleased to offer supported enterprise-class Red Hat Enterprise Linux on demand for our customers.

Wherever you live, it is likely that several letters that youhave received have been read, coded, and processed for delivery by one of our systems using JBoss EnterpriseApplication Platform as the middleware foundation.

Red Hat has impressed us with itsoutstanding engineering capabilitiesand commitment to our strategicalliance.

Page 5: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf5

Red Hat Enterprise Linux

Page 6: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf6

RED HAT ENTERPRISE LINUX 6SCALABILITY

Page 7: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf7

RED HAT ENTERPRISE LINUX 6SCALABILITY

Page 8: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf8

RED HAT ENTERPRISE LINUX 6SCALABILITY

Page 9: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf9

RED HAT ENTERPRISE LINUX 6COMMUNITY LEADERSHIP

Page 10: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf10

NFS

Page 11: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf11

NFS V4

● NFS version 3 most used! Why Change it??Performance!

● Version 4 is now the default protocol version for RHEL6

● IETF: RFC3530: http://tools.ietf.org/html/rfc3530

Page 12: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf12

NFS Version 4.0 – Noteworthy features

● Version 4 is a Stateful Protocol.● Delegations

● Mandated Security

● Referrals

● Firewall Friendly (kinda!)

Page 13: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf13

NFS version 4 – Gotchas!

● “All My files are owned by NOBODY!!!”● Idmapping: [email protected] ==> 3606● DNS problem 90% of the time● 'Domain=' in /etc/idmapd.conf

● Mounting Legacy servers.● Mount negotiation start at v4● For Legacy server use /etc/nfsmount.conf mount

negotiation

Page 14: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf14

NFS version 4.1

● Sessions● Session IDs

● Parallel NFS (pNFS)● File Layout (NAS environment) - Netapp● Block Layout● Object Layout

● IETF: RFC5661● http://tools.ietf.org/html/rfc5661

Page 15: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf15

NFS version 4.1 in RHEL

● RHEL6 Client● Tech Preview in 6.2● pNFS: File layouts only

● RHEL7 Client● All layouts supported.

Page 16: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf16

NFS version 4.1 – Make it work!

● Enabling 4.1/pNFS on the client● mount -o minorversion=1

● Does the server support pNFS● nfs4filelayout_init: NFSv4 File Layout Driver

Registering..● “pnfs=<layout>” in /proc/self/mountstats

Page 17: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf17

NFS version 4.2

● Labeled NFS● Security contexts

● Server to Server Copy● offload to server copy operation

● Sparse Files

● IETF: Internet-Draft● http://tools.ietf.org/html/draft-ietf-nfsv4-minorversion2-11

Page 18: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf18

6.4 and some important changes

Page 19: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf19

Operating system - IO

Data

Data

Data

StorageBuffers and Cache

Application Cache/Buffer Pool

Application

Operating System ( Kernel )

1: 2:

3:

Page 20: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf20

Operating system – Direct IO

Data

Data

Data

StorageBuffers and Cache

Application Cache/Buffer Pool

Application

Operating System ( Kernel )

1:

2:

Page 21: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf21

Direct IO with PNFS, is it useful?

● O_DIRECT patches into pnfs

● Access the storage directly. Why?

● Databases are a good candidate, when?

● All operations are done in block size multiples

Page 22: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf22

● Allow the number of available slots to grow with the TCP window size.

● RHEL 6.3 dynamically allocates RPC slots up to the sunrpc.tcp_max_slot_table_entries ( 65536)

● Previously the number of in-flight RPC requests was limited to 128 (default 16). This affected the performance of OLTP workloads when using the kernel based NFS client.

● NFS 4.1 max session slots is set with the boot parameter:

nfs.max_session_slots (do not set higher than above)

RED HAT ENTERPRISE LINUX 6Slots and TCP window size

Page 23: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf23

References

● Steve Dickson● http://people.redhat.com/steved/Summits/

● NFSv4.1 new features: Sessions, Parallel NFS (pNFS)● http://www.iaps.com/nfsv4.1-new-features.html

● Parallel NFS (pNFS)● http://www.pnfs.com/

Page 24: Red Hat Enterprise Linux and NFS by syedmshaaf

Red Hat Enterprise Linux and NFS | Syed M Shaaf24

Thank you!

Syed M ShaafSolution ArchitectRed Hat

Klaus OxdalPartner and Alliances, NordicsRed Hat