Windows Server 2008 File and Storage Solutions

1

Windows Server 2008 - File and Storage Solutions

2

Agenda

Remote File ServicesServer Message Block version 2 (SMB2)Distributed File System Namespace (DFS-N)Distributed File System Replication (DFS-R)Microsoft Services for Network File System (MSNFS)Folder Redirection and Offline Files (CSC)

Storage ManagementStorage ExplorerShare and Storage ManagementVirtual Disk Services (VDS)Volume ShadowCopy Services (VSS)File Server Resource Manager (FSRM)

Not covered here:NTFS, TxFCHKDSK, DefragMPIOiSCSI InitiatoriSCSI Target

3

Roles, Role Services and Features

Before we begin, I wanted to quickly review these new Windows Server 2008 tools…Server Manager

RolesRole ServicesFeatures

ServerManagerCmd.exe

4

Server Manager - Roles

5

Server Manager - Role Services

6

Server Manager - Features

7

ServerManagerCmd.exe

8

Server Message Block version 2 (SMB2)

9

The Need For SMB2

SMB1 LimitationsConsidered “chatty”Poor WAN performance due to limited request pipelining / compoundingArbitrary limits on number of users, open files, sharesProtocol evolved through many releases over many years

Difficult to extend, maintain and secure due to large number /variety of commands

Motivations for SMB2Data access over WAN has become much more commonLAN performance also much increased (1Gb is here, 10Gb coming)Build a solid foundation for continued innovation

10

SMB2 BenefitsScalability for file sharing greatly increasedPerformance massively improved

Request compounding reduces “chattiness”Larger reads/writes can fill the pipe even with significant link latency

Secure and robustDurable handlesMessage signing settings improved (HMAC SHA-256 replaces MD5)Small command set reduces attack surface and complexity

Symbolic link supportEvaluation of symlinks involving remote paths is limited by defaultCan only be created by administrators (via Group Policy)

Limits SMB1 SMB2Number of users Max 2^16 Max 2^64

Number of open files Max 2^16 Max 2^64

Number of shares Max 2^16 Max 2^32

Total SMB1 SMB2Opcodes >100 19

11

SMB2 CopyFile Performance

Improved WAN utilizationBenefits due to combination of:

TCP stack improvementsSMB2 request pipeliningSMB2 large request supportCopyFileEx() improvements

Large buffersAsync, non-cached, IO

Write Request

Write Response

Pre-Vista Vista

12

SMB2 CopyFile Performance

XCOPY, remote->Local, 1Gb / 100ms RTT

8 Mb file 700 Mb file38

483249

4991

814

10490

XP-SMB1 Vista-SMB1 Vista-SMB2

Thro

ughp

ut in

kb/

s

13

SMB2 Compounding SampleA common application generated request sequence is shown belowLeft side shows resulting client-server requests without compoundingRight side shows resulting client-server requests with compoundingBenefit of round trip savings is greater the higher the link latency

Open Dir

Query Dir

Query Volume

Response

Response

Response

Open Dir

Query Dir

Query VolumeResponse

Close Dir

Close Dir

ResponseQuery Dir

Query Volume

Satisfied from SMB2 client cache

14

SMB2 Explorer PerformanceDramatic benefits in explorer directory enumeration, due to a combination of:

compounding/speculative requestsdirectory and attribute caching

For this scenario, a directory containing about 50 Excel 2007 files was opened using Windows ExplorerNetwork – 1Gb/s, 100ms RTT

Se-ries

1

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5

Vista SP1 SMB2 Vista SMB1

Response Time in Seconds

15

SMB2 VersionsFirst shipped in Windows Vista RTM

Not all protocol features utilized by Windows Vista RTM implementationDialect revved for Windows Server 2008 / Windows Vista SP1

Windows Server 2008 / Windows Vista SP1 enhancementsUses request compoundingCached: directory enumerations and file attributesCached: common share and file system property queries

Client/ Server OS Older Windows Windows Vista RTM Windows Vista SP1 Windows Server 2008

Older Windows SMB 1 SMB 1 SMB 1

Windows Vista RTM SMB1 SMB2 (v2.001) SMB 1

Windows Vista SP1Windows Server 2008 SMB1 SMB 1 SMB2 (v2.002)

16

Server Message Block Version 2 (SMB2)

Compound Packets

Durable File Handles

Increased Buffer Sizes

Symbolic Links

Greater Scalability

More Secure

17

Distributed File SystemNamespace (DFS-N)

18

DFS Overview

\\Contoso\Public

DFS Namespace (DFS-N)

Namespace Server

Namespace Root

Software

Tools

Training Guides

Folder

Folders with Targets

DFS Folder Targets

\\NYC-SVR-01\Tools

Tools

\\SEA-SVR-01\Tools

Tools

\\SEA-SVR-02\Training

Training Guides

DFS Replication(DFS-R)

19

DFS Namespace

Windows 2008 Mode Domain Namespaces:

Eliminates 5000 link limit for domain namespaces

Our Vista/WS2008 build release namespace comprised

60,000 links, with ~1000 added and removed every day

Requires: Windows 2008 Namespace ServersWindows 2008 Domain Functional Level

Access Based Enumeration (ABE) support

For both standalone and 2008 mode domain namespaces

Improved diagnosticsIn-box – DFSUTIL.EXE, DFSDIAG.EXESystem Center Operations Manager (SCOM) 2007 pack coming soon

20

Distributed File SystemReplication (DFS-R)

21

DFS ReplicationPerformance

Un-buffered disk I/O Asynchronous – performance Low priority – reduced system impact

RPC asynchronous pipesUp to 16 concurrent file downloads (up from 4)Better hub server scale-out over slow links

22

Windows Server 2003 R2

DFS-R Performance

Initialize Data Transfer

Retrieve Data

Retrieve Data

Initialize Data Transfer

READ WRITE

Retrieve Data

Windows Server 2008

23




ReliabilityDirty Shutdown Recovery improvedStaging area moved out of replicated file tree

24

Improved Dirty Shutdown Recovery

DFSR USN Consumer updates Checkpoint USNUpdates every three seconds and on DB changes

Improper shutdown of DFSR serviceSystem reboot/crashPower failure

File system

Database

Hub Server

Branch Office USN Journal

Last USN created by NTFS

Checkpoint USNLast USN consumed

by DFSR

25




ReliabilityDirty Shutdown Recovery improvedStaging area moved out of replicated file tree

SYSVOL replication now supported using DFS-RTools for migration of SYSVOL from FRS to DFS-RSafe, multi step process with rollback from all pointsRead Only Domain Controller (RODC) SupportNTFRS will be deprecated in a future release

26

SYSVOL Migration to DFSR

REDIRECTEDSTART PREPARED ELIMINATED

FRS FRS DFSR DFSR

PREPARINGINITIAL SYNC

REDIRECTING

ELIMINATING

DFSR FRS

27

End-To-End Administrator Experience

Raise domain functional level to Windows Server 2008

Check health of AD replication – RepAdmin /ReplSum

Migrate to ‘PREPARED’ state – dfsrmig /setGlobalState 1

Ensure all DCs are ‘PREPARED’ – dfsrmig /getMigrationState

Migrate to ‘REDIRECTED’ state – dfsrmig /setGlobalState 2

Ensure all DCs are ‘REDIRECTED’– dfsrmig /getMigrationState

Migrate to ‘ELIMINATED’ state - dfsrmig /setGlobalState 3

28

DFS-R in R2DFS-R Read only replication

Publication data that should never be changed at branch locationsOpen or create requesting WRITE access will be failed by a new filter driverEven if the filter is not running, other Win7 Replication Group members will refuse updates from a read-only replication partnerRead-only member: Windows Server 2008 R2Other members: Windows Server 2003 R2 or later

DFS-R cluster support (high-availability) Replicated file folders on a clustered file serverAny Highly Available File Server can become a DFSR member server, and the DFS-R service will fail over transparently between nodesAll cluster nodes: Windows Server 2008 R2Other members: Windows Server 2003 R2 or later


29

Services for NFS (MSNFS)

30

MSNFS In Windows Vista/WS2008Support for NFS v2/3 now included in Windows

NFS Client “in-box” for the first time in the Windows Vista releaseNFS Server “in-box” for the first time in Windows Server 2008 release

Enhancements in Windows Server 2008IPv6 supportEnhanced RFC2307: Leverage AD for Windows and Unix user mappingImproved audit loggingFine grained component installation: Greater control and scriptable MSNFS deploymentsFile Share management UI provides consistent experience: Share a folder via SMB and NFS from one locationAutomated firewall configuration simplifies deployment

Username mapping server deprecated, can still use it running on a down-level box

31

MSNFS in R2Unmapped Unix User Access

Enables zero configuration NFS deploymentsNo up-front mapping required between Unix and Windows usersAssociates a Unix UID/GID directly to a Windows SID

WMI provider for NFSConsistent remote management of NFS servicesSimplification from Windows Server 2008 Required multiple tools for remote management

Support for NetgroupsRFC 2307 and NIS based NetgroupsNFS file share access control via Netgroup mappings

Enhanced Security with RPCSEC_GSS supportAuthentication and integrity support Kerb5 used for authentication supportKerb5i used for integrity checkingExtensible framework to allow for future security algorithms


32

NFS Deployment Requirements


Feature Server Client

Unmapped Unix User Access Windows Server 2008 R2 NFS v2 or NFS v3 Clients

on any OS

WMI Remote Manageability Windows Server 2008 R2 NFS v2 or NFS v3 Clients on any OS

Netgroups Windows Server 2008 R2 NFS v2 or NFS v3 Clients on any OS

Enhanced Security for NFS Windows Server 2008 R2 in AD deployment

NFS v2 or NFS v3 Clients on any OS

33

Folder Redirection and Offline Files

34

Offline Files

Folder Redirection And Offline Files

File Server

Folder Redirection

35

Offline Files In Windows Vista

Seamless transitionsFaster synchronizationSupport for large files like Outlook PST’sPer-user encryptionImproved “Slow-link Mode”Ghosting – consistent client/server namespace Better interoperability with DFSScriptable API support

36

R2 ImprovementsBackground Synchronization

Offline files are automatically synchronized in the backgroundSlow-link mode is ON by default (when round-trip latency ≥ 80ms)Fully integrated with Sync Center, showing last update timeConfigurable settings for IT administrators

Improved App File Open & CloseSMB optimizations reduce the exchanges required to open and save application files

Transparent CachingAutomatically cache the network file to the local client diskThe cached copy is only used if the local/server versions are the sameAll files modifications are made on the server Administrators can control by Group Policy (not enabled by default on fast networks)

BranchCache™Remote files accessed from a branch office are stored in the client machine disk cacheClients can retrieve files from other clients in the same branchThe file version and user access rights are always validated with the serverExisting Windows security access controls are enforced


37

BranchCache™


Slow WAN Link

Client 1 Client 2

Windows 7 Clients

Windows Server2008

Slow WAN Link

Client 1 Client 2

Windows Vista SP1 Clients


38

Deployment Requirements


Feature Client Server Configuration

Background sync Windows 7Windows Server 2008 or

Windows Server 2008 R2CSC deployment

Improved file open & close Windows 7 Windows Server 2008 R2 File Server role

Transparent caching Windows 7Windows Server 2008 or

Windows Server 2008 R2Group policy

Offline Files exclusion list Windows 7Windows Server 2008 or

Windows Server 2008 R2Group policy

BranchCache™ Windows 7 Windows Server 2008 R2 Group policy

39

Storage Explorer

40

Storage Explorer

Design:uses industry standard APIs to gather information about storage devices in FC and iSCSI SANslooks and behaves like applications that Windows administrators are familiar withimplemented as an MMC snap-in

Storage Explorer GUI:provides a tree-structured view of all the components within the SAN (Fabrics, Platforms, Storage Devices, LUNs)

Storage Explorer and SMfS (Storage Manager for SANs)Combined, these two applications provide full-featured SAN configuration management functionality that is built into the Windows OS

41

Storage Explorer

Scalable, standards-based platform for storage fabric device discoveryHierarchical view of FC and iSCSI SAN topologyNo agents or hardware providers required

42

Share and Storage Management

43


New MMC snap-inUnified overview of storage and sharesUnified share provisioning (SMB and NFS)Unifying share and storage provisioning

Tabbed overview of shares and volumes with key propertiesVolume actions

Extend, format, delete and propertiesShare actions

Stop sharing and properties

44


Manage shares & volumes in the same snap-inView shares on the ‘Shares’ tab

45


Manage shares & volumes in the same snap-inView volumes on the ‘Volumes’ tab

46

Provision a File Share

47

Provision a Volume

48

Volume ShadowcopyServices (VSS)

49

VSS in Windows Server 2008Diskshadow – inbox VSS requester

Enables creation and management of hardware and software snapshotsSupports a script mode and an interactive shellReference requester for developing writers and hardware providersHandy tool for IT administrators

Hardware snapshot reliability enhancementsResilient to timing issues during snapshot importSupport fast recovery of GPT disksMultiple imports of shadow copy LUNsAuto recovery of transportable snapshots

Snapshot protection modeConcurrent backups with single restore

50

VSS in R2

LUN re-syncFast recovery of production LUNDuplication of production LUN

Express writerDevelop a VSS backup extension in two weeks

Concurrent restoresWriter error tunneling

Requesters trap and respond to application specific errors during backups and restores

Snapshot volumes on VHDs


51

Virtual Disk Services (VDS)

52

VDS in Windows Server 2008LUN Shrink

Enables shrinking LUNs and recovering space on a hardware arrayUsed in conjunction with Volume and File System shrink

SAN Policy (disk online/offline)New SAN disks declared to be online or offline by defaultThe default for high end server editions is offlineThis protects SAN disks from aggressive Windows behaviorBetter cluster integration – clustering now uses VDS to manage disksNew read only attribute for disks

Partition AlignmentThe default alignment of new partitions is 1Mbyte

Dynamic Partition AllocationNew algorithm scans through all free space and allocates from the best fitReduced free space fragmentation

53

VDS in R2

Storage Pools (collection of storage in an array)Based on array vendor input and SMI-SPhase I: Enumerate Pools; Create LUN in Pool; Get Properties

Updates to hardware array support Explicit RAID types (ex: 3, 4, 5, 6, 10, 50, 60) New Subsystem types (SAS, hybrid) Query array’s internal number for a LUN New flags on subsystems, controllers, drives and LUNs

Native VHD supportCreate, surface, remove VHDsExpand, compact, merge, shrink, convertNew VDS provider type: extensible to other virtual disk types


54

File Server Resource Manager (FSRM)

55

FSRM

Storage usage, planning and monitoringQuota ManagementPolicy Management

Help IT administratorUnderstand how existing storage is utilizedTroubleshoot storage capacity issuesDefine and implement storage policies

Storage reports and alertsCurrent storage usage and usage trendsQuota thresholdPolicy related alerts

56

FSRM Quota Management

57

FSRM File Screening

58

FSRM Report Management

59

FSRM Reports

60

Summary

Remote File ServicesServer Message Block version 2 (SMB2)Distributed File System Namespace (DFS-N)Distributed File System Replication (DFS-R)Microsoft Services for Network File System (MSNFS)Folder Redirection and Offline Files (CSC)

Storage ManagementStorage ExplorerShare and Storage ManagementVirtual Disk Services (VDS)Volume ShadowCopy Services (VSS)File Server Resource Manager (FSRM)

61

© 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED

OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Documents

Windows Server 2008 File and Storage Solutions