33
Microsoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

  • Upload
    doannhu

  • View
    217

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Microsoft File Sharing Protocols (SMB 3) Update

Tom Talpey

Architect File Server team Microsoft

Outline

bull SMB 311

bull Windows timeline and Document timeline(s)

bull SMB3 Family News

bull More speed Less latency

May 20 2015 SambaXP 2015 Goumlttingen 2

SMB 311 Feature Review

Since SDC (September 2014)

0 Dialect now 311

1 Extensible Negotiation2 Preauthentication Integrity3 Encryption Improvements4 Cluster Dialect Fencing5 Cluster Client Failover (CCF) v26 SMB3x behaviors

3May 20 2015 SambaXP 2015 Goumlttingen

Dialectbull The Windows 10 SMB dialect will be 311

bull At SDC time (Technical Preview 1) it was 31bull 31 is now unsupported and unimplemented ndash will be rejectedbull We expect but cannot promise that Windows Server 2016 will also be 311

bull Minor number bump (31) is by designbull We will likely continue this on future major cycles of Windows Server

bull Sub-minor bump (311) needed due to Preview protocol updatesbull The dialect disambiguates packet formats and behavior changes from 31

bull Dialects in documents and PowerShell now ldquoMajorMinorSubrdquobull Or simply MajorMinor if Sub==0bull Eg ldquo2002rdquo is now ldquo202rdquo ldquo30rdquo remains ldquo30rdquo etcbull Simplified documentation and scripting

May 20 2015 SambaXP 2015 Goumlttingen 4

Extensible Negotiation (review)bull How to negotiate complex connection

capabilitiesbull Very few unused bits left in the negotiate

messages

bull SMB 311 Extensible Negotiationbull Exchange additional negotiate information via

negotiate contexts (same idea as create contexts)bull Repurpose unused fields in negotiate request

response as NegotiateContextOffset and NegotiateContextCount fields

bull Add list of negotiate contexts to end of existing negotiate messages

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

5

Key Points

bull Client sends negotiate contexts if it supports the 311 dialect

bull Server sends negotiate contexts if it selects 311 as the connectionrsquos dialect

bull Receiver must ignore unknown negotiate contexts

bull SMB 23 server implementations must be willing to accept negotiate requests that are larger than the SMB2_HEADER + SMB2_REQ_NEGOTIATE + Dialects arraybull A client does not know whether a server supports SMB 311 before it

negotiates so must assume that it does and send negotiate contexts

bull Windows accepts negotiate requests as large as 128 KiB

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

6

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 2: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Outline

bull SMB 311

bull Windows timeline and Document timeline(s)

bull SMB3 Family News

bull More speed Less latency

May 20 2015 SambaXP 2015 Goumlttingen 2

SMB 311 Feature Review

Since SDC (September 2014)

0 Dialect now 311

1 Extensible Negotiation2 Preauthentication Integrity3 Encryption Improvements4 Cluster Dialect Fencing5 Cluster Client Failover (CCF) v26 SMB3x behaviors

3May 20 2015 SambaXP 2015 Goumlttingen

Dialectbull The Windows 10 SMB dialect will be 311

bull At SDC time (Technical Preview 1) it was 31bull 31 is now unsupported and unimplemented ndash will be rejectedbull We expect but cannot promise that Windows Server 2016 will also be 311

bull Minor number bump (31) is by designbull We will likely continue this on future major cycles of Windows Server

bull Sub-minor bump (311) needed due to Preview protocol updatesbull The dialect disambiguates packet formats and behavior changes from 31

bull Dialects in documents and PowerShell now ldquoMajorMinorSubrdquobull Or simply MajorMinor if Sub==0bull Eg ldquo2002rdquo is now ldquo202rdquo ldquo30rdquo remains ldquo30rdquo etcbull Simplified documentation and scripting

May 20 2015 SambaXP 2015 Goumlttingen 4

Extensible Negotiation (review)bull How to negotiate complex connection

capabilitiesbull Very few unused bits left in the negotiate

messages

bull SMB 311 Extensible Negotiationbull Exchange additional negotiate information via

negotiate contexts (same idea as create contexts)bull Repurpose unused fields in negotiate request

response as NegotiateContextOffset and NegotiateContextCount fields

bull Add list of negotiate contexts to end of existing negotiate messages

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

5

Key Points

bull Client sends negotiate contexts if it supports the 311 dialect

bull Server sends negotiate contexts if it selects 311 as the connectionrsquos dialect

bull Receiver must ignore unknown negotiate contexts

bull SMB 23 server implementations must be willing to accept negotiate requests that are larger than the SMB2_HEADER + SMB2_REQ_NEGOTIATE + Dialects arraybull A client does not know whether a server supports SMB 311 before it

negotiates so must assume that it does and send negotiate contexts

bull Windows accepts negotiate requests as large as 128 KiB

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

6

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 3: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

SMB 311 Feature Review

Since SDC (September 2014)

0 Dialect now 311

1 Extensible Negotiation2 Preauthentication Integrity3 Encryption Improvements4 Cluster Dialect Fencing5 Cluster Client Failover (CCF) v26 SMB3x behaviors

3May 20 2015 SambaXP 2015 Goumlttingen

Dialectbull The Windows 10 SMB dialect will be 311

bull At SDC time (Technical Preview 1) it was 31bull 31 is now unsupported and unimplemented ndash will be rejectedbull We expect but cannot promise that Windows Server 2016 will also be 311

bull Minor number bump (31) is by designbull We will likely continue this on future major cycles of Windows Server

bull Sub-minor bump (311) needed due to Preview protocol updatesbull The dialect disambiguates packet formats and behavior changes from 31

bull Dialects in documents and PowerShell now ldquoMajorMinorSubrdquobull Or simply MajorMinor if Sub==0bull Eg ldquo2002rdquo is now ldquo202rdquo ldquo30rdquo remains ldquo30rdquo etcbull Simplified documentation and scripting

May 20 2015 SambaXP 2015 Goumlttingen 4

Extensible Negotiation (review)bull How to negotiate complex connection

capabilitiesbull Very few unused bits left in the negotiate

messages

bull SMB 311 Extensible Negotiationbull Exchange additional negotiate information via

negotiate contexts (same idea as create contexts)bull Repurpose unused fields in negotiate request

response as NegotiateContextOffset and NegotiateContextCount fields

bull Add list of negotiate contexts to end of existing negotiate messages

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

5

Key Points

bull Client sends negotiate contexts if it supports the 311 dialect

bull Server sends negotiate contexts if it selects 311 as the connectionrsquos dialect

bull Receiver must ignore unknown negotiate contexts

bull SMB 23 server implementations must be willing to accept negotiate requests that are larger than the SMB2_HEADER + SMB2_REQ_NEGOTIATE + Dialects arraybull A client does not know whether a server supports SMB 311 before it

negotiates so must assume that it does and send negotiate contexts

bull Windows accepts negotiate requests as large as 128 KiB

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

6

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 4: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Dialectbull The Windows 10 SMB dialect will be 311

bull At SDC time (Technical Preview 1) it was 31bull 31 is now unsupported and unimplemented ndash will be rejectedbull We expect but cannot promise that Windows Server 2016 will also be 311

bull Minor number bump (31) is by designbull We will likely continue this on future major cycles of Windows Server

bull Sub-minor bump (311) needed due to Preview protocol updatesbull The dialect disambiguates packet formats and behavior changes from 31

bull Dialects in documents and PowerShell now ldquoMajorMinorSubrdquobull Or simply MajorMinor if Sub==0bull Eg ldquo2002rdquo is now ldquo202rdquo ldquo30rdquo remains ldquo30rdquo etcbull Simplified documentation and scripting

May 20 2015 SambaXP 2015 Goumlttingen 4

Extensible Negotiation (review)bull How to negotiate complex connection

capabilitiesbull Very few unused bits left in the negotiate

messages

bull SMB 311 Extensible Negotiationbull Exchange additional negotiate information via

negotiate contexts (same idea as create contexts)bull Repurpose unused fields in negotiate request

response as NegotiateContextOffset and NegotiateContextCount fields

bull Add list of negotiate contexts to end of existing negotiate messages

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

5

Key Points

bull Client sends negotiate contexts if it supports the 311 dialect

bull Server sends negotiate contexts if it selects 311 as the connectionrsquos dialect

bull Receiver must ignore unknown negotiate contexts

bull SMB 23 server implementations must be willing to accept negotiate requests that are larger than the SMB2_HEADER + SMB2_REQ_NEGOTIATE + Dialects arraybull A client does not know whether a server supports SMB 311 before it

negotiates so must assume that it does and send negotiate contexts

bull Windows accepts negotiate requests as large as 128 KiB

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

6

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 5: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Extensible Negotiation (review)bull How to negotiate complex connection

capabilitiesbull Very few unused bits left in the negotiate

messages

bull SMB 311 Extensible Negotiationbull Exchange additional negotiate information via

negotiate contexts (same idea as create contexts)bull Repurpose unused fields in negotiate request

response as NegotiateContextOffset and NegotiateContextCount fields

bull Add list of negotiate contexts to end of existing negotiate messages

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

5

Key Points

bull Client sends negotiate contexts if it supports the 311 dialect

bull Server sends negotiate contexts if it selects 311 as the connectionrsquos dialect

bull Receiver must ignore unknown negotiate contexts

bull SMB 23 server implementations must be willing to accept negotiate requests that are larger than the SMB2_HEADER + SMB2_REQ_NEGOTIATE + Dialects arraybull A client does not know whether a server supports SMB 311 before it

negotiates so must assume that it does and send negotiate contexts

bull Windows accepts negotiate requests as large as 128 KiB

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

6

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 6: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Key Points

bull Client sends negotiate contexts if it supports the 311 dialect

bull Server sends negotiate contexts if it selects 311 as the connectionrsquos dialect

bull Receiver must ignore unknown negotiate contexts

bull SMB 23 server implementations must be willing to accept negotiate requests that are larger than the SMB2_HEADER + SMB2_REQ_NEGOTIATE + Dialects arraybull A client does not know whether a server supports SMB 311 before it

negotiates so must assume that it does and send negotiate contexts

bull Windows accepts negotiate requests as large as 128 KiB

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

6

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 7: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Preauth Integrity (review)bull How to protect messages from

tampering prior to authenticationbull No protection prior to SMB 30

bull SMB 30x Negotiate Validation doesnrsquot protect negotiate contexts or session setup messages

bull SMB 31 Preauthentication Integritybull Provides end-to-end protection of

preauthentication messages

bull Sessionrsquos secret keys derived from hash of the preauthentication messages

bull Signature validationdecryption of subsequent authenticated messages will fail in case of preauthentication message tampering

bull UNCHANGED

Client Server

Negotiate request

Negotiate response

Session setup request

Session setup response

Session setup request

Session setup response

Tree connect request

Tree connect response

UnsignedUnencrypted

now protected by hash

SignedEncryptedMay 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

7

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 8: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Key Points

bull Preauthentication Integrity is mandatory for SMB 311

bull Session setup hashes are only calculated for master and binding session setup exchanges not reauthentication

bull Preauthentication Integrity supersedes SMB 30x Negotiate Validation for SMB 311 connections

bull Expect additional hardening based on security reviews over time

bull Document significantly updated for clarity

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

8

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 9: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Encryption Improvements (review)

bull SMB 30x mandates the AES-128-CCM cipherbull What if a different cipher is required for

performance regulatory requirements etc

bull SMB 311 Encryption Improvementsbull Ciphers are negotiated per-connection

bull Adding support for AES-128-GCM

bull Clients can mandate that sessions be encrypted even if the server does not require encryption

bull Mostly UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

9

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 10: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Client-mandated Encryption (change)

bull No longer presentbull Client mandates session encryption by setting the

SMB2_SESSION_FLAG_ENCRYPT_DATA flag in its session setup request

bull Removed in 311

bull Not a complete solution to mandating encryption

bull Client can readily detect and reject server behavior and decline to continue

bull Therefore removed from protocol

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

10

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 11: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Key Points

bull AES-CCM required for SMB 30x compatibility

bull AES-GCM provides significant performance gains and should be supported

bull Session binding (multichannel) requires all of a sessionrsquos channels to negotiate the same cipher as the sessionrsquos original connection

bull Client-mandated encryption depends on SMB 31 and Preauthentication Integrity to guarantee securitybull Not sufficient for client to simply send encrypted requests and

verify encrypted responses

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

11

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 12: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Cluster Dialect Fencing (review)

bull How to support clustered file servers whose nodes have different maximum SMB dialects (for example 302 vs 311)bull Currently all cluster nodes must support the same maximum

SMB dialect to allow a client to transparently failover between cluster nodes

bull SMB 311 Cluster Dialect Fencingbull Define a maximum SMB cluster dialect that all nodes support

bull Fence access to cluster shares based on the maximum SMB cluster dialect

bull Fenced clients instructed to reconnect at a cluster-supported dialect

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

12

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 13: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Key Points

bull Dialect fencing only affects clustered share accessbull Clients can still access non-clustered shares using dialect X even

if the maximum SMB cluster dialect is lt X

bull Canrsquot mix clustered and non-clustered access on same connection

bull Client implementation should protect against infinite loop of tree connect failure disconnect reconnect tree connect failure hellip

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

13

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 14: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Cluster Client Failover v2 (review)

bull Introduced with SMB 3 for clustered applications using SMB 3 storage

bull Permits clustered application to tag an open with ApplicationInstance identifier

bull An open issued by a different client with the same ApplicationInstance indicates workload has transitioned to the new node so old opens are closed

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

14

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 15: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Key Points

bull The CCF2 extension permits a client machine to keep your clustered application running during failover situations but release it when the workload has been formally moved

bull Extending your storage cluster to support CCF2 is simple

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

15

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 16: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Changes coming (review)

bull Removing RejectUnencryptedAccess settingbull Always reject clients that donrsquot support encryption when connecting to a

servershare that requires encryption

bull CHANGED RejectUnencryptedAccess ndash see the updated documentbull When a server receives an unencrypted request and the server is configured to require

encryption RejectUnecryptedAccess is checked

bull Default of TRUE means all such client requests are rejected (legacy-free most secure)

bull Setting to FALSE rejects encryption-capable SMB3x but allows others to connect (legacy compatibility)bull Defers enforcement until all legacy clients upgraded

bull Removing RequireSecureNegotiate settingbull Always perform negotiate validation if the connectionrsquos dialect is 2x or 30x

bull UNCHANGED

May 20 2015 SambaXP 2015 Goumlttingen

SDC 2014 Review

16

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 17: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Changes 2 (review)bull Restricting use of guest sessions

bull Indistinguishable from man-in-the-middle attackbull Let us know ASAP if you have a scenario that requires guest logons using SMB 2x or 3xbull Interop experience indicates many third-party servers return SESSION_IS_GUEST and most

Samba-based (and many other) NAS server connections fail when clients reject guest with this

bull Windows 10 Preview telemetry showed a high percentage of guest usagebull Somewhat limited sample used here for illuminationbull Guest usage still quite prevalent in HomeSMB1 settings (sigh) but less common in SMB2 (good)Added a setting (and an organization-wide group policy) but default to ldquooffrdquo for Windows 10

May 20 2015 SambaXP 2015 Goumlttingen 17

SMB1Guest

(Browser sessions

removed)

SMB23Guest

(Loopback sessions

removed)

SDC 2014 Review

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 18: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

SMB2_TREE_CONNECT Change

bull SMB 311 now requires a non-anonymous non-guest TREE Connect to be signed

bull Provides additional hardening of the NEGOTIATESESSION_SETUPTREE_CONNECT initial exchange

bull Non-strongly authenticated sessions still subject to previous checksbull Eg limited pipe access etc

May 20 2015 SambaXP 2015 Goumlttingen 18

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 19: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

MS-RSVD Preview

bull New MS-RSVD Version 2bull Supports VHDX snapshots VHD Sets

bull New updated Previewbull httpdownloadmicrosoftcomdownloadC6CC6C3C6F1-E84A-44EF-

82A9-49BD3AAD8F58Windows[MS-RSVD-Diff]pdf

May 20 2015 SambaXP 2015 Goumlttingen 19

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 20: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Protocol Documentation releases

bull ldquoOfficialrdquo (full-support) documents are releasedbull Prior to any RTM of Windows

bull New Errata process replaces interim document releasesbull And provides more prompt resolution of Technical Document Issues

bull ldquoPreviewrdquo documents are releasedbull Prior to major Windows Technical Preview releases

bull Whenever new preview content is completed significant or ldquointerestingrdquobull Case-by-case basis but we try to push the SMB family early and often

bull Howeverhellipbull Windows and Windows Server releases are now becoming decoupled

May 20 2015 SambaXP 2015 Goumlttingen 20

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 21: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Timeline

bull ROUGH dates bull Windows 10 has 3 Technical Previews (ldquobetardquo) Release expected mid-2015bull Windows Server 2016 has 2 Technical Previews and a third expected sometime in 2015 with

Release in 2016

bull Windows Client and Server are no longer on the same release schedule

bull Documentation will need to adapt

May 20 2015 SambaXP 2015 Goumlttingen 21

2014 | 2015 | 2016

Windows 10 TP1 TP2 TP3 RTM hellip hellip hellip

Windows Server 2016 TP1 TP2 TP3 RTM hellip

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 22: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

PreviewRTM ldquoMixrdquo

bull SMB 31 and 311 are Previewed since September 2014

bull Windows 10 releasing with SMB 311

bull Windows Server 2016 still in Preview also implements 311

bull Published MS-SMB2 will cover RTM Windows 10 and Preview Serverbull This is new and ldquoexperimentalrdquo

bull Considered best way to simplify licensee document experience

bull Potentially may result in some confusing WBNs

bull Bear with us and give feedback if needed

bull Still unclear how to manage future release interleave

May 20 2015 SambaXP 2015 Goumlttingen 22

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 23: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

SMBrsquos Growing Familybull SMB3 (update in preview)

bull Use by Cloud Platform System (CPS)

bull Use by Storage Replica

bull Use by Storage Spaces Direct

bull Hyper-V relatedbull RSVD (update in preview doc)bull Storage QOS (preview doc)

bull Azure Filesbull Azure joining SMB family ndash with an Azure SMB2 server

bull New implementation derived from MS-SMB2bull Currently supporting SMB 21bull httpazuremicrosoftcomen-usservicesstoragefiles

May 20 2015 SambaXP 2015 Goumlttingen 23

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 24: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

bull

bull

bull

bull

bull

bull

bull

Cloud Platform System (CPS)Integrated solution for HW and SW

Todayrsquos solution withWindows Server 2012 R2 and System Center 2012 R2

May 20 2015 SambaXP 2015 Goumlttingen 24

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 25: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Multi-Site Cluster

Site1 Site2

Flexible

Works with any Windows volume uses SMB3 as transport

Hardware agnostic - works with Storage Spaces or any SAN volume

Integrated management

End-to-end Windows Server disaster recovery solution

Failover Cluster Manager UI and PowerShell

Scalable

Block-level synchronous volume replication

Automatic cluster failover for low Recovery Time Objective (RTO)

Cross site High Availability Disaster Recovery Stretch clusters across sites with synchronous volume replication

Storage Replica

May 20 2015 SambaXP 2015 Goumlttingen 25

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 26: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

bull

Software defined storage for private cloud using industry standard servers with local storage

Storage Spaces DirectSoftware defined storage for private cloud using industry standard servers with local storage

May 20 2015 SambaXP 2015 Goumlttingen 26

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 27: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Storage Quality of Service (QoS)

bull

bull

bull

bull

bull

bull

bull

bull

Policy Manager

Rate Limiter

IO Scheduler

Control and monitor storage performance

May 20 2015 SambaXP 2015 Goumlttingen 27

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 28: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Demo Summary 100GbE and NVMeA technology demonstration from Mayrsquos Microsoft Ignite

httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

Micron NVMe3x

May 20 2015 SambaXP 2015 Goumlttingen 28

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 29: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Emerging Ultra-Low Latency Storage Technologiesbull Traditional block devices

bull HDD ndash latencies ~1rsquos msecbull SSD ndash latencies ~100rsquos microsecbull SMB3 well-matched to these

bull NVMe ndash New high-performance storage interfacebull 25rdquo M2 PCIe card etc form factorbull Block device semanticsbull Latencies ~10rsquos microsec (perhaps even lt10 microsec)bull SMB3 via SMB Direct still in the game

bull PM - New class of ldquoByte-Addressable Storagerdquobull Persistent Memory ndash DIMM form factorbull Memory semantics latencies lt1 microsecbull Argues for new paradigm in SMB3 and RDMA

May 20 2015 SambaXP 2015 Goumlttingen 29

Technology Latency (high)

Latency (low)

IOPS

HDD 10 msec 1 msec 100

SSD 1 msec 100 microsec 100K

NVMe 100 microsec 10 microsec (orbetter)

500K+

PM lt 1 microsec (~ memory speed)

BWsize(gtgt1MDIMM)

Note orders of magnitude decrease

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 30: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

SNIA NVM Programming

bull SNIA Technical Working Group (TWG) for NVM programming

bull Recently published white paperbull NVM Programming Model v11

bull httpwwwsniaorgtech_activitiesstandardscurr_standardsnpm

bull Ongoing work on Remote Access to PMbull Numerous tracks at upcoming September SNIA SDC

bull Watch this space for SMB3 and SMB Directbull And other protocols

May 20 2015 SambaXP 2015 Goumlttingen 30

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 31: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Resourcesbull httpwwwmicrosoftcomopenspecifications

bull httpsmb3info

bull YouTube SMB demo videos httpswwwyoutubecomchannelUCLlf1kxGhvV3b15Q_V7jQJw

bull MS-SMB2-Diff and MS-RSVD-Diff httpmsdnmicrosoftcomen-uslibraryee941641aspx

bull The Rosetta Stone httpblogstechnetcombjosebdaarchive20150430smb3-networking-links-for-windows-server-2012-r2aspx

bull SMB3 Newsbull httpblogstechnetcombjosebdaarchive20150505what-s-new-in-smb-3-1-1-in-the-windows-server-

technical-preview-2aspxbull httpblogstechnetcombjosebdaarchive20150421the-deprecation-of-smb1-you-should-be-planning-to-

get-rid-of-this-old-smb-dialectaspx

bull Storage QOSbull httpchannel9msdncomEventsIgnite2015BRK3504bull httpblogstechnetcombjosebdaarchive20150506windows-server-2016-technical-preview-2-tp2-and-

storage-quality-of-service-qosaspx

bull SNIA SMB presentation (updated)bull httpwwwsniaorgsitesdefaultfiles2DSI2015presentationsFileSystemsJoseBarreto_SMB3_remote20file

20protocolpdf

May 20 2015 SambaXP 2015 Goumlttingen 31

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 32: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Resources ndash Microsoft Ignite

bull May 2015 presentations demos etc relevant to topics above

bull httpignitemicrosoftcomSessions

May 20 2015 SambaXP 2015 Goumlttingen 32

Code Session title Presenters

BRK3496Deploying Private Cloud Storage with Dell Servers and Windows

Server vNext

Claus Joergensen Shai Ofek Syama

Poluri

BRK3474Enabling New On-premises Scale-Out File Server with Direct-Attached

StorageClaus Joergensen Michael Gray

BRK3489 Exploring Storage Replica in Windows Server vNext Ned Pyle

BRK3504 Hyper-V Storage Performance with Storage Quality of Service Jose Barreto Senthil Rajaram

BRK2458 Overview of Microsoft Azure Storage and Key Usage Scenarios Vamshidhar Kommineni

BRK2472 Overview of the Microsoft Cloud Platform System Vijay Tewari Wassim Fayed

BRK2485 Platform Vision amp Strategy (4 of 7) Storage Overview Jose Barreto Siddhartha Roy

BRK3487Stretching Failover Clusters and Using Storage Replica in Windows

Server vNextElden Christensen Ned Pyle

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33

Page 33: Microsoft File Sharing Protocols (SMB 3) Update - sambaXP · PDF fileMicrosoft File Sharing Protocols (SMB 3) Update Tom Talpey Architect, File Server team, Microsoft

Questionsttalpeymicrosoftcom

May 20 2015 SambaXP 2015 Goumlttingen 33