Embed Size (px)
Citation preview
Windows Server 2012Storage Capabilities for EveryoneDarren MossSenior Program ManagerMicrosoft Corporation
WSV327
The Storage and File Systems (SFS) group builds the platform
storage features shipping across all versions of Windows
Ease of storage administration
Storage Management PowerShell with SMI-S integration
Minimizes Op-Ex
Efficient capacity utilization
Thin provisioning integrationMaximizes Existing Hardware Dynamic data
movement Offloaded data transfers
Storage virtualization and resiliency
Storage SpacesMinimizes Cap-Ex
Maximizes Availability
Next-generation scale, availability, and integrity
Resilient File System (ReFS)
Maximized data availability
Modern NTFS CHKDSK
Storage Platform Overview
Benefit Capability Feature
Enabled Deployment ModelsCost-efficient Storage (New) Traditional Storage
Local File Access
Remote File Access
JBODSApp Serve
rs
SAS
JBODSCA File
Servers
SAS
App Serve
rs
File
\db
App Serve
rs
FCiSCSI
CA File
Servers
FCiSCSI
App Serve
rs
File
\db
Windows Server 2012 is the most cost-efficient
platform for continuously available and highly scalable data access
Storage Spaces
Storage Virtualization and Resiliency
Storage Spaces delivers a new category of highly capable storage solutions to all Windows
customer segments at dramatically lower price-points and maximized operational simplicity
Cost-Efficient Business Critical Storage
Powerful new platform abstractionsStorage pools: Units of aggregation, administration, isolationStorage spaces: Resiliency, provisioning, and performance
Industry standard commodity storageInterconnects: SAS, USB, and SATAEnclosures: Shared SAS JBOD arrays
Storage Spaces Conceptual Model
Windows Server 2012 Capabilities
File and Storage Manager
Failover Clustering & CSV v2
ReFS & NTFS
Hyper-V
SMB v3 RDMA
Storage Mgmt. PowerShell
Virtualized Resilient Storage
Mirror Space
Parity Space
Mirror Space
Mirror Space
Mirror Space
Parity Space
Parity Space
Mirror Space
Mirror Space
Mirror Space
Mirror Space
Parity Space
Cost-efficient shared SAS JBOD arrays
Physical or Virtualized Servers
Physical Deployment Topologies
ORSAS
Shared SAS
Capabilities Overview
Optimized and flexible capacity utilization
Resiliency to drive failure
Operational simplicity with support for multi-tenancy
High-availability and scalability
Workload-optimized performance via heterogeneous media
Optimized and Flexible Capacity Utilization
On-demand provisioning with automated capacity reclamation (trim/unmap)
Capacity reclamation for deleted files (NTFS and ReFS)Sub-file capacity reclamation (e.g. through Hyper-V)Scheduled optimization for slab reclamation
Elastic capacity expansionSimply add more drives
60TB Space
60TB Space
60TB Space
60TB Space
Company A Storage Pool 60TB
Space60TB Space
60TB Space
60TB Space
Company B Storage Pool
Thinly provisioned storage spaces
Industry standard commodity storage 36 TB across 72 disks48 TB across 96 disks
Resiliency to Drive Failure
Resilient storageMirror spaces with dirty region trackingParity spaces with integrated journaling
Rapid recovery via per-pool hot spares
Mirror Space
Parity Space
Mirror Space
Mirror Space
Mirror Space
Parity Space
Mirror Space
Mirror Space
Resilient Spaces
Hot Spare
Industry standard storage
Operational Simplicity
Managed via Storage Management PowerShellEnclosure awarenessFlexible and granular administrative control with self-service agility and tenant isolation
Mirror Space
Parity Space
Simple Space
Workload Admin
Tenant Admin
Company A Pool
Mirror Space
Parity Space
Simple Space
Workload Admin
Tenant Admin
Company B Pool
Hoster Admin
Granular management control
Multi-tenant deployment
Effectively Utilize Hardware Investment
Enables mixed deploymentsUtilize both SSD and HDD media typesControl placement at storage space granularity
Industry standard commodity storage
Diverse spaces for diverse workloads
15K RPM
Home Space
Silver
7200 RPM
Archive Space
Bronze
Solid state
Finance Space
ERP Space
Gold
Standalone Server
Low number of individual servers, each with directly-attached storage
Acceptable periods of planned downtime for traditional maintenance
Space Space Space
Storage spaces with a diverse set of workloads
Standalone Deployment
Performance of a Well-tuned Standalone System
1 2 4 8 12 16 20 24 28 320
50010001500200025003000350040004500
Simple Spaces vs. Native DisksRead Throughput
Simple Spaces
Native Disks
Thro
ughput
MB
/s
1MB Sequential Read, 7.2K RPM SAS
1 2 4 8 12 16 20 24 28 320
50010001500200025003000350040004500
Simple Spaces vs. Native DisksWrite Throughput
Simple Spaces
Native Disks
Thro
ughput
MB
/s
1MB Sequential Write, 7.2K RPM SAS
1 2 4 8 12 16 20 24 28 320
1000
2000
3000
4000
5000
6000
7000
Simple Spaces vs. Native DisksRead IOPS
Simple Spaces
Native Disks
IOP
S
4K Random Read, 7.2K RPM SAS
1 2 4 8 12 16 20 24 28 320
1000
2000
3000
4000
5000
6000
Simple Spaces vs. Native DisksWrite IOPS
Simple Spaces
Native Disks
IOP
S
4K Random Write, 7.2K RPM SAS
Clustered Storage Spaces Deployment Element
Building block for scalable, highly available deployments
Easily expandable through additional DeploymentElements
Can move HA workload off a cluster node for maintenance without disruption
Live Migration for running VMsSimple “Move” Operation for others
Space Space SpaceClustered Storage Spaces
\CRMUnified Cluster Shared Volume Namespace
Enterprise Workloads
2-4 servers
Shared SAS storage
Deployment Element
Scalable and Continuous Availability
Physical View(64 servers max)
Space Space Space Space Space Space Space Space Space
Clustered Pools and Storage Spaces
\Finance \CRM \File-SharesUnified Cluster Shared Volume Namespace
Logical View(Highly available, scalable, cost-efficient)
Enterprise Workloads.\db .\VHD
VMs
.\Home
CA File Server
Deployment ElementDeployment Element
2-4 servers
Shared SAS storage
Deployment Element
Capacity Cluster Deployment Element
4 RAID Inc. FusionRomley 2U Dual-Socket EP cluster nodes with dual LSI 9205-8e SAS adapters
RAID Inc. 60-bay EBOD with Seagate Constellation 3TB Near-line SAS HDDs
180 TB
See this hardware in the TLC Windows Storage booth
Performance Cluster Deployment Element
3 RAID Inc. FusionRomley 2U Dual-Socket EP cluster nodes with dual LSI 9205-8e SAS adapters
RAID Inc. 24-bay EBOD with OCZ Talos II “R” 400GB SAS SSDs
>1 Million IOPS
>10 GB/s
See this hardware in the TLC Windows Storage booth
64 Node ClusterItem Count
Deployment Elements 16
Servers per Element 4
Total number of servers 64
JBODs per Element 1
Total number of disks 242 HDDs and SSDs
40Gbps networks per server
4
Virtual Machines 4000
Storage Spaces delivers a new category of highly capable storage solutions to all Windows
customer segments at dramatically lower price-points and maximized operational simplicity
Resilient File System (ReFS)
Next-generation scale, availability, and integrity
ReFS is a new file system delivering on demanding customer needs while providing a foundation for significant future innovations.
Windows Server 2012 customers can deploy the most cost-efficient platform for available and scalable data access using commodity storage,
by utilizing an integrated storage stack comprising ReFS and Storage Spaces.
ReFS Overview
• All metadata corruption is always detected. Optionally, user data corruption is also detected.
• ReFS utilizes Storage Spaces’ resiliency to auto-correct.
Integrity
• ReFS efficiently scales to PB datasets comprising very large files.
Scalability
• ReFS maximizes data availability.• If corruption occurs and a redundant copy is unavailable, the non-corrupt portions of
the file system remain unaffected and online.
Availability
• Architecture enables efficient evolution for new storage devices and new access patterns
Architectural Evolution
Integrity
Allocate-on-write eliminates corruption from errors associated with in-place update
Checksums detect whether the data on media has changed since it was last written
File system metadata is always protected, maximizing online operation
Flexible user data protection is configurable on a per-volume, per-directory, and per-file basis
ReFS and Storage Spaces
Data Volume - NTFS
Scrubber
Data Volume - ReFS
Storage Pool
Data
Copy0
Data
Copy1
Data
Copy2
On media failure, the scrubber will get an alternate copy of the data
With NTFS, Scrubber verifies all copies can be read
Checksum is inspected on all copies of the dataIf corruption detected, trigger auto-correct and return a healthy copy of the data
With ReFS, Scrubber verifies checksums on all copies and auto-corrects as needed
Copy1
DataCHK
Copy2
DataCHK
Copy0
DataCHK
Mirror Space
Mirror Space
ReFS Auto Correction
Application accesses data
ReFS volume detects corruption and automatically replaces the corrupt data with correct data
Mirror space offers all data copies to the file system
ReFS
Scalability
ReFS uses a highly scalable, flexible, B+ tree data structure for all metadata• Ensures maximum scalability and volume sizes
beyond NTFS
File system abstractions are implemented using key-value tables built from the B+ trees
Capacity allocation is handled by a hierarchy of allocators• Ability to allocate at different sized granularities
Availability
ReFS provides rapid recovery from file system corruption without affecting volume availability
If corruption occurs:If a redundant copy is available, then correction happens automaticallyIf a redundant copy is unavailable, then repair happens online and only the corrupt portion of the namespace is affected
Mirror Space
Copy0
Metadata Copy1
Metadata
Application Compatibility (1/2)
While delivering on new capabilities, ReFS also builds on NTFS’ 20 years of application compatibility
ReFS largely reuses the upper-layer to provide API compatibility to applications while providing a new on-media engine that enables new capabilities
NTFS.SYS
Upper API Layer
On-media Store
ReFS.SYS
Upper API Layer
MinStore
Application Compatibility (2/2)
ReFS supports the majority of the Win32 APIs
However, there are certain features that ReFS does not support
Legacy Short Names TxF
NTFS-specific Reparse Index Named Streams MFT
Superseded NTFS
Encryption NTFS Quotas NTFS
Compression
Other Hard Links
Extended
Attributes Object IDs
ReFS DeploymentsDeployable on cost-efficient commodity hardware
Optional integrity streams guarantee user data integrityStorage Spaces provides resiliency against media failure
Failover Clustering provides high availability for File Server
ConsiderationsOnly available with Windows Server 2012Can only be deployed as a data volumeDoes not guarantee the same level of application compatibility as NTFS
Deployment Element
2-4 servers
Shared SAS storage
Space Space SpaceClustered Storage Spaces
Home Dirs
VHD Librar
y
Mark’t
Dept.
ReFS volumes with integrity streams
\Docs \Home \VHDs Highly Available File Server
VHDs
ReFS is a new file system delivering on demanding customer needs while providing a foundation for significant future innovations.
Windows Server 2012 customers can deploy the most cost-efficient platform for available and scalable data access using commodity storage,
by utilizing an integrated storage stack comprising ReFS and Storage Spaces.
Modern NTFS CHKDSK
Maximized Data Availability
Confidently deploy multi-TB volumes with Windows Server 2012
Maximizing Availability in Windows Server 2012
Improved detection and handling of corruptions in NTFS
Change in the CHKDSK execution modelSeparate analysis and repair phases
Integration with Cluster Shared Volumes (CSV)
In Windows Server 2012, NTFS reaches new levels of
availability through significant CHKDSK
enhancements
Online Analysis and Repair Workflow
Possible Corruption Detected
• NTFS detects a perceived anomaly in file system metadata
Online Self-Healing
• NTFS attempts to rapidly self-heal
• Volume remains online
Online Verification
• NTFS will validate whether issue is transient or genuine
• Volume remains online
Online Identification & Logging
• If not self-healed, NTFS will identify and log corrective actions for later processing
• User or Admin is notified• Volume remains online
Precise & Rapid Offline Repair
• The user or admin can take the volume offline when convenient, and outstanding logged corruptions are rapidly repaired a.k.a. “spot fixed”
• With CSV, IO is transparently paused for rapid repair, then automatically resumed
Only Seconds Offline to Repair a Corruption
100 Million Files 200 Million Files 300 Million Files0
50
100
150
200
250
300
350
400
109
292
376
0.13 0.13 0.13
Windows Server 2008 R2 Windows Server 2012
Execu
tion
Tim
e (
min
ute
s)
Confidently deploy multi-TB volumes with Windows Server 2012
Storage Management PowerShell with SMI-S Integration
Ease of Storage Administration
With Windows Server 2012, storage management is an integrated and
intuitive experience, which reduces operational complexity
A New Approach to Storage Management
PowerShell commands simplify end-to-end storage management
Designed for remote administration and scripting
WMI-based class structure for managing heterogeneous storage
SMI-S integration enables broad multi-vendor interoperabilityStorage Management Provider (SMP) framework enables easy extensibility
SCVMM v.Next integration enables easy management of virtualized deployments
Comprehensive Storage Management
Microsoft Applications ISV or Storage Vendor
Applications
Single Storage Management Interface
SMP basedsubsystem
SMI-S compliant subsystem
Storage Spaces
Storage Spaces compatible JBOD
Integrated Storage Management
In this example, virtual disks are shown from:
Storage Spaces providerEMC via SMI-SEqualLogic via its SMP
SMP basedsubsystem
SMI-S compliant subsystem
Storage Spaces
Storage Spaces compatible JBOD
With Windows Server 2012, storage management is an integrated and
intuitive experience, which reduces operational complexity
Thin Provisioning Integration and Offloaded Data Transfers
Efficient Capacity Utilization and Dynamic Data Movement
Windows Server 2012 works in conjunction with modern storage subsystems to deliver an integrated management
view, resulting in efficient data transfers, optimized capacity utilization, and usage threshold notifications.
End-to-end Support for Thin Provisioning
Identification of thinly provisioned virtual disksIndustry leadership for standards based thinly provisioned virtual disk identification
Optimization to minimize storage footprintSpace reclamation occurs both real-time and on a scheduled basisScheduled slab consolidation ensures smallest storage footprintThreshold notifications enable agility and responsiveness
Works automatically with Storage Spaces and other enabled storage subsystems
Understanding Capacity Optimization
Virtual Machine File Deletion
Physical MachineStorage Spaces hosting virtual
machines
Sub-file Deletion
(within the VHD)
Storage SpaceAllocation View
Storage PoolAllocation View
Trim / Unmap
Pool Capacity Reclamation
Typical Data Movement Today (1/2)
Traditional Storage
Subsystem
Virtual
Disk
Virtual
Disk
DATA
Read DataWrite Data
Results
Actual Data Transfer
Typical Data Movement Today (2/2)
Reads and Writes Well understood by applications and programming modelWorks well with OS security model (ACLs)Simple
Avoidable resource consumption when simply moving data around
Consumes CPU cycles and memory on hostsUtilizes both storage and network bandwidthPerformance always constrained by available network bandwidth
Offloaded Data Transfers (1/4)
Storage Subsystem
with ODX Support
Virtual
Disk
Virtual
Disk
Actual Data Transfer
Token
Offload
Read
Token Offload Write with
Token
Results
Offloaded Data Transfers (2/4)
Enables storage subsystems to efficiently move dataHosts transfer a lightweight token representing immutable point-in-time view of data in a specific range
Windows CopyFile APIs transparently attempts ODX before falling back to traditional read-write copy semantics
Enables drag-and-drop in Windows Explorer
Scenarios: Hyper-V storage migration, VM libraries, HD video, bulk data backup
Offloaded Data Transfers (3/4)
Full stack end-to-end integrationODX between local NTFS volumesODX between remote file shares over SMBODX between mounted Virtual Hard Disk filesODX from within a Virtual MachineAny combination of the above
Flexible primitives enables offloaded transfers between virtual disks, subsystems, and datacenters
Offloaded Data Transfers (4/4)
File Server
s
SMB Shares
Storage Subsystem with ODX Support
Actual Data
Movement
Partners Supporting ODX
Windows Server 2012 works in conjunction with modern storage subsystems to deliver an integrated management
view, resulting in efficient data transfers, optimized capacity utilization, and usage threshold notifications.
Ease of storage administration
Storage Management PowerShell with SMI-S integration
Minimizes Op-Ex
Efficient capacity utilization
Thin provisioning integrationMaximizes Existing Hardware Dynamic data
movement Offloaded data transfers
Storage virtualization and resiliency
Storage SpacesMinimizes Cap-Ex
Maximizes Availability
Next-generation scale, availability, and integrity
Resilient File System (ReFS)
Maximized data availability
Modern NTFS CHKDSK
Storage Platform Overview
Benefit Capability Feature
Windows Server 2012 is the most cost-efficient
platform for continuously available and highly scalable data access
Related Content
Related Breakout SessionBuilding a Highly Available Failover Cluster Solution with Windows Server 2012 from the Ground UpThursday, June 28 at 12:00 PM in Forum
Related Breakout SessionArchitecting Private Clouds Using Windows Server 2012Friday, June 29 at 10:15 AM in Elicium 2
Related Breakout SessionWindows Server 2012 Storage for your Private CloudTuesday, June 26 1:30 PM in Forum
Track Resources
Virtualizing Storage for Scale, Resiliency, and Efficiencyhttp://go.microsoft.com/fwlink/?LinkID=254536
How to Configure Clustered Storage Spaces in Windows Server 2012http://go.microsoft.com/fwlink/?LinkID=254538
Storage Spaces FAQhttp://go.microsoft.com/fwlink/?LinkID=254539
Find me later at the Windows Server storage booth in the Technical
Learning Center
SIA, WSV, and VIR Track Resources
DOWNLOAD Windows Server 2012 Release Candidate
microsoft.com/windowsserver
#TE(sessioncode) DOWNLOAD
Microsoft System Center 2012 Evaluation
microsoft.com/systemcenterHands-On Labs
Talk to our Experts at the TLC
Resources
Connect. Share. Discuss.
http://europe.msteched.com
Learning
Microsoft Certification & Training Resources
www.microsoft.com/learning
TechNet
Resources for IT Professionals
http://microsoft.com/technet
Resources for Developers
http://microsoft.com/msdn
Evaluations
http://europe.msteched.com/sessions
Submit your evals online
© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to
be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS
PRESENTATION.
