Georgi Matev Program ManagerMicrosoft Corporationgeorgim@microsoft.com

Efficient Storage Efficient Storage Management Tools in R2Management Tools in R2

AgendaAgendaStorage Management ScopeStorage Management Scope

File Server Resource Manager File Server Resource Manager Capacity managementCapacity management

Policy management Policy management

Quota managementQuota management

Simplifying SAN SolutionsSimplifying SAN SolutionsBringing SANs to SMBs Bringing SANs to SMBs

Partnering Partnering

Storage Manager for SANsStorage Manager for SANsDisk provisioning Disk provisioning

Disk managementDisk management

Q&AQ&A

Storage & File Systems in Storage & File Systems in WindowsWindows

Physical DiskPhysical Disk

VolumeVolume

Files & FoldersFiles & Folders

Network &Network &DistributionDistribution

DFS NamespacesDFS NamespacesDFS ReplicationDFS ReplicationAccess-Based EnumerationAccess-Based Enumeration

File Server File Server ManagementManagement

SAN management SAN management (VDS)(VDS)

Quotas, Policies, Quotas, Policies, and Reportsand Reports

Shadow copies Shadow copies (VSS)(VSS)

Storage Management ScopeStorage Management ScopeComponentComponent Windows ToolWindows ToolAsset ManagementAsset ManagementManage, track and maintain physical (hardware) and logical Manage, track and maintain physical (hardware) and logical (volumes, files, I/O etc) storage information(volumes, files, I/O etc) storage information

• Fibre Channel (FC) Information Tool Fibre Channel (FC) Information Tool • Virtual Disk Service (VDS) Virtual Disk Service (VDS)

Capacity ManagementCapacity ManagementDisk and volume space information Disk and volume space information

• File Services Resource Manager (FSRM)File Services Resource Manager (FSRM)

Charge-BacksCharge-BacksProvides customer billing for storage costsProvides customer billing for storage costs

• Indirect support through Indirect support through FSRMFSRM

Configuration ManagementConfiguration ManagementConfigures physical storage systemsConfigures physical storage systems

• VDSVDS• Storage Manager for SAN Storage Manager for SAN • Storage tracingStorage tracing

Data and Media MigrationData and Media MigrationAllows data movement from different media typesAllows data movement from different media types

• File Server Migration ToolkitFile Server Migration Toolkit

Event ManagementEvent ManagementAdministrator notification of storage problemsAdministrator notification of storage problems

• Microsoft Operations Manager (MOM)*Microsoft Operations Manager (MOM)*• FC Information ToolFC Information Tool

Performance & Availability ManagementPerformance & Availability Management

Application, server, & subsystem informationApplication, server, & subsystem information

• MOM*MOM*

Policy ManagementPolicy ManagementSets and enforces policies for systems and usersSets and enforces policies for systems and users

• FSRM (file screening) FSRM (file screening)

Quota ManagementQuota ManagementManages storage usageManages storage usage

• FSRMFSRM

Media ManagementMedia ManagementProvides information about removable media storageProvides information about removable media storage

----

* Through hardware vendor pack.

File Server Resource Manager File Server Resource Manager (FSRM)(FSRM)

VisionVision

FSRM provides a suite of tools that allows IT FSRM provides a suite of tools that allows IT administrators to understand and control the type administrators to understand and control the type and quantity of data stored on their servers.and quantity of data stored on their servers.

A new Windows storage management component A new Windows storage management component that integrates:that integrates:

Capacity management Capacity management

Policy management Policy management

Quota managementQuota management

FSRM: Capacity ManagementFSRM: Capacity ManagementAdministrator ChallengesAdministrator Challenges

Determining existing storage capacity Determining existing storage capacity usage across the organizationusage across the organization

Determining whether usage effectively Determining whether usage effectively supports organizational goalssupports organizational goals

Defining and implementing storage Defining and implementing storage policies policies

Adjusting the policies as capacity needs Adjusting the policies as capacity needs grow and as organization needs change grow and as organization needs change

FSRM: Capacity ManagementFSRM: Capacity ManagementUser Scenarios and BenefitsUser Scenarios and Benefits

Identify where storage capacity is Identify where storage capacity is used inefficiently used inefficiently

Identify mechanisms to prevent future Identify mechanisms to prevent future capacity misusecapacity misuse

Monitor usage patterns and Monitor usage patterns and utilization levelsutilization levels

FSRM: Capacity ManagementFSRM: Capacity ManagementReporting FunctionalityReporting Functionality

Predefined and configurable storage Predefined and configurable storage capacity reportingcapacity reporting

Predefined reports for ease of usePredefined reports for ease of use

Configurable reports for fine tuning to specific Configurable reports for fine tuning to specific server environmentsserver environments

PredefinedPredefined• Large filesLarge files• Most/least recently usedMost/least recently used• Files by ownerFiles by owner• Files by file groupFiles by file group

• Duplicate filesDuplicate files• Quota usageQuota usage• File screen auditFile screen audit• Export reportExport report

ConfigurableConfigurable • Multiple volumesMultiple volumes• Report filtering parametersReport filtering parameters

• Multiple folders or sharesMultiple folders or shares

FSRM: Capacity ManagementFSRM: Capacity ManagementReporting Functionality (cont’d)Reporting Functionality (cont’d)

Multiple report formats Multiple report formats

Generate reports Generate reports at scheduled intervals (e.g., off-hours) at scheduled intervals (e.g., off-hours)

on-demand (e.g., troubleshooting during on-demand (e.g., troubleshooting during a storage crisis, can trace problem a storage crisis, can trace problem to source)to source)

Save reports locally or send to users via e-Save reports locally or send to users via e-mail mail

Support for clustered configurationsSupport for clustered configurations

FSRM: ReportingFSRM: Reporting

FSRM: Quota Management FSRM: Quota Management Administrator ChallengesAdministrator Challenges

User home directories often grow quickly User home directories often grow quickly causing servers to run out causing servers to run out of spaceof space

Departmental shares can also grow Departmental shares can also grow unexpectedly unexpectedly

Administrators are only aware of storage Administrators are only aware of storage crises when the server is already out of crises when the server is already out of spacespace

FSRM: Quota ManagementFSRM: Quota ManagementUser Scenarios and BenefitsUser Scenarios and Benefits

Control the amount of space used for a Control the amount of space used for a folder or share and limit its impact on folder or share and limit its impact on server utilization server utilization

Monitor disk space usage growth per:Monitor disk space usage growth per:VolumeVolume

FolderFolder

ShareShare

Slow down storage growthSlow down storage growth

FSRM: Quota ManagementFSRM: Quota ManagementWhy not NTFS quotas?Why not NTFS quotas?

NTFS quotas since Windows 2000NTFS quotas since Windows 2000Per volume Per volume

Per user Per user

Based on logical file size Based on logical file size

NTFS quotas lackNTFS quotas lackScoping to a specific directory Scoping to a specific directory

Accounting based on disk size Accounting based on disk size

Rich notification mechanismsRich notification mechanisms

FSRM: Quota Management FSRM: Quota Management Quota FunctionalityQuota Functionality

Quotas limit the size of a directory tree Quotas limit the size of a directory tree or a volumeor a volumeQuota applies to all users files in directoryQuota applies to all users files in directoryLimit can be soft or hard Limit can be soft or hard File system interoperabilityFile system interoperability

Only NTFS volumes are supportedOnly NTFS volumes are supportedUsage is tracked in real time, failing I/Os at Usage is tracked in real time, failing I/Os at hard limithard limitOnly volumes with quota configuration are monitoredOnly volumes with quota configuration are monitoredQuota usage is charged based on disk sizeQuota usage is charged based on disk sizeSupport for special filesSupport for special files

Compressed, sparse, named streams, hard links, Compressed, sparse, named streams, hard links, reparse pointsreparse points

FSRM: Quota ManagementFSRM: Quota ManagementQuota Functionality (cont’d)Quota Functionality (cont’d)

Multiple notification thresholds at configurable Multiple notification thresholds at configurable quota utilization levelsquota utilization levels

E-mail, Event log, Command/Script, ReportE-mail, Event log, Command/Script, Report

Ease of deployment through templatesEase of deployment through templatesAuto apply templatesAuto apply templates

Templates is associated with a parent folderTemplates is associated with a parent folderQuotas are auto created for existing and future child Quotas are auto created for existing and future child foldersfolders

Template tracking Template tracking Quotas keep track of source templateQuotas keep track of source templateTrack differences between quota and template Track differences between quota and template settingssettingsEnables policy driven quota configurationEnables policy driven quota configuration

Self-consistent volume configurationSelf-consistent volume configurationQuota settings travel with volume (SAN, hot-pluggable Quota settings travel with volume (SAN, hot-pluggable disks)disks)Cluster supportCluster support

FSRM: QuotasFSRM: Quotas

FSRM: Policy ManagementFSRM: Policy ManagementAdministrator ChallengesAdministrator Challenges

No easy way to control the type of data No easy way to control the type of data stored on file servers stored on file servers

Unwanted content must be identified Unwanted content must be identified manually manually

FSRM: Policy Management FSRM: Policy Management User Scenarios and BenefitsUser Scenarios and Benefits

Eliminate non-business files and improve Eliminate non-business files and improve storage utilization while reducing storage utilization while reducing management costsmanagement costs

Implement policies to restrict unauthorized Implement policies to restrict unauthorized files in order to limit legal exposurefiles in order to limit legal exposure

Promote a culture of accountability Promote a culture of accountability

FSRM: Policy Management FSRM: Policy Management File Screen FunctionalityFile Screen Functionality

Applies to a folder tree or volumeApplies to a folder tree or volume

Screening rules: Screening rules: Based on file groupsBased on file groups

Apply to all user files in the folder Apply to all user files in the folder

File screening settings can be saved in templateFile screening settings can be saved in template

Passive and active screening supportedPassive and active screening supported

Screening events recorded in audit logScreening events recorded in audit log

Same set of notification as quotas Same set of notification as quotas

FSRM: Policy Management FSRM: Policy Management File Screen Functionality (cont’d)File Screen Functionality (cont’d)

File system interoperabilityFile system interoperabilityOnly NTFS volumes are supported Only NTFS volumes are supported

Usage is tracked in real time Usage is tracked in real time

Only volumes with screening configuration are Only volumes with screening configuration are monitoredmonitored

Screening is based on file name patterns Screening is based on file name patterns (*.mp3, FY04*) (*.mp3, FY04*)

Self-consistent volume configurationSelf-consistent volume configuration

Cluster supportCluster support

FSRM: Policy Management FSRM: Policy Management File screen exceptions for fine-tuningFile screen exceptions for fine-tuning

Screening configurations can be nestedScreening configurations can be nested

Semantics similar to ACL permissions Semantics similar to ACL permissions (subfolders inherit policies)(subfolders inherit policies)

File screen exceptionsFile screen exceptionsExplicitly allow files which match a set of file Explicitly allow files which match a set of file groups to be stored in a folder treegroups to be stored in a folder tree

Usually configured on a subfolder under a Usually configured on a subfolder under a more restrictive screening policy more restrictive screening policy

No notifications are raised when a file matches No notifications are raised when a file matches an allowed file groupan allowed file group

FSRM: File FSRM: File ScreeningScreening

SMfS: SAN Provisioning SMfS: SAN Provisioning Administrator challengesAdministrator challenges

Small-midsize market want SAN benefits, but: Small-midsize market want SAN benefits, but: Existing tools are complex and expensiveExisting tools are complex and expensive

Sophisticated performance monitoring not Sophisticated performance monitoring not required in the SMB market (usually only required in the SMB market (usually only 10-15 servers)10-15 servers)

Hardware support for tens of thousands of Hardware support for tens of thousands of storage devices unnecessarystorage devices unnecessary

Administrators have limited experience with SAN Administrators have limited experience with SAN technologiestechnologies

Want basic functionality enabling the Want basic functionality enabling the administrator to easily share storage among administrator to easily share storage among serversservers

Simplifying SAN Solutions Simplifying SAN Solutions Bringing SANs to SMBsBringing SANs to SMBs

Storage area networks (SANs) provide Storage area networks (SANs) provide many benefits, including centralized, many benefits, including centralized, shared storageshared storage

SAN adoption in SMBs has been low SAN adoption in SMBs has been low because of complexity, expense, and poor because of complexity, expense, and poor solution component interoperabilitysolution component interoperability

Simplifying SAN Solutions Simplifying SAN Solutions Bringing SANs to SMBs (cont’d)Bringing SANs to SMBs (cont’d)

Microsoft is committed to helping to Microsoft is committed to helping to bring SANs to a wider range of bring SANs to a wider range of customers through a number of approaches, customers through a number of approaches, including: including:

iSCSI SANsiSCSI SANs

Enable SAN solutions by using existing IP Enable SAN solutions by using existing IP infrastructure and knowledge baseinfrastructure and knowledge base

VDS Integration VDS Integration

Partner applications are using the VDS Partner applications are using the VDS framework for both iSCSI and Fibre Channel framework for both iSCSI and Fibre Channel simplified simplified SAN solutionsSAN solutions

Simple SANsSimple SANs

Simplifying SAN Solutions Simplifying SAN Solutions iSCSI & Fibre Channel partneringiSCSI & Fibre Channel partnering

Working with iSCSI and Fibre Channel Working with iSCSI and Fibre Channel vendors in all storage categoriesvendors in all storage categories

Building solutions that integrate with VDS, Building solutions that integrate with VDS, VSS, MPIO, iSCSI, StorportVSS, MPIO, iSCSI, Storport

Developing management applications that Developing management applications that make deployment simple and easymake deployment simple and easy

Storage Manager for SANsStorage Manager for SANs(SMfS)(SMfS)

A SAN application:A SAN application:Storage resource provisioning Storage resource provisioning

Disk configuration Disk configuration

SMfS: SAN Provisioning SMfS: SAN Provisioning User scenarios and benefitsUser scenarios and benefits

Offers “just the basics” SAN management Offers “just the basics” SAN management functionality, including: functionality, including:

Device discovery Device discovery

LUN creation LUN creation

Storage allocationStorage allocation

EnablesEnablesShared storage solutionsShared storage solutions

ClusteringClustering

Leverages Virtual Disk Service (VDS) Leverages Virtual Disk Service (VDS) infrastructureinfrastructure

Allows Windows administrators Allows Windows administrators to perform basic array and LUN to perform basic array and LUN management management

Target audience: small-scale SANs built Target audience: small-scale SANs built from simplified hardwarefrom simplified hardware

SMfS is a MMC snap-inSMfS is a MMC snap-in

Storage Manager for SANsStorage Manager for SANsBasicsBasics

Storage Manager for SANsStorage Manager for SANsFeaturesFeatures

Configure all SAN storage in one UIConfigure all SAN storage in one UI

Focus on simplicityFocus on simplicityAuto-discover subsystems (arrays)Auto-discover subsystems (arrays)

Auto-discover servers on SAN (no 16-digit hex #s)Auto-discover servers on SAN (no 16-digit hex #s)

Simple wizard to provision storageSimple wizard to provision storage

Reduce complexity via easy tasksReduce complexity via easy tasksGrow volumes and underlying LUNsGrow volumes and underlying LUNs

Move storage from server to serverMove storage from server to server

Configure iSCSI securityConfigure iSCSI security

Link with local storage managementLink with local storage management

Storage Manager for SANsStorage Manager for SANsVirtual Disk Service 1.1Virtual Disk Service 1.1

Interface for storage management Interface for storage management (Windows Server 2003)(Windows Server 2003)

Local storage (volume management)Local storage (volume management)

External (SAN) storage via “hardware External (SAN) storage via “hardware providers” from hardware vendorsproviders” from hardware vendors

VDS 1.1 (post-SP1 Hotfix) adds support for VDS 1.1 (post-SP1 Hotfix) adds support for MPIO and iSCSIMPIO and iSCSI

New WHQL logo programNew WHQL logo program

Ties in with Simple SAN programTies in with Simple SAN program

Storage Manager for SANsStorage Manager for SANsTechnical detailsTechnical details

Leverages VDS API to Leverages VDS API to manage storage manage storage (hardware providers)(hardware providers)

Fibre ChannelFibre Channel

iSCSIiSCSI

““PCI” RAID (DAS)PCI” RAID (DAS)

Also iSCSI and HBA Also iSCSI and HBA API connectivity and API connectivity and MPIO for path MPIO for path managementmanagement

Storage Managerfor SANs

VDS

iSCSI MPIO

HBAAPI

ProviderProvider

Storage Hardware

(managed via VDS)

Storage Manager Storage Manager for SANsfor SANs

© 2004 Microsoft Corporation. All rights reserved.© 2004 Microsoft Corporation. All rights reserved.This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.

Thank YouThank YouQuestions?Questions?

ResourcesResources

Windows Storage: http://www.microsoft.com/windowsserversystem/storage/default.mspx

Windows Server 2003 R2 Customer Preview Program: http://www.microsoft.com/windowsserver2003/r2/default.mspx

Direct questions and comments to: georgim@microsoft.com