SharePoint Customer Presentation

1© Copyright 2012 EMC Corporation. All rights reserved.

SharePoint Customer

Presentation

September 05, 2012Stefan Voss

Sr. Manager, USD Solutions Engineering


Relentless Growth of Unstructured DataPeople / Business Processes:

1. Disconnected information silos2. Information not available to those who

need it in real-time3. Governance

IT Related:

4. TCO / Asset Utilization 5. Backup Windows / Recovery Processes6. Version Control, user mapping,

permissions

Source : IDC, The Digital Universe Decade


Why SharePoint? Why Now? Why VNX? Why SharePoint?

– Fastest growing platform in MSFT’s history– Accessible and extensible unified content

platform– $2B in 2011, 20,000 seats/DAY!

Why now?– New release (Wave 15) coming in November– 67% of customers report rolling out

SharePoint to the entire organization

Why EMC VNX and Metalogix?– Unified infrastructure for metadata and BLOBs– FAST Suite for performance & efficiency – Metalogix suite for file share consolidation and

flexible end point management

Gartner Magic Quadrant for Enterprise Content Management


EMC / Metalogix Solution

Legacy ECM

File Shares

Future content growth

Today Centralize & Take Control Consolidate & Optimize

5%

95%BLOBs

Metadata


Metalogix StoragePoint Librarian Contoso

FinanceAP

ARHR

EmployeesTraining MaterialsHandbooks and Policies

InvoicesPurchase Orders

File Share LibrarianContent stored on file

system.

ContosoFinance

AP

ARHR

EmployeesTraining MaterialsHandbooks and Policies

InvoicesPurchase Orders

SQL Content DB

List Items and

MetadataContent stays on file share

StoragePoint CatalogsFile share

StoragePoint Creates

SharePoint Structure and Items


The Challenge with SharePoint BLOBs

10 x 100GB SharePoint Content Databases

1TB of SQL Content Database Storage

PPTPDF

XLSDOC TIFF

90-95% unstructured, rest metadata

“Typically, as much as 80 percent of data for an enterprise-scale deployment of SharePoint Foundation consists of file-based data streams that are stored as BLOB data. These BLOB objects comprise data associated with SharePoint files. However, maintaining large quantities of BLOB data in a SQL Server database is a suboptimal use of SQL Server resources. You can achieve equal benefit at lower cost with equivalent efficiency by using an external data store to contain BLOB data.”

Source: http://msdn.microsoft.com/en-us/library/bb802976.aspx

• Can’t easily or economically scale

• Asset Utilization SQL Servers

• BLOBs don’t benefit from SQL query engine. Why are they there?

• Long backups / long restores

• Lack of tiered storage = Poor TCO

http://msdn.microsoft.com/en-us/library/bb802976.aspx

http://msdn.microsoft.com/en-us/library/bb802976.aspx


StoragePoint RBS End-Point Mgmt

VNX/SAS VNX/NL-SAS Isilon

Active Near-active Archive

Storag

ePoint

Aging Rule move

s

BLOB fro

m Tier 1

to Tie

r 2

at Invo

ice Date

+ 1 year

Storag

ePoint

Aging Rule move

s

BLOB fro

m Tier 2

to Tie

r 3

at In

voice

Date + 3 ye

ars

Less significant content becomes less-expensive to store

Metada

ta

BLOB

CloudArchive

Storag

ePoint

Aging Rule

moves

BLOB fro

m Tier 3

to Clou

d

at Invo

ice Date

+ 5 years


StoragePoint RBS Advanced Filters

Storage Profile

FileSystem (Sync)Filter: File Type = PDF, TIF, TIFF

Share1

FileSystem (Sync)Filter: List = HR DOCS

Share2

FileSystem (Sync)Filter: Site (Web) = Finance

BLOB Store 3


EMC / Metalogix Reference Architecture

Metadata5-10%

BLOBs90-95%

FC Network

CIFS Network

Share NL SAS

Share SAS

Share Deep Compressed

SQL Search DB

StoragePoint Rule moves BLOB from Tier 1 to Tier 2 At Invoice Date + 6 months

StoragePoint Rule moves BLOB from Tier 2 to Tier 3 At Invoice Date + 1 year

VNX FAST Cache enables faster indexing/crawl/search

Reference Architecture: http://www.emc.com/collateral/hardware/technical-documentation/h8185-sharepoint-vnx-metalogix-psg.pdf

• Flash 1st 75% Cost Reduction via VNX FAST and smart use of SSDs and NL-SAS

• FAST Cache Up to 90% Performance Improvement for Search

• FAST VP 80% less performance tuning for SQL

• Lower SQL Licensing Costs due to server virtualization and RBS

tempDBSearch Query

VNX FAST VP to reduce performance tuning

http://www.emc.com/collateral/hardware/technical-documentation/h8185-sharepoint-vnx-metalogix-psg.pdf






Flexible Endpoint Management - USD

Metadata FC Network

CIFS Network

Share FLR

Share NL SAS

LUNFAST Cache

Use Advanced Filters to move HR data to where retention /

compliance is ensured

Encrypt sensitive data before it is moved to storage endpoint

(up to 256-bit)

LUNFAST VP

• Set retention periods at file system creation • Default/minimum/maximum

• Automatic File Lock and Delete

VNX File Level Retention:

Archive / Big Data

Active Data


Virtualizing SharePoint is Essential Consolidation

• Achieve 2-10x consolidation ratio, especially for larger deploymentsPerformance

• Improved front end performance with more, smaller WFEs rather than few large WFEs

Availability• VM based protection for SharePoint provides homogeneous high availability (WSFC, VMware HA)

Business Continuity• Simplified DR management (Geo-Clustering, vCenter Site Recovery Manager)

Maintenance• Live migration of virtual machines (Hyper-V Live Migration, VMware vMotion)

Load Balancing• Maximized overall performance with balanced cross farm HW utilization (SCVMM PRO , VMware DRS)


Three Sources of Savings and Efficiency 1. Better Asset Utilization

– File Share typically not well utilized – VNX Utilization ~70% on SAS / NL-SAS and up to 90% on SSD

2. More Efficiency via Flash 1st – Results in fewer drives, lower energy bills, and lower $/GB– Also lower $/IOPS via FAST Suite

3. Lower SQL licensing via RBS and virtualization– Reduce database size and increase VM density per physical

server


Lower $/GB and $ / IOPS

Average

$/GB SAS–15K$2/GB

LOWEST

$/IO SSD$.99/IO

Metadata5-10%

BLOBs90-95%M

etal

ogix

Stor

ageP

oint

Example:• Avg. Capacity VNX5300 = 50TB• Without RBS on SAS-15K: $100K• With RBS and 5% SSD and 95% NL-SAS: $40-50K

LOWEST

$/GB NL-SAS$.43/GB

No RBS With RBS


VNX FAST Cache boosts SQL2012Data Disk RAID FC

OLTP DB Files

600K SAS 5 ON

System DB 600K SAS 5 OFF

TempDBs 600K SAS 1/0 OFF

DB Logs 600K SAS 1/0 OFF

FAST Cache: 14 x 100GB SSDsWorking Set < FAST Cache

Results:• 5x Improvement of IOPS and TPS• 30 Minute Cache Warming

IOPS

TPS


Lower SQL Licensing Costs SQL Server is rarely CPU constrained

– For SharePoint the performance bottleneck tends to be the WFE

– Idle CPU = Wasted licensing $$ SQL2012 Server Enterprise

Licensing:– Physical: per physical core – Virtual: per vCPU (all you can eat

per physical core)– No cost difference between a

physical core and vCPU

Virtualization = greater VM density and lower SQL licensing costs

– Savings determined by vCPU : Core Ratio (e.g. 4:1 ratio =75% savings)

RBS leads to smaller databases – Fewer servers overall with fewer

cores / vCPUs to license Have to weigh against performance /

CPU utilization– Perfmon and other tools to help

determine the right mix


Results• Average page load time improved by 4x after RBS • Backup times from SQL and SharePoint reduced by a

factor of 13x• >90% moved from expensive SQL drives to NL-SAS

Challenge• Internally facing communications site, which included

large amounts of rapidly changing large objects• Page load times and backup / recovery times

Large Government Contractor EMC VNX and Metalogix StoragePoint Improves Operational Agility and Performance

“The dashboard reports showed that I was now saving >90% of my storage on the expensive SQL drives.”

Derek MartinCloud Solutions Architect


Recovery Options• All depends on the recovery objectives!

– Database, Database + BLOBs, Database + BLOBs + Farm– Local vs. Remote– Granularity

• Methods Used:– Native Microsoft tools including log shipping – Third-party backup products (e.g. Avamar)– Array-based replication (snapshots/clones)

• Issues with common approach aka native tools– Long and manual restore process (hours to days)

• Two options that are RBS aware are Metalogix Selective Restore Manager and EMC Replication Manager / VNX Snaps

– Reduce restore times down from hours to minutes – Item-level restore– Proper sequence of backup and recovery must be followed


Provisioning SharePoint - ESI Open / browse local or remote

SharePoint farm Provision SharePoint Web

Application:– Create disks– Create content database– Create Web Application – Attach the content database

Create content database only (no WFE)

– Web Application can be created later using SharePoint admin and the database created in ESI

Users can select any SQL server that is part of the farm and any instance in

that server.

leave unchecked


Health Monitoring in the Private CloudEMC System Center Operations Manager (SCOM) Management Packs:

• Array discovery & health monitoring

• Full hierarchical storage schema and relationship view

• Dashboards incl. physical view (SPs, DAEs, NICs, HBAs, Drives) and logical view (RAID Groups, Volumes/Pools, LUNs, Protocols…)

• Performance Monitoring• End to end application service

view• Map / visualize relationships

between storage and SharePoint farm

EMC System Center Orchestrator (SCO) Management Packs:

• Focal point for automation of heterogeneous datacenter management

• Service Manager for workflows and pre-defined run books• 21 storage activities and

counting• Example Drive failure:

1. Gather SP Collects 2. Post on pre-defined share 3. Send alerts to admin


RBS Options & Feature ComparisonFeature RBS FILESTREAM StoragePoint SourceOne AvePoint

Catalogue Files into native SharePoint ribbon X √ X XBLOB Externalization (RBS) √ √ √* √

Offload BLOBs to remote storage platforms X

√ √ √BLOB store must be local to SQL Server

Outbound BLOB cache for off-premises (i.e. Cloud) operations X √ X X

Define multiple storage endpoints per content database X √ √ √

Filter endpoints by file type or scope (i.e. list or content type) X √ X XTake endpoints offline (and/or send notifications) if they fill up or enter an error state X √ √ X

Use SharePoint filename or folder on offloaded BLOBs X √ X XPromote SharePoint properties to endpoint X √ X XSecurely delete (shred) BLOBs X √ X XReport and Health Monitor Dashboard X √ √ XAdministration User Interface X √ √ √Central Admin PowerShell Support X √ √Compression X √ X X

Encryption X√

X XTransmission and "at rest"

Tiered Storage (HSM) support X √ X XOrphaned BLOB Garbage Collection √ √√ √ √

Basic Policy-based Basic


Storage Admin Database Admin SharePoint AdminLog into UniSphere 5mCreate Data LUN – 100GB 3mCreate Log LUN – 10GB 3mAdd LUNs to Storage Group 3m

14m 14mRescan Storage in Device Manager 5mRescan Disks in Disk Management 5mIdentify correct Physical disks to LUNs 10m

Create partitions, format @ 64kb blocks 5m

Mount drive letters 2mCreate Database in correct place/collation 10m

Pre-grow Data file and log file 5m56m

56mConnect to Central Admin 5mCreate Web Application (if required – typically not)

10m

Manage Content DBs 5mCreate Content Database in SP, pointing to new SQL DB

10m

86m

86 min

EMC Storage IntegratorOpen SharePoint Farm 0.5mEnumerate Farm and associated storage 3mStart ESI SharePoint Provisioning wizard; Provide input 4m

Create and Prepare Data LUN/Disk – 100 GB 2mCreate and Prepare Log LUN/Disk – 10GB 2mCreate Content Database ( 15M initial Size) 0.5mPre-grow Data file and log file 5mCreate Web Application 2m

Refresh Farm 1m20m

20 min

Remember, this traditional approach requires three Administrators, who may work in different departments. So there is a cross-department dependency, which would have an associated lead time.

http://www.iconarchive.com/show/people-icons-by-aha-soft/boss-icon.html

http://www.iconarchive.com/show/people-icons-by-aha-soft/engineer-icon.html



Documents

SharePoint Customer Presentation