SharePoint Online PerformancePatrick Guimonet

Serge Luca

Hi I’m Serge Luca !

Brussels, Belgiumhttp://

www.shareql.com 8 x SharePoint MVP

Works with SharePoint since

2002 @sergelucahttps://sergeluca. wordpress.com

Hi I’m Patrick Guimonet !

Paris, France http://abalon.fr5 x SharePoint MVP2 x Office 365 MVP

Microsoft Regional Director @patricg

https://yos365. wordpress.com

Agenda• Part 1 – From End User to SharePoint Online

• Get technical understanding on how you access data and services in Office 365.

• Be able to use the first level tools to get some metrics on your access.

• Know how to investigate further

• Part 2 – Within SharePoint Online

• SharePoint Online Performance

• How to diagnostic

• What is causing perf issues in SharePoint Online (top 5)

Understanding the way to your data…

Microsoft perspectiveSource: MVA Course – Office 365 Performance management

Internet Service

providers networks

Access to Office 365, from a customer perspectiveServerworkloads

Rich clientapplications

Content delivery network (CDN)

Microsoft network + edge nodes peering and routing

Customer Internal network

Internet egress point

PublicDNS

Office 365

endpoint

Growing networks to cloud-scale

FY09 FY10 FY11 FY12 FY13 FY14 FY15

Network Device Count Growth

10x Growth

Geo-Redundant Service/Application Design

• All nodes active, all nodesstateless

Top 3 Most Connected Networks in the World

• Peer in more than 23 countries with over 2000 ISP’s globally

DC-to-Internet Backbone• Multiple Terabits, • Over 50 Points of Presence globally• Global backbone connecting MS Datacenter to the

Internet

DC-to-DC Backbone• Multiple Terabits of Capacity• Dark fiber based DC-DC backbone to enable high

bandwidth between Datacenters

Dark Fiber• Tens of thousands of Route Miles of owned Dark

Fiber Backbone• Million+ 10G DWDM Route Miles of capacity

deployed

Cache Node • Hosting Services collocated at User location (metro)

Edge Nodes• Multiple Terabits of Edge Interconnect capacity• Directly connected to more than 2000 networks

with over 4,000 connections

Decoupled DCs • Separation of CPU’s Storage, SQL Services

IT Capacity Unit = STAMP • DC Capacity Unit or Workload Appliance

Microsoft

Rule 1: The power of the backbone!

Demo 1: Data transfer between Azure and Office 365

Direct versus Azure upload (6 MB)

• From my PC in Stockholm to an EMEA tenant

• From an Azure VM in the North Europe region

5 s to 7 s to 4 s

Direct versus Azure upload (10 MB)

• From my PC in Stockholm to an EMEA tenant

• From an Azure VM in the North Europe region

5 s to 14 s to 5 s

Direct versus Azure upload (42 MB)

• From my PC in Stockholm to an EMEA tenant

• From an Azure VM in the EMEA region

5 s to 51 s to 16 s

Rule 2: Know your Office 365 Datacenter and the fastest way to it

• http://azurespeedtest.azurewebsites.net/ • http://www.azurespeed.com/• Test which Microsoft Datacenters are the

closest to you

ping <your name>.sharepoint.compsping -n 20 <your name>.sharepoint.com:443 tracert -4 <your name>.sharepoint.com

Microsoft’s global datacenter footprint Microsoft’s network is one of the three largest in the world

1 million+ servers • 100+ Datacenters in over 40 countries • 1,500 network agreements and 50 Internet connections

SAN ANTONIO

CHEYENNE

QUINCYDES MOINES

CHICAGO

BOYDTON

BRAZIL

DUBLIN

AMSTERDAM

INDIA

BEIJING

SHANGHAI

JAPAN

HONG KONG

SINGAPORE

AUSTRALIA

*Operated by 21Vianet

AUSTRIA

FINLAND

BRK 2161

From a legal perspective…

http://www.microsoft.com/online/legal/v2/en-us/MOS_PTC_Geo_Boundaries.htm

Office 365 Microsoft Edge is live in 30 locations

http://www.priasoft.com/solutions/office_365_endpoint_testing_tool/

BRK 2161

Internet Network peering locations

Site data is published at http://www.peeringdb.com/view.php?asn=8075

Some cities have multiple peering points

Peering locations may be on-net or off-net

Peering may involve physical connection and/or routing advertisements

Data as of July 2014 is subject to change

Brisbane AustraliaMelbourne AustraliaPerth AustraliaSydney AustraliaVienna AustriaLuxembourg LuxembourgSao Paulo BrazilMontreal CanadaToronto CanadaPrague CzechoslovakiaParis FranceFrankfurt GermanyHong Kong Hong KongDublin IrelandMilan ItalyTurin ItalyTokyo JapanSeoul Korea

Kuala Lumpur MalaysiaAmsterdam NetherlandsAuckland New ZealandWellington New ZealandMoscow RussiaSingapore SingaporeStockholm SwedenZurich SwitzerlandTaipei TaiwanLondon UKAshburn USAAtlanta USABoston USAChicago USADallas USADenver USAHonolulu USALas Vegas USA

Los Angeles USAMiami USANew York USAPalo Alto USASan Jose USASeattle USA

BRK 2161

Azure CDN This topic lists current Microsoft Azure CDN point of presence (POP) locations.

https://azure.microsoft.com/en-us/documentation/articles/cdn-pop-locations/

Demo 2: Measure RTT to Office 365

Measure Internal and External RTT (TCP Ping here)

Source: How to measure the Network Round Trip Time to Office 365 by Paul Collinge

Internal should be less than 100 ms, ideally 50 msEMEA to EMEA should be less than 150 ms

Outlook in cached mode can cope well with worse RTTBut for SharePoint 350 to 400 ms is the tipping between good and bad performances

aka Edge or Egress point

Client connectivity to Office 365

From support.office.com/en-us/article/Client-connectivity...

The SharePoint wayThe Exchange way

Rule 3: Check REORGANIZED TOP 10 tips for optimising and troubleshooting Office 365 Network Connectivity

• 6. TCP Window Scaling• 7. TCP Idle time settings• 8. TCP Max Segment size

(Should be >= 1300)

• 9. Selective Acknowledgement

• 10. Application Level troubleshooting

• 1. Latency/Round Trip Time (RTT)

• 2. DNS Geo location• 3. DNS performance

• 4. Proxy Scalability• 5. Proxy Authentication

Top 10 tips for optimizing and troubleshooting your Office 365 network connectivity by Paul Collinge

Demo 3: Perform network diagnostics with Microsoft Office 365 Client Performance Analyzer (OCPA)

OPCA from Stockholmsmässan Wifi

Microsoft Network

OPCA from a North Europe based VM

France - Near Paris - @HomeFrance - Nantes - Wifi Hotel

France - Nantes - 4GSpain - Barcelona - Wifi Conf

Canada - Montréal - MS Office WifiCanada - Vancouver - Hotel Wifi

US - Bellevue - Hotel WifiUS - Redmond - MS Open Wifi

Sweden - Stockholm - WifiAzure VM - Europe North

Azure VM - US West

0 5 10 15 20 25

Network HOPS to Office 365 Should be <= 25

Some OPCA results (1/2)DNS Résolution Time Network HOPS to Office 365 Network Latency ( HTTP Ping) to Office 365 Http latency to CDN Client download bandwith (Kbps)

Should be <= 25 <= 25 <=1000 <=1000 >= 1024France - Near Paris - @Home 3 15 222 76 19476France - Nantes - Wifi Hotel 185 17 323 125 1983France - Nantes - 4G 11 19 613 332 15903Spain - Barcelona - Wifi Conf 57 16 388 196 590Canada - Montréal - MS Office Wifi 454 20 588 321 788Canada - Vancouver - Hotel Wifi 2 16 647 118 33456US - Bellevue - Hotel Wifi 303 14 694 173 8529US - Redmond - MS Open Wifi 110 16 705 76 56567Sweden - Stockholm - Wifi 2 13 454 46 10199Azure VM - Europe North 25 9 69 5 81331Azure VM - US West 201NAN 638 17 125982

Some OPCA results (2/2)

DNS Résolution Time to my european tenantShould be <= 25

France - Near Paris - @Home

France - Nantes - Wifi Hotel

France - Nantes - 4G

Spain - Barcelona - Wifi Conf

Canada - Montréal - MS Office Wifi

Canada - Vancouver - Hotel Wifi

US - Bellevue - Hotel Wifi

US - Redmond - MS Open Wifi

Sweden - Stockholm - Wifi

Azure VM - Europe North

Azure VM - US West

0 50 100 150 200 250 300 350 400 450 500

DNS Résolution Time to my european tenantShould be <= 25

France - Near Paris - @HomeFrance - Nantes - Wifi Hotel

France - Nantes - 4GSpain - Barcelona - Wifi Conf

Canada - Montréal - MS Office WifiCanada - Vancouver - Hotel Wifi

US - Bellevue - Hotel WifiUS - Redmond - MS Open Wifi

Sweden - Stockholm - WifiAzure VM - Europe North

Azure VM - US West

0 20000 40000 60000 80000 100000 120000 140000

Client download bandwith (Kbps)

1.2) Master the tools• IP standard tools:• Ping, traceroute, nslookup, …• PSPing is better

• Dedicated tools:• Office 365 Client Performance

Analyzer• AzureSpeedTest • Fast Track Network Analysis (EMEA)

(need java)

• Network capture tools• Netmon 3.4 is the last version.• Message Analyzer is the

replacement for Network Monitor• WireShark, TCPDump, …

• Application level tools• HTTPWatch• Fiddler• IE and Edge F12• Chrome DevTools

Rule 4: If you should use only one tool, use OPCA

DNS Résolution Time to my european tenantShould be <= 25

Quick summary of IT Pro job

Use the fastest way to the backbone

First check with OPCA

Investigate with other tools

Microsoft Best Practices

And in SharePoint Online ?

SPRequestDuration X-SharePointHealthScore

Use F12

Check the following SharePoint Http Response Headers :

Check Files load time

Create an OOB Site Collection as a baseline

SPRequestDuration

How much work the server is doing to serve the page

X-SharePointHealthScore

Health of the server that your SharePoint instance is running on.

0 = more healthy10 = less healthy

Demo 4

F12 + SharePoint Http performance Headers

Top 5 performance issues

Top 1Navigatio

n

Structural Navigation

Managed Navigation

Search based Navigation

Navigation

Structural Managed Search based

-Slower +Faster +The fastest

++Easy to configure +Easy to maintain -Requires Customization of the master page

+Security trimmed -Not security trimmed +Security trimmed

+Automatically updated -Not automatically updated +Automatically updated

-depends on cache -Cannot be ordered

+can cache navigation in client storage

Demo 5

Navigation & Performance

Top 5 performance causes

Top 1Navigation

Top 2Content Rollup

Content RollupFrom Slow to Fast

Content By Query web partContent By Search web partStatic content

Content By Search web part Tip :Use the Group caching option

Refreshes every 15 minutesOnly AD groups

Content By Search Web Part Group Caching Option

A fast alternative is to use static contentIf content seldom changesCommon Links, depts,…

Demo 6

Content Rollup & Performance

Top 5 performance issues

Top 1Navigation

Top 2Content Rollup

Top 3Large Files

Larges FilesJavascript

• CDN• Minifying

Videos

• Office 365 Video Portal (Azure Media Services)

Pictures

• Picture Lazy loading

• Sprites• Image

Rendition

Image Lazy loading : how to

Images : spritescomposite image that contains many smaller images

ex: spcommon.png (in …layouts/15/images/spcommon.png)

Benefit : downloads only 1 picture and caches it

Use CSS to display on a particular parthttps://css-tricks.com/css-sprites/

Image rendition1 (big) image stored in SharePoint

Several variations are renderedSharePoint automatically sizes the imageYou can also crop

Super important for mobilesDon’t have to visually resize the pictureThe server sends the smaller version

Demo 7

Images Rendition

Top 5 performance issues

Top 1Navigation

Top 2Content Rollup

Top 3Large Files

Top 4Many

Requests to Server

Top 5 performance issues

Top 1Navigation

Top 2Content Rollup

Top 3Large Files

Top 4Many

Requests to Server

Top 5

A lot of Web Parts

Front end Caching in SPO :a huge problem for MS

Use Azure Redis CacheUse the Azure Redis cache

Ex to store session state data like to SharePoint contextBy default the SharePointContext class requires ASP.Net session state

In Proc mode ->not ok if several ASP.Net servers

More details here http://tinyurl.com/osst9xj

SPO does user throttling• Limits number of concurrent calls

99% throttling : custom code• Error 429 (« Too many requests »)• Error 503 (« service not available »)

O365 Migration API (Preview)

Throttling Pattern• Reduce number operation /request• Reduce number of Requests• Incremental Back Off

O365 PnP Throttling pattern(incremental backoff)

Predictive capacity:forecastingForecasts are

for groups of farms in a zone

Time

Requ

ests

Requests in zone

Requests per farm

Predictive capacity: managing farms

0

10

20

30

40

50

60

70

80

90

100

Average front end CPU load

% C

PU

Monday Tuesday Wednesday Thursday Friday

0% to 40 % - Operating zone

40% to 85 % - Buffer

85 to 100 % - Danger Zone

Front ends in content farms run at 40% CPU

As load increases, weadd capacity

Solution : rollout to all users in waves

Don’t do performance testings in SPO

You will be throttled

Thank You ! Questions ?

DocumentationSupport.office.comNetwork planning and performance tuning for Office 365

On MSDNNetwork planning and performance tuning for Office 365

Sources (Part 1)• MVA Course – Office 365 Perfor

mance management

• Office 365 Client Performance Analyzer• Microsoft Azure Speed Test

• Top 10 Tips for Optimising & Troubleshooting your Office 365 Network Connectivity from Paul Collinge• MS Ignite 2015 – BRK4121 - Offic

e 365 Network Performance Troubleshooting