Nutanix 24,000-Mailbox Virtualized Exchange Server 2013 Mailbox

2

Nutanix 24,000-Mailbox Virtualized Exchange Server 2013 Mailbox Resiliency Storage Solution Tested with ESRP Storage Version 4.0 Test date: June 2015

2

Table of Contents !1 Overview ................................................................................................................................... 3

2 Solution Description ............................................................................................................ 5 2.1 Targeted Customer Profile ...................................................................................................... 7 2.2 Tested Deployment ................................................................................................................... 7

2.2.1 Simulated Exchange Configuration: ............................................................................. 7 2.2.2 Storage Hardware ................................................................................................................ 8 2.2.3 Storage Software ................................................................................................................. 9 2.2.4 Storage Disk Configuration (Mailbox Store Disks. Transactional Log Disks Utilizing Same Disks as Mailbox Store Database) ................................................................ 9

3 Best Practices ........................................................................................................................ 11 3.1 Backup Strategy .......................................................................................................................... 11

4 Contact for Additional Information ............................................................................. 13

5 Test Result Summary ........................................................................................................ 14 5.1 Reliability ...................................................................................................................................... 14 5.2 Storage Performance Results .............................................................................................. 14 5.3 Database Backup/Recovery Performance ...................................................................... 16

5.3.1 Database Read-only Performance ............................................................................... 16 5.3.2 Transaction Log Recovery/Replay Performance ................................................... 16

6 Conclusion ............................................................................................................................. 17

7 Appendix A - Test Results ............................................................................................... 18 7.1 24-Hour Stress/Reliability Test Results ............................................................................ 19 7.2 2-Hour Performance Test Results ...................................................................................... 24 7.3 Database Backup Test Results ............................................................................................ 28 7.4 Soft Recovery Test Results .................................................................................................. 30

3

1 Overview

This document provides information on Nutanix's solution for Microsoft Exchange Server 2013, based the Microsoft Exchange Solution Reviewed Program (ESRP) – Storage program*. For any questions or comments regarding the contents of this document, see http://technet.microsoft.com/en-us/exchange/ff182054.aspx.

*The ESRP – Storage program was developed by Microsoft Corporation to provide a common storage testing framework for vendors to provide information on its storage solutions for Microsoft Exchange Server software. For more details on the Microsoft ESRP – Storage program, please click http://technet.microsoft.com/en-us/exchange/ff182054.aspx.

Disclaimer

This document has been produced independently of Microsoft Corporation. Microsoft Corporation expressly disclaims responsibility for, and makes no warranty, express or implied, with respect to, the accuracy of the contents of this document.

The information contained in this document represents the current view of Nutanix on the issues discussed as of the date of publication. Due to changing market conditions, it should not be interpreted to be a commitment on the part of Nutanix, and Nutanix cannot guarantee the accuracy of any information presented after the date of publication.

Features

This solution describes the results from the testing of a 24,000-mailbox Exchange Server 2013 mailbox resiliency data availability group (DAG) with two database copies running on two Nutanix hyper-converged 4-node NX-8150 clusters.

The performance results and best practices outlined in this document provide tested guidelines for configuring Exchange 2013 with one DAG with two copies. The performance results outlined in this paper are from the testing of a single Nutanix cluster at the primary site. See the section Test results summary for more information.

About Nutanix

Nutanix is the leader in hyper-converged infrastructure, natively converging compute and storage with a scale-out, 100% software-based approach to run any application, at any scale. Nutanix web-scale solutions eliminate the cost and complexity of standalone SAN and NAS, while delivering enterprise-class features and availability with predictable performance at 40% to 60% lower overall TCO. Organizations of all sizes rely on Nutanix to simplify their infrastructure for virtualized desktops, enterprise applications such as tier-1 databases, Microsoft Exchange, private cloud,

4

big data and more. Learn more at www.nutanix.com or follow up on Twitter @nutanix.

Nutanix Hyper-Converged Infrastructure

The Nutanix hyper-converged infrastructure is an enterprise solution for virtualization and cloud environments. It brings together the predictable benefits and economics of web-scale architectures from companies including Google, Facebook, and Amazon to the enterprise using the Nutanix Distributed File System (NDFS).

Nutanix integrates multiple high-performance compute resources with enterprise-class SSD and HDD storage controlled by the 100% software based Nutanix Controller VM (CVM) in cost-effective appliances. It removes the need for network-based storage, such as a storage area network (SAN) or network-attached storage (NAS).

The Nutanix CVM runs as a virtual machine on Microsoft Windows Server 2012 R2 and consolidates and controls storage across the entire system. It serves all the storage IO operations for Hyper-V host and all the virtual machines running on the host over SMB3. The storage is managed by Nutanix Distributed File System (NDFS). The VM-centric NDFS ensures storage is accessible from all the hosts in system and provides advanced data management features. It also brings data closer to virtual machines by storing the data locally on the system, resulting in higher performance at a lower cost.

Nutanix hyper-converged infrastructure can horizontally scale from as few as three nodes to a large number of nodes. Each Nutanix building block or node is based on industry-standard and high performing x86 server technology, and delivers a unified, scale out, shared-nothing architecture with no single point of failure (SPOF). Nutanix systems including one using for the ESRP submission can be scaled without downtime by simply adding additional Nutanix nodes. The additional compute and storage are automatically added to the virtualization and storage pools; no additional configuration or tuning is needed.

Nutanix customers realize substantial benefits from their hyper-converged infrastructure, including:

o 40 to 60% lower costs, which includes as much as 90% reduction in OPEX

o Up to 90% reduction in datacenter footprint and power/cooling requirements

o 8x faster time to deployment from purchase to production and scaling

o Ability to scale compute plus storage in minutes without incurring downtime

5

2 Solution Description The following section describes the hyper-converged NX-8150 based Exchange 2013 mailbox resiliency solution Nutanix implemented to run the ESRP test.

Nutanix NX-8150 4 node cluster with Nutanix OS 4.1.2

o Compute per node: E5-2690v2, 20 cores / 3.0 GHz with 256 GB of RAM

o Raw storage:

o Per node:

! SSD: 3.2 TB (4x 800 GB)

! HDD: 20 TB (20x 1 TB)

o System (4-node per cluster,):

! SSD: 12.8 TB (16x 800 GB)

! HDD: 80 TB (80x 1 TB)

o Networking:

o Per node:

! 2x 10Gbps Ethernet ports with Jumbo Frames

o System (using 4-node):

! 8x 10Gbps Ethernet ports with Jumbo Frames

The Nutanix NX-8150 used in this solution can be found in the Windows Server Catalog: http://www.windowsservercatalog.com/item.aspx?idItem=e7a9314f-808c-5da5-5c7a-b30893d9e9d1&bCatID=1333.

Figure 1 illustrates the high-level topology and DAG architecture of the 24,000-mailbox virtualized Exchange 2013 mailbox resiliency storage solution. The solution is composed of two Nutanix NX-8150 clusters with Windows Server 2012 R2 Hyper-V being the hypervisor. Each cluster is consisting of 4x NX-8150 nodes with 16x 800GB SSDs and 80X 1TB SATA drives. The DAG has 6 Exchange 2013 mailbox servers and two database copies. The two database copies were placed on two physically isolated clusters.

6

Figure 1: High-level architecture of the Nutanix NX-8510 24,000-mailbox Exchange Server 2013 mailbox resiliency storage solution.

For nodes 1-3 on both Cluster A and Cluster B, a mailbox server VM and a set of database volumes were created per node. The MBX server and the set of DB volumes were connected using SMB 3.0. The primary database copy and the secondary database copy were placed on two physically separated and isolated clusters. The two clusters can be located at the same datacenter, or two different datacenters.

The ESRP-Storage program focuses on storage solution testing to address performance and reliability issues with storage design. However, storage is not the only factor to take into consideration when designing a scale up Exchange solution. Other factors which affect the server scalability are: server processor utilization, server physical and virtual memory limitations, resource requirements for other applications, directory and network service latencies, network infrastructure limitations, replication and recovery requirements, and client usage profiles. All these factors are beyond the scope for ESRP-Storage. Therefore, the number of mailboxes hosted per server as part of the tested configuration may not necessarily be viable for some customer deployments.

For more information on identifying and addressing performance bottlenecks in an Exchange system, please refer to Microsoft's Troubleshooting Microsoft Exchange Server Performance, available at http://technet.microsoft.com/en-us/library/dd335215.aspx.

7

2.1 Targeted Customer Profile

This solution is designed for a medium enterprise Exchange environment. The target customer is typically one looking for a scalable, reliable, high-performance and highly available Exchange storage solution. The solution tested is designed for:

o 24,000 mailboxes

o 6 Exchange Servers (3 Tested)

o 0.05 IOPS (0.06 IOPS tested for additional 20% headroom

o 1.0GB per mailbox

o Maintaining ample controller headroom for storage infrastructure activities such as data replication.

o 24/7 background database maintenance

o Mailbox Resiliency (2-copy)

2.2 Tested Deployment

The following tables summarize the testing environment:

2.2.1 Simulated Exchange Configuration:

Number of Exchange mailboxes simulated

24000

Number of Database Availability Groups (DAGs)

1

Number of servers/DAG 6 (3 tested)

Number of active mailboxes/server 4000 (4000 active and 4000 passive mailboxes per server. 8000 active mailboxes/server tested)

Number of databases/host 4

Number of copies/database 2

Number of mailboxes/database 2000

Simulated profile: I/O’s per second per mailbox (IOPS, include 20% headroom)

0.06 IOPs / Mailbox

(0.05 IOPs plus 20% headroom)

Database/Log LUN size 2.14 TB

Total database size for performance 24,000 GB

8

testing

% storage capacity used by Exchange database**

90%

**Storage performance characteristics change based on the percentage utilization of the individual disks. Tests that use a small percentage of the storage (~25%) may exhibit reduced throughput if the storage capacity utilization is significantly increased beyond what is tested in this paper.

2.2.2 Storage Hardware

Storage Connectivity (Fiber Channel, SAS, SATA, iSCSI)

SMB 3

Storage model and OS/firmware revision NX-8150, Nutanix OS 4.1.2

Storage cache 50.6GB per node

Number of storage controllers 4 virtual storage controllers or nodes

Number of storage ports 2 10GbE ports per node

Maximum bandwidth of storage connectivity to host

20Gbps per node

Switch type/model/firmware revision Arista DCS-7150S 10Gb Ethernet, Firmware 4.11.5.1

HBA model and firmware Intel 82599 10Gb Ethernet,

MTU 9000

Number of HBA’s/host 2

Host server type 3x Nutanix NX-8150

(Supermicro X9DRi-LN4+ 20-core Intel Ivy Bridge CPU @ 2.60 GHz etc.)

256GB RAM

Total number of disks tested in solution 96 (4 node cluster)

Maximum number of spindles can be hosted in the storage

96 (Cluster can be scaled to 40+ nodes)

9

2.2.3 Storage Software

HBA driver Hv_netvsc version 3.1

HBA QueueTarget Setting N/A

HBA QueueDepth Setting N/A

Multi-Pathing Microsoft Windows MPIO

Hardware virtualization software Windows Server 2012 R2 Hyper-V

Exchange virtual machine guest OS Windows Server 2012 R2 Standard (version 6.3)

ESE.dll file version 15.00.0516.026

Replication solution name/version N/A

2.2.4 Storage Disk Configuration (Mailbox Store Disks. Transactional Log Disks Utilizing Same Disks as Mailbox Store Database)

Disk type, speed and firmware revision Per node:

4x Intel SSDSC2BA40 800GB – FW 0265

20x ST91000640NS SATA 1TB 7200 RPM – FW SN03

Raw capacity per disk (GB) 967GB

Number of physical disks in test 96

Total raw storage capacity (GB) 92,832GB

Disk slice size (GB) N/A

Number of slices per LUN or number of disks per LUN

N/A

Raid level Nutanix replication factor 2 (RAID 1)

Total formatted capacity 25.68 TB

Storage capacity utilization 28.3%

10

Database capacity utilization 25.5%

11

3 Best Practices Exchange server is a disk-intensive application. Based on the testing run using the ESRP framework, we would recommend the following to improve the storage performance.

For Exchange 2013 best practices on storage design, please visit http://technet.microsoft.com/en-us/library/dd346703.aspx

Nutanix System Best Practices

This solution design follows these best practices:

o The Nutanix cluster is configured in an N+1 manner for node level failover operations.

o Three para-virtual SCSI (pvscsi) connections from theWindows 2012 R@ Hyper-V instance to controller virtual machine (CVM) are utilized.

o The Exchange database and logs are placed in the same vdisk.

o Nutanix replication factor of 2, plus two database copies provides resiliency with four total copies of the Exchange data.

o NTFS file systems formatted at 64KB allocation size.

Deployment Guidelines for Data Replication

http://www.microsoft.com/technet/prodtechnol/exchange/guides/E2k3DataRepl/bedf62a9-dff7-49a8-bd27-b2f1c46d5651.mspx

Multi-site data replication support for Exchange

http://support.microsoft.com/?kbid=895847

3.1 Backup Strategy

Nutanix hyper-converged infrastructure including the NX-8150 employs a hybrid approach to storage, intelligently tiering data to maximize performance and capacity. IT organizations no longer need to rely on secondary storage systems for storing backups or relying on external solutions for tiering. Based on the customer’s recovery point objectives (RPO) and recovery time objectives (RTO) needs, they can choose from a variety of features ranging from snapshot to remote replication to synchronous metro-scale clusters.

The Nutanix solution can take snapshots or point-in-time copies of individual virtual disks and virtual machines. These VM snapshots can be replicated to a remote site

12

for disaster recovery and longer term archiving purpose. This functionality is complementary to Microsoft Exchange Database Available Groups employed for recovery from a local or remote site.

13

4 Contact for Additional Information To learn more about the award-winning Nutanix hyper-converged infrastructure with web-scale technologies or to schedule a personal briefing, please contact us at:

Nutanix, Inc.

1740 Technology Drive,

San Jose, CA 95110

Web: www.nutanix.com

Main: (855) NUTANIX or (408) 216-8300

Email: [email protected]

Twitter: @nutanix

14

5 Test Result Summary This section provides a high level summary of the test data from ESRP and the link to the detailed html reports that are generated by ESRP testing framework. Please click on the underlined headings below to view the html report for each test.

5.1 Reliability

A number of tests in the framework are to check Reliability tests runs for 24 hours. The goal is to verify the storage can handle high IO load for a long period of time. Both log and database files will be analyzed for integrity after the stress test to ensure no database/log corruption.

The following list provides an overview: (click on the underlined word will show the html report after the reliability tests run)

o No errors reported in the saved event log file.

o No errors reported during the database and log checksum processes.

5.2 Storage Performance Results

The Primary Storage performance testing is designed to exercise the storage with maximum sustainable Exchange type of IO for 2 hours. The test is to show how long it takes for the storage to respond to an IO under load. The data below is the sum of all of the logical disk I/O’s and average of all the logical disks I/O latency in the 2 hours test duration. Each server is listed separately and the aggregate numbers across all servers is listed as well.

Individual Server Metrics:

The sum of I/O’s across Storage Groups and the average latency across all Storage Groups on a per server basis.

Database I/O MBX1 MBX2 MBX3

Database Disks Transfers/sec 596.42 563.04 587.98

Database Disks Reads/sec 420.96 397.13 414.69

Database Disks Writes/sec 175.46 165.91 173.29

15

Average Database Disk Read Latency (ms) 12.80 13.27 12.81

Average Database Disk Write Latency (ms) 7.92 9.05 8.35

Transaction Log I/O

Log Disks Writes/sec 122.39 115.90 121.52

Average Log Disk Write Latency (ms) 2.23 2.51 2.26

Aggregate Performance across all servers Metrics:

The sum of I/O’s across the 3 primary servers in solution and the average latency across the 3 servers in solution.

Database I/O

Database Disks Transfers/sec 1747.44

Database Disks Reads/sec 1232.78

Database Disks Writes/sec 514.66

Average Database Disk Read Latency (ms) 12.96

Average Database Disk Write Latency (ms) 8.44

Transaction Log I/O

Log Disks Writes/sec 359.80

Average Log Disk Write Latency (ms) 2.34

16

5.3 Database Backup/Recovery Performance

There are two tests reports in this section. The first one is to measure the sequential read rate of the database files, and the second is to measure the recovery/replay performance (playing transaction logs in to the database).

5.3.1 Database Read-only Performance

The test is to measure the maximum rate at which databases could be backed up via VSS. The following table shows the average rate for a single database file, a single mailbox server, and all of the 3 mailbox servers.

MB read/sec per database 67.19

MB read/sec total per server 268.75

Aggregate MB read/sec from all 3 servers 806.26

5.3.2 Transaction Log Recovery/Replay Performance

The test is to measure the maximum rate at which the log files can be played against the databases. The following table shows the average rate for 500 log files played in a single storage group. Each log file is 1 MB in size.

Average time to play one Log file (sec) 1.60

17

6 Conclusion This document is developed by storage solution providers, and reviewed by Microsoft Exchange Product team. The test results/data presented in this document is based on the tests introduced in the ESRP test framework. Customer should not quote the data directly for his/her pre-deployment verification. It is still necessary to go through the exercises to validate the storage design for a specific customer environment.

ESRP program is not designed to be a benchmarking program; tests are not designed to getting the maximum throughput for a giving solution. Rather, it is focused on producing recommendations from vendors for Exchange application. So the data presented in this document should not be used for direct comparisons among the solutions.

7 Appendix A - Test Results This section includes representative test results from 1 of the 3 primary mailbox servers under test: MBX1. All servers’ test results are comparable to one another.

7.1 24-Hour Stress/Reliability Test Results Stress Test Result Report Test Summary Overall Test Result Pass Machine Name JS1 Test Description Test Start Time 6/1/2015 9:57:00 AM Test End Time 6/2/2015 9:59:11 AM Collection Start Time 6/1/2015 9:59:08 AM Collection End Time 6/2/2015 9:58:57 AM Jetstress Version 15.00.0995.000 ESE Version 15.00.0516.026 Operating System Windows Server 2012 Standard (6.2.9200.0) Performance Log C:\Users\Administrator\Desktop\new\Stress_2015_6_1_9_57_9.blg Database Sizing and Throughput Achieved Transactional I/O per Second 599.799 Target Transactional I/O per Second 480 Initial Database Size (bytes) 8456511946752 Final Database Size (bytes) 8472802623488 Database Files (Count) 4 Jetstress System Parameters Thread Count 12 Minimum Database Cache 128.0 MB Maximum Database Cache 1024.0 MB Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 35% Lazy Commits 70%

Run Background Database Maintenance True Number of Copies per Database 2 Database Configuration Instance2628.1 Log path: E:\logs

Database: E:\Jetstress001001.edb

Instance2628.2 Log path: F:\logs Database: F:\Jetstress002001.edb

Instance2628.3 Log path: G:\logs Database: G:\Jetstress003001.edb

Instance2628.4 Log path: H:\logs Database: H:\Jetstress004001.edb

Transactional I/O Performance MSExchange Database ==> Instances

I/O Database Reads Average Latency (msec)

I/O Database Writes Average Latency (msec)

I/O Database Reads/sec

I/O Database Writes/sec

I/O Database Reads Average Bytes

I/O Database Writes Average Bytes

I/O Log Reads Average Latency (msec)

I/O Log Writes Average Latency (msec)

I/O Log Reads/sec

I/O Log Writes/sec

I/O Log Reads Average Bytes

I/O Log Writes Average Bytes

Instance2628.1

12.985 9.611 105.665

44.314 33355.906

34995.731

0.000 2.241 0.000 29.852 0.000 7944.891

Instance2628.2

11.455 9.030 105.525

44.271 33351.152

34996.444

0.000 2.324 0.000 29.744 0.000 7991.975

Instance2628.3

11.470 8.985 105.731

44.404 33359.416

34981.507

0.000 2.333 0.000 29.782 0.000 7965.991

Instance2628.4

11.518 8.370 105.597

44.292 33348.736

34996.909

0.000 2.339 0.000 29.756 0.000 7974.950

Background Database Maintenance I/O Performance

MSExchange Database ==> Instances

Database Maintenance IO Reads/sec

Database Maintenance IO Reads Average Bytes

Instance2628.1 9.087 261947.857 Instance2628.2 9.128 261960.523 Instance2628.3 9.128 261961.557 Instance2628.4 9.129 261953.773 Log Replication I/O Performance MSExchange Database ==> Instances I/O Log Reads/sec I/O Log Reads Average Bytes Instance2628.1 0.696 224143.099 Instance2628.2 0.699 224398.133 Instance2628.3 0.697 223789.907 Instance2628.4 0.698 223454.079 Total I/O Performance MSExchange Database ==> Instances









I/O Log Reads/sec

I/O Log Writes/sec



Instance2628.1

12.985

9.611 114.752

44.314 51456.977

34995.731

1.440 2.241 0.696 29.852 224143.099

7944.891

Instance2628.2

11.455

9.030 114.653

44.271 51551.877

34996.444

1.601 2.324 0.699 29.744 224398.133

7991.975

Instance2628.3

11.470

8.985 114.859

44.404 51526.892

34981.507

1.548 2.333 0.697 29.782 223789.907

7965.991

Instance2628.4

11.518

8.370 114.726

44.292 51538.854

34996.909

1.478 2.339 0.698 29.756 223454.079

7974.950

Host System Performance Counter Average Minimum Maximum % Processor Time 0.941 0.222 3.836 Available MBytes 6272.483 6231.000 6381.000

Free System Page Table Entries 33556659.635 33556643.000 33556694.000 Transition Pages RePurposed/sec 0.000 0.000 0.000 Pool Nonpaged Bytes 37875894.234 37797888.000 38064128.000 Pool Paged Bytes 88261153.279 86020096.000 90251264.000 Database Page Fault Stalls/sec 0.000 0.000 0.000 Test Log 6/1/2015 9:57:00 AM -- Preparing for testing ... 6/1/2015 9:57:04 AM -- Attaching databases ... 6/1/2015 9:57:04 AM -- Preparations for testing are complete. 6/1/2015 9:57:04 AM -- Starting transaction dispatch .. 6/1/2015 9:57:04 AM -- Database cache settings: (minimum: 128.0 MB, maximum: 1.0 GB) 6/1/2015 9:57:04 AM -- Database flush thresholds: (start: 10.2 MB, stop: 20.5 MB) 6/1/2015 9:57:09 AM -- Database read latency thresholds: (average: 20 msec/read, maximum: 200 msec/read). 6/1/2015 9:57:09 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 200 msec/write). 6/1/2015 9:57:09 AM -- Operation mix: Sessions 12, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%. 6/1/2015 9:57:09 AM -- Performance logging started (interval: 15000 ms). 6/1/2015 9:57:09 AM -- Attaining prerequisites: 6/1/2015 9:59:08 AM -- \MSExchange Database(JetstressWin)\Database Cache Size, Last: 968118300.0 (lower bound: 966367600.0, upper bound: none) 6/2/2015 9:59:09 AM -- Performance logging has ended. 6/2/2015 9:59:09 AM -- JetInterop batch transaction stats: 288967, 288966, 288966 and 288966. 6/2/2015 9:59:09 AM -- Dispatching transactions ends. 6/2/2015 9:59:09 AM -- Shutting down databases ... 6/2/2015 9:59:11 AM -- Instance2628.1 (complete), Instance2628.2 (complete), Instance2628.3 (complete) and Instance2628.4 (complete) 6/2/2015 9:59:11 AM -- C:\Users\Administrator\Desktop\new\Stress_2015_6_1_9_57_9.blg has 5761 samples. 6/2/2015 9:59:11 AM -- Creating test report ... 6/2/2015 9:59:34 AM -- Instance2628.1 has 13.0 for I/O Database Reads Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.1 has 2.2 for I/O Log Writes Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.1 has 2.2 for I/O Log Reads Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.2 has 11.5 for I/O Database Reads Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.2 has 2.3 for I/O Log Writes Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.2 has 2.3 for I/O Log Reads Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.3 has 11.5 for I/O Database Reads Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.3 has 2.3 for I/O Log Writes Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.3 has 2.3 for I/O Log Reads Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.4 has 11.5 for I/O Database Reads Average Latency.

6/2/2015 9:59:34 AM -- Instance2628.4 has 2.3 for I/O Log Writes Average Latency. 6/2/2015 9:59:34 AM -- Instance2628.4 has 2.3 for I/O Log Reads Average Latency. 6/2/2015 9:59:34 AM -- Test has 0 Maximum Database Page Fault Stalls/sec. 6/2/2015 9:59:34 AM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0.

6/2/2015 9:59:34 AM -- C:\Users\Administrator\Desktop\new\Stress_2015_6_1_9_57_9.xml has 5753 samples queried.

7.2 2-Hour Performance Test Results Performance Test Result Report Test Summary Overall Test Result Pass Machine Name JS1 Test Description Test Start Time 5/21/2015 6:54:02 AM Test End Time 5/21/2015 8:56:23 AM Collection Start Time 5/21/2015 6:56:21 AM Collection End Time 5/21/2015 8:56:19 AM Jetstress Version 15.00.0995.000 ESE Version 15.00.0516.026 Operating System Windows Server 2012 Standard (6.2.9200.0) Performance Log C:\Users\Administrator\Desktop\new\Performance_2015_5_21_6_54_11.blg Database Sizing and Throughput Achieved Transactional I/O per Second 596.418 Target Transactional I/O per Second 480 Initial Database Size (bytes) 8394293641216 Final Database Size (bytes) 8395694538752 Database Files (Count) 4 Jetstress System Parameters Thread Count 12 Minimum Database Cache 128.0 MB Maximum Database Cache 1024.0 MB Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 35% Lazy Commits 70% Run Background Database Maintenance True Number of Copies per Database 2 Database Configuration Instance2856.1 Log path: E:\logs


Instance2856.2 Log path: F:\logs

Database: F:\Jetstress002001.edb












I/O Log Reads/sec

I/O Log Writes/sec



Instance2856.1

14.119 8.523 105.332

43.965 32956.811

36041.464

0.000 2.300 0.000 30.435 0.000 7983.688

Instance2856.2

12.276 7.916 104.888

43.268 32946.684

36151.372

0.000 2.248 0.000 30.396 0.000 7949.294

Instance2856.3

12.388 7.803 105.262

44.009 32968.799

36158.219

0.000 2.148 0.000 30.719 0.000 7988.430

Instance2856.4

12.419 7.431 105.478

44.216 32966.295

36110.605

0.000 2.243 0.000 30.837 0.000 7962.594

Background Database Maintenance I/O Performance MSExchange Database ==> Instances



Instance2856.1 8.920 261990.740 Instance2856.2 9.016 261973.484 Instance2856.3 8.997 261953.932 Instance2856.4 9.015 261949.656

Log Replication I/O Performance MSExchange Database ==> Instances I/O Log Reads/sec I/O Log Reads Average Bytes Instance2856.1 0.716 227221.111 Instance2856.2 0.711 229648.687 Instance2856.3 0.721 230134.202 Instance2856.4 0.721 229163.171 Total I/O Performance MSExchange Database ==> Instances









I/O Log Reads/sec

I/O Log Writes/sec



Instance2856.1

14.119

8.523 114.252

43.965 50837.309

36041.464

1.821 2.300 0.716 30.435 227221.111

7983.688

Instance2856.2

12.276

7.916 113.904

43.268 51074.944

36151.372

1.964 2.248 0.711 30.396 229648.687

7949.294

Instance2856.3

12.388

7.803 114.259

44.009 50998.967

36158.219

1.852 2.148 0.721 30.719 230134.202

7988.430

Instance2856.4

12.419

7.431 114.492

44.216 50995.435

36110.605

1.977 2.243 0.721 30.837 229163.171

7962.594

Host System Performance Counter Average Minimum Maximum % Processor Time 0.935 0.522 1.585 Available MBytes 5998.427 5976.000 6058.000 Free System Page Table Entries 33556640.985 33556523.000 33556654.000 Transition Pages RePurposed/sec 0.000 0.000 0.000 Pool Nonpaged Bytes 40965614.933 40960000.000 41000960.000 Pool Paged Bytes 91609915.733 91533312.000 91738112.000 Database Page Fault Stalls/sec 0.000 0.000 0.000

Test Log 5/21/2015 6:54:02 AM -- Preparing for testing ... 5/21/2015 6:54:06 AM -- Attaching databases ... 5/21/2015 6:54:06 AM -- Preparations for testing are complete. 5/21/2015 6:54:06 AM -- Starting transaction dispatch .. 5/21/2015 6:54:06 AM -- Database cache settings: (minimum: 128.0 MB, maximum: 1.0 GB) 5/21/2015 6:54:06 AM -- Database flush thresholds: (start: 10.2 MB, stop: 20.5 MB) 5/21/2015 6:54:11 AM -- Database read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read). 5/21/2015 6:54:11 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write). 5/21/2015 6:54:11 AM -- Operation mix: Sessions 12, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%. 5/21/2015 6:54:11 AM -- Performance logging started (interval: 15000 ms). 5/21/2015 6:54:11 AM -- Attaining prerequisites: 5/21/2015 6:56:21 AM -- \MSExchange Database(JetstressWin)\Database Cache Size, Last: 967299100.0 (lower bound: 966367600.0, upper bound: none) 5/21/2015 8:56:21 AM -- Performance logging has ended. 5/21/2015 8:56:21 AM -- JetInterop batch transaction stats: 25139, 25139, 25139 and 25139. 5/21/2015 8:56:21 AM -- Dispatching transactions ends. 5/21/2015 8:56:21 AM -- Shutting down databases ... 5/21/2015 8:56:23 AM -- Instance2856.1 (complete), Instance2856.2 (complete), Instance2856.3 (complete) and Instance2856.4 (complete) 5/21/2015 8:56:23 AM -- C:\Users\Administrator\Desktop\new\Performance_2015_5_21_6_54_11.blg has 488 samples. 5/21/2015 8:56:23 AM -- Creating test report ... 5/21/2015 8:56:25 AM -- Instance2856.1 has 14.1 for I/O Database Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.1 has 2.3 for I/O Log Writes Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.1 has 2.3 for I/O Log Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.2 has 12.3 for I/O Database Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.2 has 2.2 for I/O Log Writes Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.2 has 2.2 for I/O Log Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.3 has 12.4 for I/O Database Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.3 has 2.1 for I/O Log Writes Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.3 has 2.1 for I/O Log Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.4 has 12.4 for I/O Database Reads Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.4 has 2.2 for I/O Log Writes Average Latency. 5/21/2015 8:56:25 AM -- Instance2856.4 has 2.2 for I/O Log Reads Average Latency. 5/21/2015 8:56:25 AM -- Test has 0 Maximum Database Page Fault Stalls/sec. 5/21/2015 8:56:25 AM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0.

5/21/2015 8:56:25 AM -- C:\Users\Administrator\Desktop\new\Performance_2015_5_21_6_54_11.xml has 479 samples queried.

7.3 Database Backup Test Results Database backup Test Result Report Database Backup Statistics - All Database Instance Database Size (MBytes) Elapsed Backup Time MBytes Transferred/sec Instance2628.1 2020083.59 09:48:20 57.22 Instance2628.2 2020067.59 08:00:55 70.01 Instance2628.3 2020059.59 08:06:18 69.23 Instance2628.4 2020051.59 08:04:29 69.49 Avg 66.49 Sum 265.95 Jetstress System Parameters Thread Count 12 Minimum Database Cache 128.0 MB Maximum Database Cache 1024.0 MB Insert Operations 40% Delete Operations 20% Replace Operations 5% Read Operations 35% Lazy Commits 70% Database Configuration Instance2628.1 Log path: E:\logs














I/O Log Reads/sec

I/O Log Writes/sec



Instance2628.1

6.424 0.000 228.682

0.000 262144.000

0.000 0.000 0.000 0.000 0.000 0.000 0.000

Instance2628.2

4.983 0.000 279.821

0.000 262144.000

0.000 0.000 0.000 0.000 0.000 0.000 0.000

Instance2628.3

5.038 0.000 276.718

0.000 262144.000

0.000 0.000 0.000 0.000 0.000 0.000 0.000

Instance2628.4

5.029 0.000 277.740

0.000 262144.000

0.000 0.000 0.000 0.000 0.000 0.000 0.000

Host System Performance Counter Average Minimum Maximum % Processor Time 1.267 0.175 4.103 Available MBytes 7192.203 7186.000 7196.000 Free System Page Table Entries 33556657.936 33556655.000 33557681.000 Transition Pages RePurposed/sec 0.000 0.000 0.000 Pool Nonpaged Bytes 39146196.463 39010304.000 39370752.000 Pool Paged Bytes 92875121.197 92393472.000 93061120.000 Database Page Fault Stalls/sec 0.000 0.000 0.000 Test Log 6/3/2015 6:48:07 AM -- Preparing for testing ... 6/3/2015 6:48:11 AM -- Attaching databases ... 6/3/2015 6:48:11 AM -- Preparations for testing are complete. 6/3/2015 6:48:16 AM -- Performance logging started (interval: 30000 ms). 6/3/2015 6:48:16 AM -- Backing up databases ... 6/3/2015 4:36:36 PM -- Performance logging has ended.

6/3/2015 4:36:36 PM -- Instance2628.1 (100% processed), Instance2628.2 (100% processed), Instance2628.3 (100% processed) and Instance2628.4 (100% processed) 6/3/2015 4:36:36 PM -- C:\Users\Administrator\Desktop\new\DatabaseBackup_2015_6_3_6_48_11.blg has 1176 samples.

6/3/2015 4:36:36 PM -- Creating test report ...

7.4 Soft Recovery Test Results SoftRecovery Test Result Report Soft-Recovery Statistics - All Database Instance Log files replayed Elapsed seconds Instance2628.1 501 832.1205128 Instance2628.2 507 773.8470148 Instance2628.3 507 776.6985182 Instance2628.4 505 773.8470148 Avg 505 789.128 Sum 2020 3156.5130606 Database Configuration Instance2628.1 Log path: E:\logs






I/O Database Reads Average

I/O Database Writes Average





I/O Log Reads Average Laten

I/O Log Writes Average

I/O Log Reads/sec

I/O Log Writes/sec


I/O Log Writes Average

Latency (msec)

Latency (msec)

cy (msec)

Latency (msec)

Bytes

Instance2628.1

10.798 2.665 536.728

2.403 39742.362

30859.184

2.366 0.000 3.007 0.000 197024.208

0.000

Instance2628.2

10.003 2.850 585.582

2.616 39708.354

32083.551

1.898 0.000 3.273 0.000 204762.039

0.000

Instance2628.3

10.102 2.916 580.065

2.604 39756.024

32170.667

1.813 0.000 3.258 0.000 205878.019

0.000

Instance2628.4

9.921 2.702 586.820

2.606 39724.411

31997.995

1.879 0.000 3.260 0.000 204780.024

0.000

Background Database Maintenance I/O Performance MSExchange Database ==> Instances



Instance2628.1 0.000 0.000 Instance2628.2 0.000 0.000 Instance2628.3 0.000 0.000 Instance2628.4 0.000 0.000 Total I/O Performance MSExchange Database ==> Instances









I/O Log Reads/sec

I/O Log Writes/sec



Instance2628.1

10.798 2.665 536.728

2.403 39742.362

30859.184

2.366 0.000 3.007 0.000 197024.208

0.000

Instance2628.2

10.003 2.850 585.582

2.616 39708.354

32083.551

1.898 0.000 3.273 0.000 204762.039

0.000

Instance2628.3

10.102 2.916 580.065

2.604 39756.024

32170.667

1.813 0.000 3.258 0.000 205878.019

0.000

Instance2628.4

9.921 2.702 586.820

2.606 39724.411

31997.995

1.879 0.000 3.260 0.000 204780.024

0.000

Host System Performance Counter Average Minimum Maximum % Processor Time 2.332 0.000 5.412 Available MBytes 6119.499 6073.000 7151.000 Free System Page Table Entries 33556657.058 33556653.000 33556660.000 Transition Pages RePurposed/sec 0.000 0.000 0.000 Pool Nonpaged Bytes 39652166.044 39591936.000 39694336.000 Pool Paged Bytes 94167555.719 94130176.000 94253056.000 Database Page Fault Stalls/sec 0.000 0.000 0.000 Test Log 6/4/2015 6:15:29 AM -- Preparing for testing ... 6/4/2015 6:15:33 AM -- Attaching databases ... 6/4/2015 6:15:33 AM -- Preparations for testing are complete. 6/4/2015 6:15:33 AM -- Starting transaction dispatch .. 6/4/2015 6:15:33 AM -- Database cache settings: (minimum: 128.0 MB, maximum: 1.0 GB) 6/4/2015 6:15:33 AM -- Database flush thresholds: (start: 10.2 MB, stop: 20.5 MB) 6/4/2015 6:15:38 AM -- Database read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read). 6/4/2015 6:15:38 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write). 6/4/2015 6:15:38 AM -- Operation mix: Sessions 12, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%. 6/4/2015 6:15:38 AM -- Performance logging started (interval: 15000 ms). 6/4/2015 6:15:38 AM -- Generating log files ... 6/4/2015 7:44:57 AM -- E:\logs (100.2% generated), F:\logs (101.4% generated), G:\logs (101.4% generated) and H:\logs (101.0% generated) 6/4/2015 7:44:57 AM -- Performance logging has ended. 6/4/2015 7:44:57 AM -- JetInterop batch transaction stats: 21802, 21802, 21802 and 21802. 6/4/2015 7:44:57 AM -- Dispatching transactions ends. 6/4/2015 7:44:58 AM -- Shutting down databases ... 6/4/2015 7:44:59 AM -- Instance2628.1 (complete), Instance2628.2 (complete), Instance2628.3 (complete) and Instance2628.4 (complete) 6/4/2015 7:44:59 AM -- C:\Users\Administrator\Desktop\new\Performance_2015_6_4_6_15_38.blg has 356 samples. 6/4/2015 7:44:59 AM -- Creating test report ... 6/4/2015 7:45:01 AM -- Instance2628.1 has 12.0 for I/O Database Reads Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.1 has 2.2 for I/O Log Writes Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.1 has 2.2 for I/O Log Reads Average Latency.

6/4/2015 7:45:01 AM -- Instance2628.2 has 10.3 for I/O Database Reads Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.2 has 2.3 for I/O Log Writes Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.2 has 2.3 for I/O Log Reads Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.3 has 10.3 for I/O Database Reads Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.3 has 2.3 for I/O Log Writes Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.3 has 2.3 for I/O Log Reads Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.4 has 10.3 for I/O Database Reads Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.4 has 2.3 for I/O Log Writes Average Latency. 6/4/2015 7:45:01 AM -- Instance2628.4 has 2.3 for I/O Log Reads Average Latency. 6/4/2015 7:45:01 AM -- Test has 0 Maximum Database Page Fault Stalls/sec. 6/4/2015 7:45:01 AM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0. 6/4/2015 7:45:01 AM -- C:\Users\Administrator\Desktop\new\Performance_2015_6_4_6_15_38.xml has 355 samples queried. 6/4/2015 7:45:01 AM -- C:\Users\Administrator\Desktop\new\Performance_2015_6_4_6_15_38.html was saved. 6/4/2015 7:45:01 AM -- Performance logging started (interval: 2000 ms). 6/4/2015 7:45:01 AM -- Recovering databases ... 6/4/2015 7:58:53 AM -- Performance logging has ended. 6/4/2015 7:58:53 AM -- Instance2628.1 (832.1205128), Instance2628.2 (773.8470148), Instance2628.3 (776.6985182) and Instance2628.4 (773.8470148) 6/4/2015 7:58:54 AM -- C:\Users\Administrator\Desktop\new\SoftRecovery_2015_6_4_7_45_1.blg has 413 samples.

6/4/2015 7:58:54 AM -- Creating test report ...

Documents

Nutanix 24,000-Mailbox Virtualized Exchange Server 2013 Mailbox