Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
Q500-P10 performance report
Version 0.2
Nov 2013
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
3
Table of Contents
Revision History ............................................................................................ 2
Table of Contents ........................................................................................... 3
1. Test bed ............................................................................................. 4
1.1 Hardware ........................................................................................ 4
1.2 Software ......................................................................................... 4
1.3 Storage target settings ..................................................................... 5
2. Test matrix ......................................................................................... 6
3. Single controller - Sequential ................................................................ 7
3.1 RAID 0 ............................................................................................ 7
3.2 RAID 5 ............................................................................................ 8
3.2.1 RAID 5 degrade ............................................................................ 8
3.2.2 RAID 5 rebuild .............................................................................. 9
3.2.3 RAID 5 comparison ...................................................................... 10
3.3 RAID 6 ........................................................................................... 11
3.3.1 RAID 6 degrade ........................................................................... 12
3.3.2 RAID 6 rebuild ............................................................................. 13
3.3.3 RAID 6 comparison ...................................................................... 14
4. Dual controllers – Sequential ............................................................... 15
4.1 RAID 0 ........................................................................................... 15
4.2 RAID 5 ........................................................................................... 15
4.3 RAID 6 ........................................................................................... 16
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
4
1. Test bed
The testing environment includes host servers, HBA cards, HDDs, and switches.
All performance cases conducted here are on Windows platform. There are no
Linux, Unix, or Mac platform numbers. Details are listed below.
1.1 Hardware
Host servers
There are total 4 servers. Three are ASUS RS700-X7/PS4. One is ASUS
TS500-E6-PS4
Model name ASUS RS700-X7/PS4
Processor(s) CPU:Intel® Xeon® E5-2620 2.00GHz
Memory ASUS 8GB PC3-10600 (REG, ECC) with ELPIDA
On-board LAN Intel® 82574L Gigabit Network Connection
Model name ASUS TS500-E6-PS4
Processor(s) CPU:Intel® Xeon® E5520 2.27GHz
Memory ASUS 2GB PC3-10600 (REG, ECC) with ELPIDA
On-board LAN Intel® 82574L Gigabit Network Connection
iSCSI HBA cards
Device name Intel® 82574L Gigabit Network
Driver version 12.7.27.0
Hard drives
Seagate Cheetah 3.5” SAS 15K.5 ST373455SS 73GB x24
1GbE switch
Dell PowerConnect 5324
1.2 Software
Operating system used on host servers.
Windows Server 2008 R2 Enterprise 64bit with service pack 2
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
5
Benchmark tools
o Iometer 2006,07,27
o IOmeter settings
Cache hit : max disk size = 20480
None cache hit : max disk size = 0
# of outstanding I/Os : 64
Ramp up time : 5 seconds
Run time : 25 seconds
1.3 Storage target settings
RAID controller : Dual controller Q500-P10-D424
Firmware version : 1.0.0_ 20130425_1600
Host interfaces :
o Single controller : up to 6x 1GbE iSCSI ports
o Dual controller : up to 12x 1GbE iSCSI ports
Stripe height (KBytes): 64KB
Block size : 512 Bytes
Write back or write through : Write back
Best configuration suggestion
As a general rule of thumb, try to assign dedicated RAID group (RG) to each host
interface port. This will yield the best performance. If you assign each RG to
several host interface ports, this usually will result in not so good performance.
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
6
2. Test matrix
The following is the test configuration used in this report.
Sequential Random
RAID 0 O(single/dual) X
RAID 5 O(single/dual) X
Degrade O(single) X
Rebuild O(single) X
RAID 6 O(single/dual) X
Degrade O(single) X
Rebuild O(single) X
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
7
3. Single controller - Sequential
3.1 RAID 0
Configurations
Host servers : Three servers
# of host interface : 6x 1GbE iSCSI with 1x trunking
6x RGs. Each RG has one VD. Each RG has 4x HDDs.
RAID 0 sequential read/write
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 133295.8 78796.7 21053.4 2630.5 559.0
NCH 123557.9 75666.0 20654.9 2453.3 645.5
Throughput (MBytes/sec)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 65.1 307.8 657.9 657.6 559.0
NCH 60.3 295.6 645.5 613.3 645.5
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 91490.1 70761.1 15770.3 2221.8
NCH 90520.7 63152.6 14011.8 2021.1 505.7
Throughput (Mbytes/sec)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 44.7 276.4 492.8 555.4
NCH 44.2 246.7 437.9 505.3 505.7
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
8
3.2 RAID 5
Configurations
Host servers : One server
# of host interface : 6x 1GbE iSCSI with MPIO
1x RGs. Each RG has one VD. Each RG has 8x HDDs.
RAID 5 sequential read/write
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 127703.7 95397.7 20712.9 2673.0 664.5
NCH 129204.8 98229.9 20560.1 2680.4 666.5
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 62.4 372.6 647.3 668.2 664.5
NCH 63.1 383.7 642.5 670.1 666.5
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 104520.7 78550.0 15016.6 2117.1 502.0
NCH 93927.5 71987.9 15020.3 2056.2 513.4
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 51.0 306.8 469.3 529.3 502.0
NCH 45.9 281.2 469.4 514.0 513.4
3.2.1 RAID 5 degrade
Configurations
Host servers : Two servers
# of host interface : 2x 1GbE iSCSI
2x RGs. Each RG has one VD. Each RG has 8x HDDs.
Unplug one HDD to make RAID 5 in degraded mode
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
9
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 124833.6 36007.2 7144.5 892.3 221.7
NCH 133293.5 35966.5 7013.0 836.8 220.2
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 61.0 140.7 223.3 223.1 221.7
NCH 65.1 140.5 219.2 209.2 220.2
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 93822.6 56717.4 7079.5 874.9 217.9
NCH 96605.9 56181.9 7071.6 874.5 217.7
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 45.8 221.6 221.2 218.7 217.9
NCH 47.2 219.5 221.0 218.6 217.7
3.2.2 RAID 5 rebuild
Configurations
Host servers : Two servers
# of host interface : 2x 1GbE iSCSI
2x RGs. Each RG has one VD. Each RG has 8x HDDs.
Plug in one new HDD to rebuild RAID 5 parity
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 34148.7 22086.0 7102.1 891.8 222.5
NCH 35087.3 27225.7 7070.3 890.0 219.6
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
10
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 16.7 86.3 221.9 222.9 222.5
NCH 17.1 106.4 220.9 222.5 219.6
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 28283.7 23945.9 6595.9 860.7 214.4
NCH 28684.6 28409.7 6720.1 864.1 213.6
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 13.8 93.5 206.1 215.2 214.4
NCH 14.0 111.0 210.0 216.0 213.6
3.2.3 RAID 5 comparison
We compare RAID 5 performance under the same configuration to show the
degrade and rebuild impact on performance. None cache hit numbers are
used here.
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
11
3.3 RAID 6
Configurations
Host servers : One server
# of host interface : 6x 1GbE iSCSI with MPIO
1x RGs. Each RG has one VD. Each RG has 8x HDDs.
RAID 6 sequential read/write
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 114631.4 94976.3 20475.2 2672.6 668.0
NCH 126333.8 91047.5 20307.7 2679.3 666.3
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 56.0 371.0 639.8 668.2 668.0
NCH 61.7 355.7 634.6 669.8 666.3
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
12
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 95987.3 74206.7 15578.3 2132.9 534.4
NCH 99395.6 65647.3 14541.2 2028.3 507.5
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 46.9 289.9 486.8 533.2 534.4
NCH 48.5 256.4 454.4 507.1 507.5
3.3.1 RAID 6 degrade
Configurations
Host servers : Two servers
# of host interface : 2x 1GbE iSCSI
2x RGs. Each RG has one VD. Each RG has 8x HDDs.
Unplug two HDDs to make RAID 6 in degraded mode
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 120386.7 36093.7 7142.6 880.9 216.1
NCH 125569.6 36295.9 7144.4 889.8 220.3
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 58.8 141.0 223.2 220.2 216.1
NCH 61.3 141.8 223.3 222.4 220.3
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 97770.4 56069.2 7080.4 875.3 217.6
NCH 98512.0 49827.1 7008.1 873.6 217.3
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
13
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 47.7 219.0 221.3 218.8 217.6
NCH 48.1 194.6 219.0 218.4 217.3
3.3.2 RAID 6 rebuild
Configurations
Host servers : Two servers
# of host interface : 2x 1GbE iSCSI
2x RGs. Each RG has one VD. Each RG has 8x HDDs.
Plug in two HDDs to rebuild RAID 6 parity
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 29588.7 20384.0 7089.1 892.0 221.7
NCH 30287.4 21802.5 7030.2 890.1 220.4
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 14.4 79.6 221.5 223.0 221.7
NCH 14.8 85.2 219.7 222.5 220.4
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 29106.2 21617.7 6412.0 850.7 212.1
NCH 28665.1 28560.2 6644.9 855.8 210.4
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 14.2 84.4 200.4 212.7 212.1
NCH 14.0 111.6 207.7 214.0 210.4
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
14
3.3.3 RAID 6 comparison
We compare RAID 6 performance under the same configuration to show the
degrade and rebuild impact on performance. None cache hit numbers are
used here.
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
15
4. Dual controllers – Sequential
4.1 RAID 0
Configurations
Host servers : Two servers
# of host interface : 12x 1GbE iSCSI with 2x trunking
2x RGs. Each RG has one VD. Each RG has 8x HDDs.
RAID 0 sequential read/write
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 259438.2 205735.2 41639.0 5353.6 1338.6
NCH 253559.4 203223.5 41028.2 5363.9 1335.2
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 126.7 803.7 1301.2 1338.4 1338.6
NCH 123.8 793.8 1282.1 1341.0 1335.2
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 193064.6 149871.2 29322.3 4196.5 1048.8
NCH 196886.4 144702.3 29585.6 4144.8 1022.0
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 94.3 585.4 916.3 1049.1 1048.8
NCH 96.1 565.2 924.5 1036.2 1022.0
4.2 RAID 5
Configurations
Host servers : Two servers
# of host interface : 12x 1GbE iSCSI with 2x trunking
2x RGs. Each RG has one VD. Each RG has 8x HDDs.
RAID 5 sequential read/write
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
16
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 249418.2 195637.1 41517.0 5353.5 1335.6
NCH 239356.4 196022.5 38042.6 5360.7 1335.0
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 121.8 764.2 1297.4 1338.4 1335.6
NCH 116.9 765.7 1188.8 1340.2 1335.0
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 181165.7 142753.1 29064.4 4150.2 1042.0
NCH 186481.6 137599.9 27628.7 3963.9 985.6
Throughput (Mbytes/s)
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 88.5 557.6 908.3 1037.5 1042.0
NCH 91.1 537.5 863.4 991.0 985.6
4.3 RAID 6
Configurations
Host servers : Two servers
# of host interface : 12x 1GbE iSCSI with two MPIO
2x RGs. Each RG has one VD. Each RG has 12x HDDs.
RAID 6 sequential read/write
IOPS
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 252807.8 203599.9 42100.8 5356.7 1339.1
NCH 255892.2 198319.8 41965.5 5338.9 1334.8
Copyright © 2004-2013 Qsan Technology, Inc. All Rights Reserved.
Qsan Document
17
Throughput (Mbytes/s)
512B; Read 4K; Read 32K; Read 256K; Read 1M; Read
CH 123.4 795.3 1315.7 1339.2 1339.1
NCH 124.9 774.7 1311.4 1334.7 1334.8
IOPS
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 194989.8 153263.7 29696.2 4193.8 1051.3
NCH 189627.2 139859.7 28734.3 3951.7 984.7
Throughput
512B; Write 4K; Write 32K; Write 256K; Write 1M; Write
CH 95.2 598.7 928.0 1048.4 1051.3
NCH 92.6 546.3 897.9 987.9 984.7