By Derrick Lee, Garrett Lord, Jesse Martinez, and Christopher Moore

Mentors: HB Chen, Parks Fields, Benjamin McClelland, Alfred Torrez

Computer Systems, Cluster, and Networking Summer Institute 2011

Performance Studies of Out-of-Core Computing on Various Storage Devices –

Fusion-IO’s IOSan, SuperTalent’s RaidDrive, OCZ Vertex 3, Kingston V+

OutlineOut of Core Testing

IntroductionDevices UsedTypes of BenchmarksResults from BenchmarksCost EfficiencyAreas for ImprovementConclusion

Introduction• Datasets are characterized by their very large

sizes with multiple superposed scalar and vector fields, demanding an imperative need for new interactive exploratory visualization capabilities

• Sequence of Out-of-core benchmarking tests were done on various storage devices such as SATA based Solid State Devices and PCI-Express based SSD

Devices• System– Fedora 13 64bit– RAM: 144GB, 16 Cores– Devices• Fusion IO IOSAN SSD 640GB

• System– Fedora 15 64bit– RAM: 8GB, 8 Cores– Devices• SuperTalent RAID Drive 512GB• APTEC PCI-Express 4-Port SATA Controller– 4x 240 GB OCZ Vertex 3– 4x 256 GB Kingston V+ Series

Benchmark TestsFIO (File Input/Output) Benchmark

Unbuffered/Buffered I/OSequential ReadSequential WriteRandom ReadRandom Write

Graph 500Scale 28Cores: 16

FIO BenchmarkThree types of results done

Aggregate Bandwidth I/O Operations per SecondCompletion Latency

Ext2 File systems were created on the devices

Minimum TEPS Median TEPS Maximum TEPS0

20

40

60

80

100

120

140

Graph 500 Results

MemoryFusion IO

Range of TEPS

Trav

erse

d Ed

ges

per

Seco

nd (M

illio

ns)

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

FIO Benchmark - IOPS - Unbuffered - 64 Jobs512 2k 8k 32k 128k 512k 2M 8M

IOPS

Rand. Read Rand. Write Seq. Read Seq. Write

140k

120k

100k

80k

60k

40k

20k

0

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

Fusio

n IO

Supe

r Tal

ent

OCZ

King

ston

0200400600800

1000120014001600

FIO Benchmark - Aggregate Bandwidth - Unbuffered - 64 Jobs 512 2k 8k 32k 128k 512k 2M 8M

Aggr

egat

e Ba

ndw

idth

(MB/

s)

Rand. Read Rand. Write Seq. Read Seq. Write

FIO Benchmark Cost EfficiencyDevice(MTBF)

Capacity (GB) / $

Bandwidth (MB) / $

IOPS / $

Fusion IO 0.040 0.012 3.011Super Talent(1.5 mil. Hours)

0.256 0.056 14.355

OCZ Vertex 3(2 mil. Hours ea.)

0.426 0.035 8.904

Kingston V+(1 mil. Hours ea.)

0.499 0.021 7.224

Cost/Capacity List

02,0004,0006,0008,000

10,00012,00014,00016,00018,000

16,000

4,0002,500 2,400

Cost($)

Bandwidth Cost Comparison

FusionIO IO SAN

Supertalent RaidDrive

OCZ Vertex 3

Kingston V+ NowSSD

0

0.01

0.02

0.03

0.04

0.05

0.06

0.012

0.056

0.035

0.021

MB/sec/$

MB/sec/$

IOPs Cost Comparison - IOPs/$

FusionIO IO SAN

Supertalent RaidDrive

OCZ Vertex 3 Kingston V+ NowSSD

02468

10121416

3.011

14.355

8.9047.224

IOPS/$

IOPS/$

Areas for Future Improvement• Benchmarks• IOZone• XDD• Bonnie++• Bandwidth+• STREAM• ScaLAPACK

• Performance Analysis of SSDs in Larger Systems• Memory Swap Performance

• File Systems Formats

Conclusion• In respect to processing power, FIO test results also

showed that the Fusion IO drive displayed significantly better performance. However, performance per dollar indicates that the smaller SSDs had a higher cost efficiency rating.

• Graph500 benchmark testing showed that the Fusion IO had a high edge traverse rate with the swap system but baseline results showed to be higher.

• Although the Fusion IO had higher performances, the performance/cost results showed to be lower than the rest of the SSD devices.

Questions?