1
11M+ ops/sec Memcached at 0.3 msec latency with a single AWS EC2 instance LegUp Computing Inc. provides a cloud platform that enables software developers to program, deploy, scale, and manage FPGA devices for accelerating high-performance applications. 276K 1.4M 1.3M 443K 4.3M 11.5M 0 2M 4M 6M 8M 10M 12M 5 10 20 40 80 160 400 800 1400 [ops/sec] Number of Connections ElastiCache LegUp Memcached 9X Better ops/sec vs ElastiCache Memcached-compatible so no software change is necessary. Simply launch LegUp Memcached instance on AWS and connect your web server. Easy to Deploy LegUp Computing offers the world’s fastest cloud-deployed Memcached using AWS EC2 F1 (FPGA) instances. With a single F1, LegUp’s Memcached server achieves over 11M ops/sec, a 9X improvement over ElastiCache, at <300 µs latency. World’s Fastest Memcached on AWS The FPGA is only 20% utilized, leaving plenty of room to add user-defined functions. With LegUp, you can add custom computing logic on the FPGA while keeping the same throughput. Examples include: compression, encryption, data analytics and machine learning. Customized Solutions www.legupcomputing.com [email protected] AWS launched F1 instances in April, 2017. An F1 instance contains a compute acceleration device called an FPGA (Field- Programmable Gate Array), which can be instantly programmed as any digital circuit. FPGAs excel at real-time data processing. What is AWS F1? 0.25 ms 1.03 ms 18.2 ms 0.20 ms 0.31 ms 2.0 ms 0 4 8 12 16 20 5 10 20 40 80 160 400 800 1400 [ms] Number of Connections ElastiCache LegUp Memcached Up to 9X Lower Latency vs ElastiCache AWS Instance RAM Cost cache.r4.4xlarge 101GB $1.82/hour f1.2xlarge 122GB $1.65/hour Cost Efficient 10% lower EC2 instance cost vs. comparable RAM size ElastiCache instance. With 9x higher ops/sec, LegUp Memcached offers 10X better throughput/$. Network Offload The FPGA implements a 10Gbps TCP/IP network stack and the Memcached server in ultra-fast hardware. * Results in the figure are gathered using memtier_benchmark, network delay is included. Latency of LegUp Memcached server alone is less than 300 µs.

11M+ ops/sec Memcached at 0.3 msec latency with a single ... · 11M+ ops/sec Memcached at 0.3 msec latency with a single AWS EC2 instance LegUpComputing Inc.provides a cloud platform

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

11M+ ops/sec Memcached

at 0.3 msec latency with a

single AWS EC2 instance

LegUp ComputingInc. providesacloudplatformthatenablessoftwaredevelopers toprogram,deploy,scale,andmanageFPGAdevices foracceleratinghigh-performanceapplications.

276K 1.4M 1.3M443K

4.3M

11.5M

0

2M

4M

6M

8M

10M

12M

5 10 20 40 80 160 400 800 1400

[ops/sec]

NumberofConnections

ElastiCache LegUpMemcached

9X Better ops/sec vs ElastiCache

Memcached-compatiblesonosoftwarechangeisnecessary.SimplylaunchLegUp MemcachedinstanceonAWSandconnectyourwebserver.

Easy to DeployLegUpComputingofferstheworld’sfastestcloud-deployedMemcached usingAWSEC2F1(FPGA)instances.WithasingleF1,LegUp’s Memcached serverachievesover11Mops/sec,a9XimprovementoverElastiCache,at <300µslatency.

World’s Fastest Memcached on AWS

TheFPGAisonly20%utilized,leavingplentyofroomtoadduser-definedfunctions.WithLegUp,youcanaddcustomcomputinglogicon theFPGAwhilekeepingthesamethroughput.Examplesinclude:compression,encryption, dataanalyticsandmachinelearning.

Customized Solutions

www.legupcomputing.com

[email protected]

AWSlaunchedF1instancesinApril,2017.AnF1instancecontainsacomputeaccelerationdevicecalledanFPGA(Field-ProgrammableGateArray),whichcanbeinstantlyprogrammedasanydigitalcircuit.FPGAsexcelatreal-timedataprocessing.

What is AWS F1?

0.25ms 1.03ms

18.2ms

0.20ms 0.31ms 2.0ms

0

4

8

12

16

20

5 10 20 40 80 160 400 800 1400

[ms]

NumberofConnections

ElastiCache LegUpMemcached

Up to 9X Lower Latency vs ElastiCache

AWSInstance RAM Costcache.r4.4xlarge 101GB $1.82/hourf1.2xlarge 122GB $1.65/hour

Cost Efficient

10%lowerEC2instancecostvs.comparableRAMsizeElastiCacheinstance.

With9xhigherops/sec,LegUpMemcached offers10Xbetterthroughput/$.

Network Offload

TheFPGAimplementsa10GbpsTCP/IPnetworkstackandtheMemcached serverinultra-fasthardware.

* Results in the figure are gathered using memtier_benchmark,network delay is included. Latency of LegUp Memcached serveralone is less than 300 µs.