Making clouds go faster, for fun and profit!

This slide intentionally left blank.

Wednesday, 17 October 12

MAKING CLOUDS GO FASTERFOR FUN AND PROFIT

SpeakersWho crafted this talk?

Alex Howells@nixgeek

Technical OperationsLivingSocial

alex.howells@livingsocial.comhttp://github.com/agh

Paul Thomas@ftergl0w

Technical OperationsLivingSocial

paul.thomas@livingsocial.comhttp://github.com/AfterGlow

Bedtime ReadingYou can get a copy of these slides after the talk -

https://speakerdeck.com/u/nixgeek

Problem?8

PerformanceIt doesn’t need to be rocket science.

It does matter though!

I promise I’m not trolling you.

“Oh man, that was too fast!It’s so much betternow it’s slow!!”

-- Average User

In a parallel universe...

YEAH RIGHTI wish I had users who were that easy to please!

But since we live in the real world...

“Why is that dude smiling?!This is too slow!

Why can’t it be faster?”

-- Average Users

In our universe...

THINGS ARE IMPROVINGCactus => Diablo => Essex => Folsom

But things can improve faster with focus!

Mostly reliable,but can be a bit slow!

The Future?

Faster. More scalable.A real driving experience.

Why should I listen to you?

What’s the big deal?16

WE’RE A LOT LIKE YOU!Developers. Operators. Engineers. Users.We see potential. We see opportunities.

AirspaceLivingSocial PaaS

We care about speed because ...

* Scaling services up/down needs to happen fast! * Needing to maintain huge pools of “slack capacity” to account for sudden spikes in traffic sucks. * Upgrading applications should be fast.

What does fast mean to us? One example?

New instances online in under 10 seconds.

Performance Matters

What could your business do if instances came online in under 5 seconds vs. 50 seconds?

> Makes integration tests leveraging the Cloud complete much faster. > Seasonal spikes? React to them faster - happier customers spend more money. > Engineers who don’t grumble that “getting servers is a pain in the ass”. > Deploy new applications and services more quickly and easily.

Along with many other things ...

What do we do?

Think Positive22

Because solutions are better than problems!

Two-ProngedApproach

Hardware & Software“A Love Story”

Warning!

Picking the right hardware is quite hard.It’s often individual to your users needs.

What works for us may not rock your world.

Hardware26

Our Servers

Supermicro 1027R-WRFT+2x Intel Xeon E5-2670 (8C/16T 2.60GHz)16 x 8GB 1600MHz ECC MemoryLSI 9266-8i (1-LD RAID-10)8 x Intel 520-series 240GB SSDDual-Port Intel X540 10GBASE-T

Benefits

* ‘Just right’ balance of CPU/RAM for us.

* Exceptional ephemeral I/O performance > Not using eMLC - trade off? > We can think about SQL on IaaS

* A surplus of network bandwidth

Servers are not a bottleneck!

Our Network

Top of Rack -Arista Networks 7050T48-port 10GBASE-T Switch+ 4-port 40GbE (uplinks)

Zone Spine -Arista Networks 7050Q16-port 40GbE Switch

Benefits

* A network which runs Linux!* Ability to automate it via ZTP and Chef

* Non-blocking communication in a rack.* Provision 160Gbps to spine via four cables.* Under 2:1 contention for comms in/out of rack.

* Less need to think about QoS!

Network is not a bottleneck!

Software31

Production

Ubuntu 12.04 LTS (‘Precise Pangolin’)Hypervisor -- KVM

CloudScaling OCS 1.3 .. based off OpenStack Essex ..

Moving to OCS 2.0 in near future... .. that one is OpenStack Folsom ..

Ubuntu 12.04 LTS (‘Precise Pangolin’)Hypervisor -- KVM

Useful for development and testing .. we’re running OpenStack Folsom now ..

Most of the data shown later was grabbedwith help from DevStack running on similarhardware to our production environment.

WHAT NOW?We’ve picked the hardware stack. It’s awesome.

We’ve got our software installed. It’s looking great.

Support calls are imprecise. We need data!

Monitoring35

Old School* Is my service (API) responding on TCP/8774?* Am I able to make a GET and fetch instance info?* Is my server running all the processes it should?* Are there any errors on my network ports?

If any of this looks broken,send me alerts saying so!

New Thinking

* “How long did my website take to show?”* Individual performance of each click or API call* Inspection of latency within the application

If lots of users interactions are slow,then I want you to alert me.

If its just an outlier - log it and shut up.

“End-User Experience Monitoring”

DEMO TIME!Because pretty pictures are awesome.

We’ll call the slowest transactions our “Disaster Porn”.

Boundary

“AppViz”

* Port-to-port throughput/latency* How much SQL traffic are you doing?

Updates in real-time.Look backwards in time.

Powered by IPFIX (RFC 5101)

Tracelytics

Lots more cool stuff to help ...We’ll blitz through a few more things next ...

Latency Trends* Over the last 60 minutes* Over the last 24 hours* Over the last 7 days

Top Tip: This is bad news.

TracelyticsPatches

If you want to try out OpenStack APM -https://github.com/Afterglow/tracelytics-openstack

Any questions? Just open an issue!

Glance

Keystone

“Call to Arms”

Reminder about those patches -https://github.com/Afterglow/tracelytics-openstack

> Performance regression tests as an OpenStack CI gate?> More people talking about “How I fixed those >5 second outliers!”> Better ‘shared knowledge’ about what settings to tweak for added oomph> Architectural analysis asking about “big picture” (big impact) changes

CreditsBecause these folks are awesome

N.B. Not intended as an exhaustive list of all the awesome people in the world/room!

http://www.livingsocial.com

Credits

http://www.cloudscaling.com

Credits

http://www.aristanetworks.com

Credits

http://www.tracelytics.com

Credits

We’re done talking,thanks for listening!

Any questions?

Interested?E-mail Ken -

ken.persel@livingsocial.com

Or just find me!

Reminder that these slides are over at -https://speakerdeck.com/u/nixgeek

Making clouds go faster, for fun and profit!

Technology

Leica Aibot - ABTech€¦ · to the surveying industry by capturing data faster to generate accurate orthophotos, 3D models and point clouds in high density. Efficient flight planning

The Effects of Artificial Clouds on Climateartificialclouds.com/artificial-clouds-and-climate-change.pdf · The Effects of Artificial Clouds on Climate ... CLOUDS AFFECT AIR TEMPERATURE,

Create Faster Code Faster

CLOUDS. What are clouds?

Clouds, Rain, Clouds Again

NEW FOR 2014 FASTER REMOVE MUST-HAVE PREP PROFIT MAKERS

Ice in Clouds Experiment–Layer Clouds. Part II: Testing …opensky.ucar.edu/islandora/object/articles:11950... · 2020. 4. 24. · Ice in Clouds Experiment–Layer Clouds. Part

Franchising with the world’s favorite convenience store is ... · Let’s talk franchising. Brand strength: It’s turnkey: Technology: Gross profit split: Faster start-up: Ongoing

Storm clouds. Cumulonimbus clouds Cold rain process

PRINT FASTER, LOWER COST, BOOST PROFIT

The aim of FASTER (FAst-physics System TEstbed and Research) is to evaluate and improve the parameterizations of fast physics (involving clouds, precipitation,

types of clouds. Different kinds of clouds lead to ... · Different kinds of clouds lead to different types of weather. Cirrus clouds are the highest group of clouds that form above

The invigoration of deep convective clouds over the ...€¦ · undetectable clouds (the abovementioned small clouds or clouds with weak optical signature) decreases as a function

Better . Faster . Cheaper - Cryptotvplus...Better . Faster . Cheaper Bantu The Bantu Blockchain Foundation (BBF) is a non-profit entity that develops blockchain-based financial inclusion

Faster than ever - Graphisoftand the creation of a digital building model. But now 3D scanners – representing the latest technology innovations – can generate “point-clouds”

Image-Error-BasedLevel of Detail for Landscape Visualization€¦ · model, our method is two times faster than billboard clouds. Categories and Subject Descriptors (according to

Why do clouds turn gray? CLOUDS - mrspruillscience€¦ · Stratus Clouds Stratus clouds are uniform grayish clouds that often cover the entire sky. They resemble fog that does not

Clouds - Metlink...Cirrus made by an aeroplane (aircraft contrail cirrus) Clouds Cumulus 1 Clouds Cumulus 2 Clouds Cumulus 3 Clouds Nimbostratus Clouds Nimbostratus with rainbow Clouds

Cloud connectivity and the importance for a working ecosystem … · 2019. 10. 30. · Hyperscalers are growing faster than „Private Clouds“ Hyperscalers will cover most of workloads,

More, Better, Faster! Agile Design for Fun & Profit