GoDaddy's OpenStack Journey

GODADDY OVERVIEWNOV 2016

OpenStack at ScaleFebruary 9th, 2017GoDaddy's OpenStack Journey

Copyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved.

1

Where we startedCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved.

OpenStack (late 2013 now())

Strategic bet on open source!

A nice, active, larger and bountiful community

Deploying started soon thereafter

Missing some key functionality (but getting better)

Our cloudsCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. *2x the above (for public cloud and private cloud)

Ensure to denote that there is double the amount of the above.

The tech we use (and operate and make sure works) is all of the above.3

Our sizeCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. VMsHVs16,000+2000+

VMsHVs1,900+260+

~2017~2013 (vmware)

Our layoutCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. Highlights

One of the first adopters of nova cells v1

Network design not detailed here (should be other presentations/talks that you can find online about that).5

Our journey (so far)Copyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved.

Packaging

Deployment

Scale

Operational best practices

Keeping involved and engaged

(and more)

PackagingCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. Old: partially hand generated rpmsError prone and fragile

New: machine generated docker imagesGithub integrated Slack integratedAuto-built via jenkins jobsAuto-pushed to artifactoryAuto-pulled from thereafter for deployment

+

+

+

+

Kolla

+


Nifffty!



DeploymentCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved.

Old: hand-driven puppet with a sprinkling of ansiblePeer review and pray

New: moving to continuous automation (and eventual CD)Takes advantage of docker images to mitigate fragilityInteractions audited and tracked by command and controlEliminates the (faulty) person-behind-the-keyboardHeavily ansible based (also slack integrated)Interacts with tool agnostic cloud topology (yaml) format+

+

+

+


Cloud at scale - lessons learnedCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. Beginners:Devstack

Intermediate (but still easy):Operating a small cloud (less than 100 nodes)Deploying a small cloud (even by hand/high touch)

Advanced (not easy):Operating multiple clouds (multiple thousands of nodes/VMs)Hand-crafted deployment no longer just worksTransitioning from high touch to low touch is requiredBeing involved (upstream) while doing this

Transition from high touch to low touch the earlier the better

Operational best practicesCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. Do not create distribution packages

Containerization even used minimally is worth it

Attend the #openstack-operators meetings

Incorporate reoccurring questions into the product

Education - ephemeral nature of the cloud

Balance downstream and upstream carefully

Educate your users about ephemeral nature of OpenStack VMs - especially if transitioning from VMWare.

Immutability (configs and code).

Incorporate reoccurring questions into the product - prevents live support burden.14

Community involvementCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved. Not so easy staying involved while building operations/automation/deployments.But we manage!

Things we want to work onCopyright 2016 GoDaddy Inc. 14455 N. Hayden Road Scottsdale, Arizona 85260 (480) 505-8800 All Rights Reserved.

Less complicated upgrades & deployments

Self-healing

Scale & performance

Less complicated networking/compute/ APIs

Better resource cleanup

Discoverable API endpoints

(and more, partner with us!)

We are hiring!!!We are hiring!!! x.co/openjobs

For OpenStack:

Neutron + SDN expertsNova expertsEngineers passionate about automating operations

Mailto: [email protected]

Find: Stephen Hoffman (in the back)

17

2017 GoDaddy Inc.

Thanks for coming!

18

We are hiring!!!

19

Technology

GoDaddy's OpenStack Journey