Rally certification at Scale

Boris Pavlovic & Jesse Keating

Agenda

● Who/Why/Where● Rally demo● Cloud certification● Current progress● Future efforts● Q/A

OpenStack testing before Rally

What is Rally?

KISS4ever

★ Simple to get★ Simple to understand★ Simple to configure★ Simple to work ★ Simple to extend ★ Simple to contribute

Rally: Workflow

Rally: 0-60 under 3● Debian

apt-get install rally (Debian only)

● Sourcecurl https://raw.githubusercontent.com/openstack/rally/master/install_rally.sh | bash

● Dockerdocker pull rallyforge/rally && docker run rallyforge/rally

● Muranohttps://github.com/openstack/murano-apps

● Simple waysource openrc && rally deployment create --from-env --name your_cloud

● Hardcore way{

"type": "ExistingCloud",

"auth_url": "http://example.net:5000/v2.0/",

"region_name": "RegionOne",

"endpoint_type": "public",

"admin": {

"username": "admin",

"password": "pa55word",

"tenant_name": "demo"

},

"users": [...]

}

rally deployment create --file that_file_above.json --name your_cloud

s

Rally: 0-60 under 3

Rally: 0-60 under 3● Run the task

rally task start ./samples/nova/boot-bounce-delete.json

● Generate reportsrally task report --out report.html

Rally task format NovaServers.boot_and_delete_server:

-

args:

flavor:

name: "m1.tiny"

image:

name: “.*ubunut.*”

runner:

type: "constant"

times: 3

concurrency: 3

context:

users:

tenants: 3

users_per_tenant: 2

sla:

failure_rate:

max: 0

Rally in nutshell - demo

RallyDEMO

Rally as a cloud cert tool Blue Box Cloud use of Rally● New Cloud Deployment

o SLA validationo Functionality of whole system, including non-openstack

● New deployment tool releaseso Regression protectiono New feature validation

● New feature / configuration explorationo Does it work?o Does it impact performance or SLA?

Cloud certification pyramid

Make it even simpler?

Define certification task● Create certification WG

o Specify set of arguments that accept task amount of users/tenants/controllers/computes type of cloud workloads quality of hardware …

o Specify set of parameterized tests in tasks scenarios loads slas

Future steps ● Involve

o more core reviewerso more operators o more companies

Who is using Rally?

Thanks http://stackalytics.com for graphs

All time● > 30 companies● > 140 devs● ~ 1200 commits● ~ 2 years of dev

Kilo● 25 companies● > 80 devs● > 380 commits

Q/ABoris Pavlovic - Mirantis:

boris[at]pavlovic.me@PavlovicBorishttps://github.com/boris-42

Jesse Keating - BlueBox:jlk[at]bluebox.net@iamjkeatinghttps://github.com/j2sol