Eduardo CastillejoBig Data Architect

Service Orchestration andMetal as a Service

with Juju and MAAS

… but it’s more...

Problem(s)

● Wrong assumptions: ○ We usually consider a solution for one client / project○ Let’s be realistic, talking about Big Data still produces suspicion

in many forums● Consequence #1: We lose valuable time, not just in explaining

ourselves, but also in developing, maintaining and configuring Big Data infrastructures

● Consequence #2: We usually lack of real solutions and / or BI infrastructure to show to our clients

● A possible solution:○ A common service

infrastructure to deploy the necessary tools and projects ■ Project independant

○ A realistic capability of doing dynamic deployments

○ Instantly provable

● A possible solution:○ A common service

infrastructure to deploy the necessary tools and projects

○ But… how?

Juju allows software to be quickly deployed, integrated and scaled on a wide choice of cloud services or servers.

Juju is a software solution which provides service orchestration

○ It allows the deployment and the maintenance capabilities of services, called charms

Juju allows software to be quickly deployed, integrated and scaled on a wide choice of cloud services or servers.

Juju allows software to be quickly deployed, integrated and scaled on a wide choice of cloud services or servers.

Juju allows software to be quickly deployed, integrated and scaled on a wide choice of cloud services or servers.

Common servers, private and public clouds, etc.

Juju allows software to be quickly deployed, integrated and scaled on a wide choice of cloud services or servers.

https://demo.jujucharms.com/

Why Juju?

● Let’s keep talking about this: ○ So… with Juju we

somehow “cover” the service infrastructure problem...

● Let’s keep talking about this: ○ So… with Juju we

somehow “cover” the service infrastructure problem…

○ … but what about the real hardware infrastructure?

● Let’s keep talking about this: ○ So… with Juju we

somehow “cover” the service infrastructure problem…

○ … but what about the real hardware infrastructure?■ How do we manage our

servers or cloud?■ Where are the Juju charms

going?

● Let’s keep talking about this: ○ So… with Juju we

somehow “cover” the service infrastructure problem…

○ … but what about the real hardware infrastructure?■ How do we manage our

servers or cloud?■ Where are the Juju charms

going?

A “less” virtual perspective

● Let’s keep talking about this: ○ So… with Juju we

somehow “cover” the service infrastructure problem…

○ … but what about the real hardware infrastructure?■ How do we manage our

servers or cloud?■ Where are the Juju charms

going?

MAAS (Metal As A Service) is a tool that helps you manage your physical infrastructure with the same ease and flexibility as virtual machines in the cloud

Watch the video

● With MAAS we can:○ Discover and deploy physical servers○ Dynamically re-allocate physical

resources to balance current workloads○ Online physical ecosystem monitoring○ On demand requirements can be

dynamically covered○ Deploy different SO...○ …

We work with our physical infrastructure with the same ease and flexibility as

virtual machines in the cloud

MAAS Architecture1. Region Controller: A region controller consists of:

● REST API server (TCP port 5240)● PostgreSQL database● DNS● caching HTTP proxy● web UI

2. Rack Controllers: A rack controller provides:● DHCP● TFTP● HTTP (for images)● iSCSI● power management

3. Nodos: A node is a general term that refers to multiple, more specific objects. Basically, it is a networked object that is known to MAAS.Nodes include:

● Controllers● Machines● Devices

● 1 Region Controller (WebUI, DNS Server, API, Metadata Server)

● N Cluster Controllers, which control provisioning and the power on-off of the machines (TFTP Server, DHCP Server)

● M Nodes

Fuente: https://linux.dell.com/files/whitepapers/Deploying_Workloads_With_Juju_And_MAAS-14.04LTS-Edition.pdf

MAAS Deployment

Fuente: https://docs.ubuntu.com/maas/2.1/en/

MAAS Deployment

MAAS in action

https://maas.io/static/media/screen-grabs/homepage-ui2.gif

+

Services: Juju

Metal: MAAS

Summary

● In Pre-sales:○ Real capabilities○ We focus on flexibility through infrastructure, showing that we can

actually work fast○ Open source○ Commodity-hardware○ Highly customizable○ Compatible with ad-hoc solutions○ Easy-in-deploy, Easy-in-maintenance

Summary

● In IT:○ Dynamic solutions deployment○ Make the most of “humble” machines○ Remote control (MASS WebUI + Juju WebUI)○ Delegate:

■ Service configuration -------------> Juju■ Infrastructure configuration ---> MAAS

○ On demand growth or shrinking

Thanks!