Nephelae’s Cloud

Nephelae’s Cloud

Papadopoulos Andreas

Presentation OutlineDefinition of Cloud ComputingCloud Computing StackOpen Source Cloud Computing Software

PlatformsNephelae’s ConfigurationEucalyptusHow to use Nephelae’s infrastructureDemostration

Definition of Cloud Computing“Cloud computing is Internet-based computing, whereby

shared resources, software and information are provided to computers and other devices on-demand, like electricity” (Wikipedia)

“Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.” (NIST)

Cloud Computing Stack

Software As A Service - SAASA complete application is offered to the

customer, as a service on demandA single instance of the service runs on the

cloud and multiple end users are servicedCustomers' side: no need for upfront

investment in servers or software licensesProviders' side: the costs are lowered, since

only a single application needs to be hosted and maintained

SaaS offered by Google, Salesforce, Microsoft, Zoho, etc.

Platform As A Service - PAASA layer of software, or development

environment is encapsulated and offered as a service

The customer has the freedom to build his own applications, which run on the provider's infrastructure

PaaS providers offer a predefined combination of OS and application servers, such as LAMP platform, restricted J2EE, Ruby etc.

PaaS example: Google's App Engine, Force.com etc.

Infrastructure As A Service - IAASIaaS provides basic storage and computing

capabilities as standardized services over the network

Servers, storage systems, networking equipment, datacenter space etc. are pooled and made available to handle workloads

The customer would typically deploy his own software on the infrastructure.

IaaS examples: Amazon, GoGrid, 3 Tera etc.

Anything As A Service - *AAS

Impact of Cloud Computing – IT organization governance

Open Source Cloud Computing Software Platforms

Eucalyptus (also commercial version available)

OpenNebulaNimbusCloudStackOpenStackOpenQRM…

Nephelae’s ConfigurationNephelae runs Ubuntu Enterprise Cloud

Ubuntu Server 11.10Open source eucalyptus 2.0.2

KVM

Started as a research project in the Computer Science Department at the University of California, Santa Barbara

Based on open-source software components that are used without modification

Compatible with Amazon's EC2, S3, and EBS interfaces

Hypervisors supported: KVM, Xen and VMware (only enterprise edition)

Eucalyptus Architecture

Nephelae Architecture CPU Model CPU

sTotal Cores

Total RAM (GB)

Storage Capacity (TB)

Cloud Controller - Walrus

[email protected] 2 8 74 1.6

Cluster and Storage Controller


Node Controller 1


Node Controller 2


Node Controller 3


Node Controller 4


Node Controller 5

[email protected] 2 12 24 460GB

Eucalyptus ArchitectureCloud Controller (CLC)

ClC is a collection of three web services Resource Services

Manipulation and monitoring of the system component and virtual machines and network Data Services

Managing of the persistent user and system data Interface Services

Authentication protocol translation User-visible interfaces

Cluster Controller (CC) Schedule incoming instance run requests to specific NCs, FCFS depending on

VM-type Control the instance virtual network overlay Report information about NCs

Node Controller (NC) NC is executed on every node that is designed for hosting VM It discovers the characteristics of the physical resource It replies to describeResource, describeInstances, runInstance,

terminateInstance requests

WalrusStorage controllerEucalyptus users can stream data into/out of the cloudStorage service for VM

compressencrypt split cache

Implements REST (via HTTP) SOAP style of software architecture for distributed hypermedia systems such as the World Wide Web.

Block Storage (BS)Compatible with Elastic Block Store, BS

allows volumesCreation (from snapshot)MonitoringAttaching DetachingDeletion

Eucalyptus Virtual Network OverlayEucalyptus provides four network configurationsSYSTEM: VMs request IP address trough DHCP

requests STATIC: MAC ↔ IP address tupleMANAGED: VM attached to a specific network

(private or public)Isolation

MANAGED NO-VLAN: Same as MANAGED without vlan support

Nephelae is configured in SYSTEM mode

How to use Nephelae’s Infrastructure - Outline

Create an account Download and install credentials Install euca2oolsStart-up instancesAttach volumesUse Walrus storageShutting-down instances

Create an account Use the Eucalyptus Web Interfaces at

https://Nephelae.in.cs.ucy.ac.cy:8443 /

On the Login page click on Apply for account.On the next page that pops up fill out ALL the

Mandatory AND optional fields of the form. Once complete click on signup and the Eucalyptus

administrator will be notified of the account request.You will get an email once the account has been

approved.Click on the link provided in the email to confirm and

complete the account creation process.

Downloadcredentials

Download your credentials as a zip file from the web interface for use with euca2ools

Use credentials Save this credential file euca2-

{username}-x509 and extract it for local use

Source the eucarc file using the command source eucarc

mkdir ~/.eucacd ~/.eucaunzip euca2-{username}-x509.zipchmod 0700 ~/.eucachmod 0600 ~/.euca/*

source ./eucarc

Install euca2oolsEuca2ools are the command line

clients used to interact with Eucalyptus.

Download euca2ools from http://open.eucalyptus.com/downloads

Instructions for various Linux platforms are available on the download page.

Create your KeypairCreate a keypair and add the public key to

eucalyptus.$ euca-add-keypair mykey | tee mykey.private$ chomd 0600 mykey.private

List your existing keypairs$ euca-describe-keypairs

Start-up instancesTesting your setup

Use euca-describe-availability-zones to test the setup.

List existing images

$ euca-describe-availability-zones AVAILABILITYZONE NephelaeCC1 NephelaeCC

$ euca-describe-images

IMAGE emi-E240106D debian/debian.5-0.x86-64.img.manifest.xml admin available public x86_64 machine eki-4A8E123C eri-83C01326IMAGE emi-C9A8102E centos/centos.5-3.x86.img.manifest.xml admin available public i386 machine eki-36321225 eri-6DF012FE instance-storeIMAGE emi-485F121D ubuntu-9.04/ubuntu.9-04.x86-64.img.manifest.xml admin available public x86_64 machine eki-8F121374 eri-CB0D1458 instance-storeIMAGE emi-C9CD1067 ubuntu11/ubuntu_11__.img.manifest.xml admin available public x86_64 machine eki-559B1299 eri-8EE4137F instance-store………

Start-up instancesSelect image and run

$ euca-run-instances -k mykey -n 1 emi-C9CD1067 -t c1.medium

View status of your instances$ euca-describe-instances

Availability ZonesVMType Ma

xCPU

(#cores)

Ram (MB)

Disk (GB)

m1.small 88 1 256 2c1.mediu

m88 1 512 5

m1.large 44 2 1024 10m1.xlarg

e44 2 2048 20

Connect to your instancesView the ip address of your instance using

$ euca-describe-instancesConnect as root with ssh

$ ssh –i mykey.private [email protected]

Install your programsChanges will be lost on shutdown (halt) or

terminate

Use BS - Attach volumesPersistent StorageCreate volume using:

$ euca-create-volume –-size 5G –-zone NephelaeCC1Attach Volume to instance

$ euca-attach-volume –i instanceId –d vda volumeIDUse fdisk to create primary partition

vm$ fdisk /dev/vdaCreate filesystem with mkfs

vm$ mkfs.ext3 /dev/vdaMount locally with mount

vm$ mkdir /ebs ; mount /dev/vda1 /ebsUnmount and detach when done

vm$ umount /ebs $ euca-detach-volume volumeID

Use Walrus storageDownload s3cmd 0.9.8.3Get patch from eucalyptus siteCreate your config file to include your

SECRET and ACCESS key (from eucarc) and Nephelae host

Use s3cmd to create/delete/upload/download to/from walrus$ s3cmd -c s3cfg.walrus mb s3://BUCKET$ s3cmd -c s3cfg.walrus put FILE [FILE...]

s3://BUCKET[/PREFIX]S3cmd can also be installed on a vm

Shutting-down instances Unmount and detach any volumes

Log out from the vm$ euca-terminate-instance instanceId

User Limits1 bucket maximum size 30Gb1 block storage maximum size 30Gb

No instances limit

Demo

Nephelae’s Cloud

Papadopoulos Andreas

Thank you

http://grid.ucy.ac.cy/Nephelae/

Documents

Nephelae’s Cloud