ORCA OverviewLEARN Workshop

Ilia Baldine, Anirban Mandal

ibaldin@renci.org, anirban@renci.org

Renaissance Computing Institute, UNC-CH

2

Overview

• Cloud technologies (IaaS)• ORCA overview• Putting it all together• Demo

• Open source and supported• Runs at 1000s of sites w/ Xen, KVM, etc.• Amazon/EC2 compatible (“standard”)

4

XCat (Extreme Cloud Administration toolkit)

• Open-Source with support from IBM• Highly-scalable (up to 30,000 nodes)• Flexible• Support for bare metal provisioning and

virtualization• Non standard highly extensible remote interface

5

Using clouds for network experiments

• Advantages:– Published remotable interfaces– Multi-use infrastructure

• Utility computing• Cloud applications• IaaS• Experimentation

– Makes easier to convince substrate owners to contribute resources to GENI

• Key requirement– Ability to embed a topology into one or more cloud sites

• Possible with XCat • Not possible with stock Eucalyptus

6

Eucalyptus Network Extensions

• NEuca (pronounced nyoo-kah) - extensions to Eucalyptus that permit– Creating and configuring virtual machines with multiple network interfaces

attaches to VLANs or physical interfaces on the host node– Perform arbitrary post-boot actions on guest VMs

• Implemented as a set of patches for Eucalyptus 2.0.[02] and guest-side tools pre-loaded on the image (Linux derivatives supported)

• Permits using Eucalyptus-manage interface for management, while using high-performance separate backplane for data communications

• Developed as part of the larger initiative in enabling science applications on clouds– NSF SDCI award #1032573

• Does not affect the normal functionality of a private Eucalyptus cloud– In GENI context network experiments can coexist with computational work in

a private cloud

http://www.networkedclouds.org

7

Overview

10

What it is good for

• Institutional general purpose cloud infrastructure• Well-established APIs• Overflow capacity from Amazon EC2

• Using well-established Amazon EC2 API for network experiments

11

Network resources

• BEN – Breakable Experimental Network– Optical metro testbed connecting RENCI, UNC-CH, Duke and

NCSU– Equipped with optical switches, DWDM, switches and routers– Several Xcat/Eucalyptus clusters (departmental or RENCI-owned)– Deeply programmable, reconfigurable

• NLR– Sherpa dynamic VLAN API

• Internet2– ION MPLS-based VLAN service

• ESNet– OSCARS VLAN service

BEN

• BEN: Breakable Experimental Network– Dark fiber interconnecting RENCI, UNC, Duke and NCSU campuses– Unique testbed for developing disruptive

distributed technologies– Managed by RENCI for Triangle Universities

• Multi-layered, high-performance (multiple 10Gbps), dedicated to research– L2 switches, routers– OpenFlow switches

• Connection to FrameNet– Working on connection to ION

• PerfSONAR MPs for optical layer properties– GEC10

• Controlled by ORCA software – A framework for distributed computational,

network substrate orchestration

12

13

Network

Where does ORCA fit?

Application

Resource Provisioning Middleware

Compute Storage

ORCA

OSCARSSherpa

GENI experiment control tool

BEN SA

ORCA BENMulti-layeredprovisioning

XCat

Eucalyptus

Middleware API

Substrate APIsGENI AM APIs

Walrus

14

Operators

ORCA Actors

Broker(CH)

ticket

redeem

lease

Authority/AM

delegateSlice

Manager(SM)

request

XML – RPC

ORCA Server (Actor) Roles

JavaWeb portal

Webportal

Webportal

Users and

tools

Substrate owners

18

ORCA Key facts

• Lease-based transactions between actors– Traceable, verifiable

• Inherently distributed, without centralized control– Multiple configurations possible

• Using Semantic Web tools and mechanisms for resource descriptions

• Extensible– New resource management policies– New drivers

• Recently developed Cisco3400 (UofH), OpenFlow

– New controllers• GENI-compliant controller based on XMLRPC

19

ORCA Tools

• Actor registry• Resource description format converter• Client-side XMLRPC tools

20

ORCA near-term feature roadmap

• Image Proxy (by GEC10)• GENI AM API Interoperability (by GEC10)• Shibboleth + ABAC (by GEC11)• ION support (GEC11)• Full protoGENI interoperability (GEC11)• Multi-site embedding• L3 slice peering• Advanced scheduling

Presentation title goes here 21

ORCA Demo

• Embedding a topology into a cloud at a single site

• Giving researcher access to instantiated VMs

22

Embedding Triangle Topology

vlan 2

vlan 4vlan 3

eth1: 10.100.10.34eth2: 10.100.30.34

eth1: 10.100.30.35

eth2: 10.100.20.36

eth1: 10.100.10.36

eth2: 10.100.20.35