46
Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1. Grab a Worksheet and instructions 2. Did you do the pre-work? A. Are you able to login to the GENI Portal? Using your home institution username and password, or Using a GPO issued username and password, or A temporary account B. Are you running the ICDCS13 Tutorial VM including both: VirtualBox ICDCS13 Tutorial VM image GENI Portal is at: http:/ /portal.geni.net

Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Embed Size (px)

Citation preview

Page 1: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 1ICDCS13: July 8, 2013

Are you ready for the tutorial?

1. Grab a Worksheet and instructions

2. Did you do the pre-work?A. Are you able to login to the GENI Portal?

• Using your home institution username and password, or• Using a GPO issued username and password, or• A temporary account

B. Are you running the ICDCS13 Tutorial VM including both:• VirtualBox• ICDCS13 Tutorial VM image

GENI Portal is at:

http://portal.geni.net

Page 2: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation

Tutorial: Getting Started with GENI

- Part I

Niky Riga,

GENI Project Office

8 July 2013

Page 3: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 3ICDCS13: July 8, 2013

Hands On Exercise

Do a Simple Layer 2 Experiment in GENI

Reserve two VMs connected at Layer 2

Layer 2VMVM

Page 4: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 4ICDCS13: July 8, 2013

Understand GENI Terminology

slice project

aggregate

experimenter

resource

Page 5: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 5ICDCS13: July 8, 2013

Use the GENI Portal and Flack

Page 6: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 6ICDCS13: July 8, 2013

Experiment Workflow• Part I: Design/Setup

• Part II: Execute

• Part III: Finish

Page 7: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 7ICDCS13: July 8, 2013

The GENI Portal is…

A web-based tool for experimenters to manage

experimenters, projects, and slices.

Includes simple tools to reserve resources.

More to come in the future.

Page 8: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 8ICDCS13: July 8, 2013

Flack is …

A graphical user interface (GUI) for: – designing topologies in GENI– reserving resources in GENI

Page 9: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 9ICDCS13: July 8, 2013

Experimenter

An experimenter is a researcher who uses GENI resources

Different types of experimenters have different roles and permissions:• Advisor vs Grad Student• Teacher vs TA vs Student Experimenter

Page 10: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 10ICDCS13: July 8, 2013

Projects

Projects organize research in GENI

Project

Lead

Members

Slice

Projects contain both people and their experiments

A project is led by a single responsible individual: the project lead

Page 11: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 11ICDCS13: July 8, 2013

Creating Projects• Only project leads can create projects.• Project names are public, unique and

permanent• A project may contain many experimenters;

an experimenter may be a member of many projects

• Projects have an optional expiration (e.g. for classes, tutorials)

For today’s tutorial we will all join a project which expires in about a week

Page 12: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 12ICDCS13: July 8, 2013

Experiment Workflow• Part I: Design/Setup

• Part II: Execute

• Part III: Finish

Page 13: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 13ICDCS13: July 8, 2013

Part I: Establish Management Environment

1 Pre-work: Design your experiment

2.1 Pre-work: Login to the Portal

2.2 Pre-work: Project lead adds you to project

Project Name: ICDCS13

2.3 Generate and Download SSH KeypairTutorial instructions:http://groups.geni.net/geni/wiki/Tutorials/ICDCS2013/GettingStartedWithGENI_I/Procedure

Page 14: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 14ICDCS13: July 8, 2013

Creating a GENI account

• GENI Portal is at:

https://portal.geni.net

• Anyone with an account at a supported identity provider (usually your school or employer) can log in, but they will have no privileges

• If you don’t have such an account, we will make you an account at the GPO Identity Provider

• You must be a member of a project to do anything interesting

Page 15: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 15ICDCS13: July 8, 2013

InCommon

For many experimenters:• no new passwords• familiar login screens

Leverage InCommon forsingle sign-on authentication

Experimenters from 304 educational and research institutions have InCommon accounts

Page 16: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 16ICDCS13: July 8, 2013

Using ssh with a public/private keypair

Login to all GENI compute resources using

ssh with a private key

1. The public key is loaded onto the node when you reserve resources.

2. You provide the private key when you log into the node.

There are several ways to offer your private key to ssh.

You should never be prompted for a password to log into a GENI compute node.

If you are, something has always gone wrong.

No password!

Page 17: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 18ICDCS13: July 8, 2013

Expiration and renewal

slice expiration time ≤ project expiration time

each resource expiration time ≤ slice expiration time

each resource expiration time ≤ aggregate’s max expiration

project

slice

resource

(optional)project

expiration timeslice

expiration timeresource

expiration timenow

In general, to extend the lifetime of your resource reservation, you must renew the slice and all resources

resourceresource

Page 18: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Projects

Slices

Log Messages

Profile

You are here

Help

Page 19: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Generate SSH Keys2

Login

Join Project

Page 20: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

In your local VM …

> mv ~/Downloads/id_geni_ssh_rsa ~/.ssh/.> chmod 600 ~/.ssh/id_geni_ssh_rsa> ssh-add ~/.ssh/id_geni_ssh_rsa

2

Page 21: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 22ICDCS13: July 8, 2013

Resource

A resource is a piece of infrastructure

A resource can be real or virtual.

Resource specifications are used to describe and request resources.

Examples:• Compute: computer vs virtual machine (VM)• Wireline Network: VLAN or OpenFlow• Wireless: WiMAX

Page 22: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 23ICDCS13: July 8, 2013

Aggregate

An aggregate manages a set of reservable resources

Aggregates include:GENI racks

OpenFlow

WiMAX

InstaGENI Rack ExoGENI Rack

Page 23: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 24ICDCS13: July 8, 2013

Slice

A slice is a container of resources used in an experiment.

A slice can contain resources from one or more aggregates

A slice is in a single project

A slice has an expiration

Slice names are public, reusable and unique

Page 24: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 25ICDCS13: July 8, 2013

Experimenter

Putting it all together

slice

aggregate

project Member:Lead:

Experimenter

Layer 2resourceresource

Page 25: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 26ICDCS13: July 8, 2013

slice

Part I continued:Obtain Resources

3.1 Create a slice

3.2 (optional) Renew your slice

3.3 Reserve two VMs and a link

3.4 Check Whether VMs are Ready to be Used

Layer 2VMVM

Page 26: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Create Slice

3.1

Page 27: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Extend slice expiration3.2

Page 28: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

LaunchFlack

Extend slice expirationExtend resource expiration

3.3

Page 29: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

LaunchFlack

username slice name

all availableaggregates

3.3

Page 30: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Draw two VMs connected by a link

3.3

Page 31: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Change names of VMs

3.3

Page 32: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Reserve resources

3.3

Page 33: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Resources are READY!!!

3.4

Page 34: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 35ICDCS13: July 8, 2013

Experiment Workflow• Part I: Design/Setup

• Part II: Execute

• Part III: Finish

Page 35: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 36ICDCS13: July 8, 2013

Part II: Execute Experiment

4.1 Login to nodes (two nodes: client & server)

4.2 Download and compile pingPlus

5 Run your experiment5.1 Send IP Traffic

5.2 Disable IP and send Layer 2 (non-IP) Traffic

6.1 Logout of nodes

Internet

Data Interfaces

Control Interfaces

ssh

Layer 2

Experimenter

serverclient

Page 36: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Login4.1

Page 37: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

$ wget …/pingPlus-0.2.tar.gz$ tar xvfz pingPlus-0.2.tar.gz$ cd pingPlus-0.2 $ make

$ /sbin/ifconfig

$ wget …/pingPlus-0.2.tar.gz$ tar xvfz pingPlus-0.2.tar.gz$ cd pingPlus-0.2 $ make

$ /sbin/ifconfigserver

client

4.2

5.1

Page 38: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Worksheet

Client

Control Interface

Name eth ___

IP Address __ . __ . __ . __

Data Interface

Name eth ___

Initial IP Addr 10 . __ . __ . __

Des IP Addr 10 . 18 . 1 . 1 /24

Server

Control Interface

Name eth ___

IP Address __ . __ . __ . __

Data Interface

Name eth ___

Initial IP Addr 10 . __ . __ . __

Des IP Addr 10 . 18 . 1 . 2 /24

MAC Address __ : __ : __ : __ : __ : __

Project Name: ICDCS13

Slice Name: portal01

EtherType: 18001

5.1

Page 39: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

# configure your IP

$ sudo /sbin/ifconfig mv10.1 10.18.1.1/24

# should SUCCEED$ ping 10.18.1.2 –c 5

# disable IP on your nodes

$ sudo /sbin/ifconfig eth1726 0.0.0.0

# should FAIL$ ping 10.18.1.2 –c 5

# start L2 client$ sudo pingPlus 01:02:03:04:05:06 eth1726 18001

$ exit

# configure your IP $ sudo /sbin/ifconfig mv2.3 10.18.1.2/24

# disable IP on your nodes$ sudo /sbin/ifconfig eth1726 0.0.0.0

# start L2 server

$ sudo pingPlusListener 18001

$ exitserverclient

5.1

5.2

6.1

Page 40: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 41ICDCS13: July 8, 2013

Experiment Workflow• Part I: Design/Setup

• Part II: Execute

• Part III: Finish

Page 41: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 42ICDCS13: July 8, 2013

Part III: Finish Experiment

When your experiment is done, you should always release your resources.

– Normally this is when you would archive your data– Delete your resources at each aggregate

sliceproject

aggregateexperimenter

resource

Page 42: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Delete Resources

7

Page 43: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 44ICDCS13: July 8, 2013

Congratulations!

You have…–Run your first GENI Experiment!–Exercised your knowledge of GENI

terminology–Used the GENI Portal and Flack

Page 44: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 45ICDCS13: July 8, 2013

What’s Next?

• (If needed) Request a permanent account

• Are you a Professor or PI? – Ask to be a Project Lead so you can create projects

– Invite students to join your project

• Are you a Student?– Ask your professor to create a project – Request to join that project

Keep experimenting!

Page 45: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 46ICDCS13: July 8, 2013

Learn about other tools

• Tools that are integrated with the Portal– Flack GUI is linked on each slice page– Omni command line tool (config linked on bottom of Profile page)

• Next tutorial

– GEMINI/GENI Desktop is an Intrumentation and Measurement tool

• Get help after ICDCS– [email protected] (Niky and Vic)

Page 46: Sponsored by the National Science Foundation 1 ICDCS13: July 8, 2013 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the

Sponsored by the National Science Foundation 47ICDCS13: July 8, 2013

Welcome to GENI!