GENI Exploring Networks of the Future Niky Riga, GENI Project Office ([email protected])

Sponsored by the National Science Foundation

GENIExploring Networks of the Future

Niky Riga, GENI Project Office([email protected])

www.geni.net

Sponsored by the National Science Foundation 2GENI Introduction – NTUA 17 February 2014 www.geni.net

Outline

• GENI – Exploring future internets at scale• The GENI Concept• Building GENI• Experimental and Classroom use of GENI• GENI: An experimenter’s view


Credit: MONET Group at UIUC

Society IssuesWe increasingly rely on

the Internet but are unsure we can trust its

security, privacy or resilience

Science IssuesWe cannot currently

understand or predict the behavior of complex,large-scale networks

Innovation IssuesSubstantial barriers to

at-scale experimentation with new architectures, services,

and technologies

Global networks are creatingextremely important new challenges


GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.


GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.


Multiple GENI Experiments run Concurrently

Resources can be shared

between slices

Experiments live in isolated “slices”


GENI is “Deeply Programmable”

I install software I want throughout my network slice (into routers, switches, …) or control

switches using OpenFlow

Experimenters can set up custom topologies, protocols and switching of flows


GENI Compute Resources

GENI Racks

Existing Testbeds(e.g. Emulab)

GENI Wireless compute nodes


GENI Networking Resources

Networking within a Rack

National Research Backbones(e.g. Internet2)

Regional Networks(e.g. CENIC)

WiMAX Base Stations


Outline



“I have a great idea.”

“That will never work.”

A bright idea


Let’s try it out!

My new architecture worked great in the lab, so now I’m going to try a larger experiment for a few months.

He uses a modest slice of GENI, sharing its infrastructure with many other concurrent experiments.


It turns into a really good idea

His slice of GENI keeps growing, but GENI is still running many other concurrent experiments.

This service looks very useful


“Looks like an app to me.”

“It’s my very own GENI slice.”

Attracts real users


“Boy did I learn a lot!”

“What a cool service.”(I wonder how it works.)

“I always said it was a great idea.”

(But way too conservative.)


??


Moral of this story

GENI is meant to enable . . .– At-scale experiments– Internet-incompatible experiments– Both repeatable and “in the wild”

experiments– ‘Opt in’ for real users– Instrumentation and measurement

tools

GENI creates a huge opportunity for ambitious research!


Outline



Growing GENI’s footprint


FederationGENI grows by GENI-enabling heterogeneous infrastructure

Avoid technology “lock in” and grow quickly by incorporating existing infrastructure

Backbone #1

Regional

GENI Rack

GENI Rack

Access#1

CommercialClouds

CorporateGENI suites

Non-USTestbeds

ResearchTestbed

Campus

My experiment runs acrossthe evolving GENI federation.

My GENI Slice

This approach looks remarkably familiar . . .


“At scale” GENI prototype

Campus photo by Vonbloompasha

Build GENI at sufficient scale

Infeasible to build a testbed as big as the Internet

GENI-enabled campuses,students as early adopters

HP ProCurve 5400 Switch

NEC WiMAX Base Station

GENI-enabledequipment

GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks


GENI architecture

• Flexible network / cloud research infrastructure

• Also suitable for physics, genomics, other domain science

• Support “hybrid circuit” model plus much more (OpenFlow)

• Distributed cloud (racks) for content caching, acceleration, etc.

MetroResearch

Backbones

InternetISPU N I V E R S I T YU N I V E R S I T Y

U N I V E R S I T YU N I V E R S I T Y

Regional Networks Campus

g

g

gLegend

GENI-enabled hardware

Layer 3Control Plane

Layer 2Data Plane


Toroki LightSwitch 4810

Georgia Tech: a great example

Nick FeamsterPI

Russ Clark, GT-RNOC

Ellen Zegura

Ron Hutchins, OIT

• OpenFlow in 4 GT lab buildings now

• Aware Home

• Students will “live in the future” – Internet in one slice, multiple future internets in additional slices

Trials of “GENI-enabled” commercial equipment

Arista 7124S Switch

HP ProCurve 5400 Switch Juniper MX240 EthernetServices Router

NEC IP8800 Ethernet Switch

NEC WiMAX Base Station HTC Android smart phone

GENI racks


Example regional networkCENIC OpenFlow buildout


GENI on Internet2 A major step towards campus expansion

• Collaboration to implement national-scale infrastructure– sliced and deeply-programmable– incorporating OpenFlow/SDN switches, GENI Racks, etc.– high-speed (10-100 Gbps)

• With software that supports shared use by faculty, students, and campus IT organizations

• In-progress migration from “prototype GENI” to AL2S production system

• Scaling to an envisioned goal of 100-200 GENI campuses

• ION AM to support dynamic provisioning within Internet2


GENI WiMAX Agreements

• Agreement with Clearwire– Clearwire and Rutgers University have signed a master agreement– encompassing all WiMAX sites, to ensure operation in the EBS Band.– An emergency stop procedure, in case of interference with Clearwire

service, has been agreed upon.

• GENI Mobile Virtual Network Operator (MVNO) - Partner with Sprint and Arterra (a Sprint partner) to create and

operate an (MVNO) that serves the academic research community- The effort is led by Jim Martin, Clemson Univ, and is underway with

a 1 year NSF EAGER


Current GENI buildout

• More WiMAX base stationswith Android handsets

• GENI-enable 5-6regional networks

• Inject moreOpenFlow switchesinto Internet2

• Add GENI Racks to 50 locationswithin campuses, regionals, andbackbone networks

GENI Racks serve as programmable routers, distributed clouds, content

distribution nodes, caching or transcoding nodes, etc


Creating and deploying GENI racks

ExoGENI RackInstalled at GPO – Feb 22, 2012

Ilia BaldineRENCIMore resources / rack,fewer racks

Rick McGeerHP Labs

Fewer resources / rack,more racks


GENI WiMAX 2013

• Researcher-owned,• researcher-operated• 4G cellular systems

• 26 Wimax Base Stations in 13 Sites

• Sliced, virtualized and interconnected

On the AirNot On the Air


Federation Extends the Reach of GENI and International Peer Testbeds

Initial plan to federate testbeds on five continents


Testbeds Involved

Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/

GEC18_brecht_vermeulen_International_Federation.pdf


GENI Operations

GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation• Monitors most GENI Aggregates

GMOC Google Calendar keeps track of reservations/outages


GMOC Calendar

ScheduledUnscheduled


Current GMOC Operational Support

• Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale)

• Emergency Stop • GENI Experimenter Support • Manage network/systems alarms, outages, maintenances,

– Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem)

• Notifications, Escalation and Reporting • Engineering configuration (Internet2, MOXI, Indiana) and

new Aggregate site, regional and GENI rack turn-up • GMOC Measurement API for GENI Aggregates • Develop new tools for network monitoring and

measurement Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC

%20Presentation.pdf


GENI Monitoring System

• “Complete” monitoring system functionality motivated by three representative use cases: – LLR inquiry (Legal, Law Enforcement & Regulatory)– Usage and health report– Problem alerting and status

• Components of system needed to support use cases:– Overview of components– Current status (what’s complete, what’s not started, what’s in progress)

More on GENI Operationshttp://groups.geni.net/geni/wiki/GEC18Agenda/RackOpsAndMeasurement


Outline



How is GENI being Used?

Research• Future Internet

architectures• Software defined

networking• Large scale evaluation of

smart grid protocols

Education• Networking and

Distributed systems classes

• Cloud computing classes• WiMAX classes

As of October 2013, GENI had over a 1200 users!


Three FIA Teams have Slices on GENI

GENI is the only testbed that can support these teams.

XIA (demo at GEC15)

NDN (demo at GEC 13)

MobilityFirst (demo at GEC 12 & GEC18)


Multi-radar NetCDF Data

Nowcast Processing

1. Spin up system in Amazon commercial EC2 and S3 services on demand

“raw” live data

Generate “raw” live dataViSE/CASA radar nodes

http://stb.ece.uprm.edu/current.jsp

ViSE views steerable radars as shared, virtualized resourceshttp://geni.cs.umass.edu/vise

Nowcast images for display

Weather NowCastingUniversity of Massachusetts

David Irwin et al

Create and run realtime “weather service on demand”as storms turn life-threatening


Virtual Desktop Cloud

Prasad CalyamUniversity of Missouri

Program realtime load-balancing functionality

deep into the network to improve QoE


GENI in the Classroom

• Undergrad Classes– Reinforce learning of key concepts

• Graduate classes– Hands-on experience of advanced concepts– Project in GENI

• Classes in:– Computer Networking, Wireless and Mobile

Networking, Distributed Systems, Cloud Computing

10-20 classes per semester


GENI at Upcoming Conferences


Outline



Access to GENI

For many experimenters:• no new passwords• familiar login screens

Leverage InCommon forsingle sign-on authentication

Experimenters from 304 educational and research institutions have InCommon accounts

GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.


The GENI Portal is…

A web-based tool for experimenters to manage experimenters, projects, and slices.


For GENI IdP Accounts …

1. Sign up with an institutional email address (ie ntua.gr email) that you have access to

– Forwarding on that email address is ok

2. Reply to follow up email confirming that you made the request – The account creation process can take a couple of days.


GENI: Terms and Definitions

– An experiment uses resources in a slice

– Slices isolate experiments

– Experimenters are responsible for their slices

SliceAbstraction for a collection of resources capable of running experiments


Slice credentials


• Slice authority: Creates and registers slices– GENI slice authorities: PlanetLab, ProtoGENI, GPO Lab

• Aggregate: Provides resources to GENI experimenters– Typically owned and managed by an organization– Examples: PlanetLab, Emulab, GENI Rack on various campuses– Aggregates implement the GENI AM API

Create & Register Slice

Researcher

SliceAuthority

Aggregate Manager API - listResources - createSliver … Aggregate

ManagerAggregate Resources



• Sliver: One or more resources provided by an aggregate– E.g. Bare machines, virtual machines, VLANs

Backbone #1

Backbone #2

Campus#3

Campus#2

Access#1

CommercialClouds

CorporateGENI suites

Other-NationProjects

ResearchTestbed

Campus My GENI Slice

My slice contains slivers from many aggregates.


RSpecs

• RSpecs: Lingua franca for describing and requesting resources– “Machine language” for negotiating resources between experiment

and aggregate– Experimenter tools eliminate the need for most experimenters to

write or read RSpec

<?xml version="1.0" encoding="UTF-8"?><rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node></rspec> RSpec for requesting a single node


Sliver Creation using Rspecs and the AM API

• Advertisement RSpec: What does an aggregate have?• Request RSpec: What does the experimenter want?• Manifest RSpec: What does the experimenter have?

AggregateManager

Client

ListResources(…)

Advertisement RSpec

CreateSliver(Request RSpec, …)

Manifest RSpec

ListResources(SliceName, …)

Manifest RSpec


Putting it all Together: Demo

• 2 Demos– Create a slice– Create a sliver at one

aggregate• Two computers (VMs),

connected by a LAN– Install and run software

on the machines*– View output of software– Delete sliver

• Experimenter tool: Flack

*Second Demo

ServerVM

clientVM


Start Demo

• Login to GENI Experimenter Portal• Create slice• Launch Flack• Draw topology• Create sliver• Verify sliver creation was successful


GENI Tools: Instrumentation & Measurement

• Two major I&M systems being implemented– GEMINI (Indiana U. & U. of

Kentucky)– GIMI (U. of Massachusetts,

RENCI, NICTA)• Support for active and

passive measurements• Repositories for archiving

(and searching) for measurement data & meta-data

The GENI Desktop and GEMINI

LabWiki and GIMI


Omni: Resource Reservation tool

• A command line experimenter tool

• Useful for making AM API calls on aggregates

• Written in and scriptable from Python

• Works with aggregates that implement the GENI AM API – ProtoGENI, PlanetLab,

OpenFlow, InstaGENI, ExoGENI

$ omni.py createsliver aliceslice myRSpec.xml INFO:omni:Loading config file omni_config INFO:omni:Using control framework pgeni INFO:omni:Slice urn:publicid:IDN+pgeni.gpolab. expires within 1 day on 2011-07-07 INFO:omni:Creating sliver(s) from rspec fileINFO:omni:Writing result of createsliver for INFO:omni:Writing to ‘aliceslice-manifest-rspeINFO:omni: -----------------------------------INFO:omni: Completed createsliver:

Options as run: aggregate: https://www.emulab. framework: pgeni native: True

Args: createsliver aliceslice myRSpec.xml

Result Summary: Slice urn:publicid:IDN+pgeniReserved resources on https://www.emulab.net/p Saved createsliver results to aliceslice-manINFO:omni: ===================================

http://trac.gpolab.bbn.com/gcf/wiki/Omni

http://trac.gpolab.bbn.com/gcf/wiki/Omni


Do Try This at Home!

• Tutorials on the GENI wiki– Look for the icon on the GENI wiki and then click on for tutorials

• Ensure you have a GENI account today!


QUESTIONS?

Documents

GENI Exploring Networks of the Future Niky Riga, GENI Project Office ([email protected])