Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Sponsored by the National Science Foundation
GENI Exploring Networks of the Future
www.geni.net
Sponsored by the National Science Foundation 2 GENI Introduction www.geni.net
Outline
What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 3 GENI Introduction www.geni.net
GENI: Infrastructure for Experimentation
GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.
Sponsored by the National Science Foundation 4 GENI Introduction www.geni.net
GENI: Infrastructure for Experimentation
GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.
Sponsored by the National Science Foundation 5 GENI Introduction www.geni.net
Multiple GENI Experiments run Concurrently
Resources can be shared between slices
Experiments live in isolated
“slices”
Sponsored by the National Science Foundation 6 GENI Introduction www.geni.net
GENI is “Deeply Programmable”
I install software I want throughout my network slice (into routers, switches, …) or control
switches using OpenFlow
OpenFlow part of the experiment not only the infrastructure
Sponsored by the National Science Foundation 7 GENI Introduction www.geni.net
GENI Compute Resources
GENI Racks GENI Wireless compute nodes
Existing Testbeds
Emulab
Planetlab
ORBIT
Sponsored by the National Science Foundation 8 GENI Introduction www.geni.net
Creating and deploying GENI racks
Ilia Baldine RENCI More resources / rack, fewer racks
Rick McGeer HP Labs
Fewer resources / rack, more racks
Latest addition
Rajesh Narayanan DELL
KC Wang Clemson
Sponsored by the National Science Foundation 9 GENI Introduction www.geni.net
GENI Networking Resources
Networking within a Rack
National Research Backbones (e.g. Internet2)
Regional Networks (e.g. CENIC)
WiMAX Base Stations
4G/3G GENI network
Sponsored by the National Science Foundation 10 GENI Introduction www.geni.net
Federation GENI grows by GENI-enabling heterogeneous infrastructure
Avoid technology “lock in” and grow quickly by incorporating existing infrastructure
Backbone #1
Regional
GENI Rack
GENI Rack
Access #1
Commercial Clouds
Corporate GENI suites
Non-US Testbeds
Research Testbed
Campus
My experiment runs across the evolving GENI federation.
My GENI Slice
This approach looks remarkably familiar . . .
Sponsored by the National Science Foundation 11 GENI Introduction www.geni.net
GENI Architecture
• Flexible network / cloud research infrastructure
• Also suitable for physics, genomics, other domain science
• Distributed cloud (racks) for content caching, acceleration, etc.
Metro Research
Backbones
Internet ISP U N I V E R S I T YU N I V E R S I T Y
U N I V E R S I T YU N I V E R S I T Y
Regional Networks Campus
g
g
g Legend
GENI-enabled hardware
Layer 3 Control Plane
Layer 2 Data Plane
Sponsored by the National Science Foundation 12 GENI Introduction www.geni.net
Current GENI buildout
• More WiMAX base stations with Android handsets
• GENI-enable 5-6 regional networks
• Inject more OpenFlow switches into Internet2
• Add GENI Racks to 50-80 locations within campuses, regionals, and backbone networks
GENI Racks serve as programmable routers, distributed clouds, content
distribution nodes, caching or transcoding nodes, etc
Sponsored by the National Science Foundation 13 GENI Introduction www.geni.net
GENI Operations
GMOC: GENI Meta-operation Center • Keeps track of outages • Notification system for resource reservation • Monitors most GENI Aggregates
GMOC Google Calendar keeps track of reservations/outages
Sponsored by the National Science Foundation 14 GENI Introduction www.geni.net
Federation Extends the Reach of GENI and International Peer Testbeds
Initial plan to federate testbeds on five continents
Sponsored by the National Science Foundation 15 GENI Introduction www.geni.net
Testbeds Involved
Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/GEC18_brecht_vermeulen_International_Fe
deration.pdf
Sponsored by the National Science Foundation 16 GENI Introduction www.geni.net
Outline
What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 17 GENI Introduction www.geni.net
How is GENI being Used?
Research • Future Internet
architectures • Software defined
networking • Large scale evaluation of
smart grid protocols
Education • Over 50 classes using
GENI in all levels • Networking and
Distributed systems classes
• Cloud computing classes • WiMAX classes
As of October 2014, GENI has over 2700 users!
Sponsored by the National Science Foundation 18 GENI Introduction www.geni.net
Outline
What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 19 GENI Introduction www.geni.net
GENI: Terms and Definitions
– An experiment uses resources in a slice
– Slices isolate experiments
– Experimenters are responsible for their slices
Slice Abstraction for a collection of resources capable of running experiments
Sponsored by the National Science Foundation 20 GENI Introduction www.geni.net
Slice credentials
Clearinghouse and Aggregates
• Clearinghouse: Manages users, projects and slices – Standard credentials shared via custom API or new Common CH API – GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH
• Aggregate: Provides resources to GENI experimenters – Typically owned and managed by an organization – Speaks the GENI AM API – Examples: PlanetLab, Emulab, GENI Racks on various campuses
Create & Register Slice
Researcher
Aggregate Manager API - listResources - createSliver … Aggregate
Manager Aggregate Resources
users
slices
clearinghouse
projects
Tool
Sponsored by the National Science Foundation 21 GENI Introduction www.geni.net
GENI: Terms and Definitions
• A slice : One or more resources provided by an aggregate – E.g. Bare machines, virtual machines, VLANs
Backbone #1
Backbone #2
GENI Rack #3
GENI Rack #2
Access #1
Commercial Clouds
Corporate GENI suites
Other-Nation Projects
Research Testbed
GENI Rack #1
My GENI Slice
My slice contains slivers from many aggregates.
Sponsored by the National Science Foundation 22 GENI Introduction www.geni.net
Resource Specifications (RSpecs)
• RSpecs: Lingua franca for describing and requesting resources – “Machine language” for negotiating resources between experiment
and aggregate – Experimenter tools eliminate the need for most experimenters to
write or read RSpec
<?xml version="1.0" encoding="UTF-8"?> <rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node> </rspec> RSpec for requesting a single node
Sponsored by the National Science Foundation 23 GENI Introduction www.geni.net
Resource Reservation using RSpecs and the AM API
• Advertisement RSpec: What does an aggregate have?
• Request RSpec: What does the experimenter want? • Manifest RSpec: What does the experimenter have?
Aggregate Manager
Client
ListResources(…)
Advertisement RSpec
CreateSliver(Request RSpec, …)
Manifest RSpec
ListResources(SliceName, …)
Manifest RSpec
Sponsored by the National Science Foundation 24 GENI Introduction www.geni.net
Outline
What is GENI? How is GENI being used? Key GENI Concepts Demo: A simple experiment using GENI
Sponsored by the National Science Foundation 25 GENI Introduction www.geni.net
Access to GENI
For many experimenters: • no new passwords • familiar login
screens
Leverage InCommon for single sign-on authentication
Experimenters from 304 educational and research institutions have InCommon accounts
GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.
Sponsored by the National Science Foundation 26 GENI Introduction www.geni.net
NTUA is now federated …
1. Choose National Technical University of Athens from the drop down list
2. Use your NTUA username and password to login
Sponsored by the National Science Foundation 27 GENI Introduction www.geni.net
Putting it all Together: Demo
• Demo – Create a slice – Create a sliver at one
aggregate • Two computers (raw PCs),
connected by a LAN
– Install and run software on the machines
– View output of software – Delete sliver
• Experimenter tool: Jacks
server (VM)
client (VM)
Sponsored by the National Science Foundation 28 GENI Introduction www.geni.net
Ways to Get Help
• Sign Up for : [email protected]
• Use #geni IRC chatroom
• HowTo pages on the GENI Wiki
http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp
Sponsored by the National Science Foundation 29 GENI Introduction www.geni.net
Other Important Lists
• geni-announce – GENI news and events
• Experimenters
– Announcements of interest to GENI experimenters
• Experimenter-ops – Announcements about infrastructure maintenance
Full list at: http://groups.geni.net/geni/wiki/GENICommunicationChannels
Sponsored by the National Science Foundation 30 GENI Introduction www.geni.net
Answer is [email protected]
Have a question?
Sarah Edwards Niky Riga Vic Thomas
which is an email list which only goes to members of the GPO including…
(However, the archive of the list is public)
Sponsored by the National Science Foundation 31 GENI Introduction www.geni.net
QUESTIONS?
Sponsored by the National Science Foundation 32 GENI Introduction www.geni.net
BACKUP SLIDES
Sponsored by the National Science Foundation 33 GENI Introduction www.geni.net
“At scale” GENI prototype
Campus photo by Vonbloompasha
Build GENI at sufficient scale
Infeasible to build a testbed as big as the Internet
GENI-enabled campuses, students as early adopters
HP ProCurve 5400 Switch
NEC WiMAX Base Station
GENI-enabled equipment
GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks
Sponsored by the National Science Foundation 34 GENI Introduction www.geni.net
Current GMOC Operational Support
• Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale)
• Emergency Stop • GENI Experimenter Support • Manage network/systems alarms, outages, maintenances,
– Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem)
• Notifications, Escalation and Reporting • Engineering configuration (Internet2, MOXI, Indiana) and
new Aggregate site, regional and GENI rack turn-up • GMOC Measurement API for GENI Aggregates • Develop new tools for network monitoring and
measurement Modified slide from:
http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC%20Prese
ntation pdf