Upload
steven-kelly
View
215
Download
2
Tags:
Embed Size (px)
Citation preview
Sponsored by the National Science Foundation
Scaling Up: Growing the Topology of an
Existing Experiment in GENI
Sarah Edwards
GENI Project Office
Xuan Liu, UMKC
Sponsored by the National Science Foundation 2Scaling Up – October 22, 2014
Agenda
• Background and Motivation• Hands-On: Medium sized, multi-site topology
– A multi-slice, multi-site technique for building larger stitched topologies
– Building large RSpecs• geni-lib based scaleup tool
Sponsored by the National Science Foundation 3Scaling Up – October 22, 2014
Why are we here?
At GEC20, we talked about Systematic Experimentation
A quick review…
• Build smallest reasonable
topology by…
– … changing one thing at a time …
– … automating as you go …
– … saving what you do.
• THEN scale up. Today
client server
router
router router
Sponsored by the National Science Foundation 4Scaling Up – October 22, 2014
Scaling Up
Assumption #1You have a small scale working experiment
Assumption #2Install and orchestration scripts are auto-configuring
Today we will discuss how to make your topology
BIGGER
Sponsored by the National Science Foundation 8Scaling Up – October 22, 2014
Process Recommendation
A. Build (smallest possible) topology by hand at a single aggregate
B. Automate topology creation at a single aggregate
C. Orchestrate and Instrument
D. Increase scale
E. More nodes
F. More aggregates
Automate
Sponsored by the National Science Foundation 9Scaling Up – October 22, 2014
Process Recommendation
A. Build (smallest possible) topology by hand at a single aggregate
B. Automate topology creation at a single aggregate
C. Orchestrate and Instrument
D. Increase scale
E. More nodes
F. More aggregates
AutomateGetting Started
Tutorials
Sponsored by the National Science Foundation 10Scaling Up – October 22, 2014
Process Recommendation
A. Build (smallest possible) topology by hand at a single aggregate
B. Automate topology creation at a single aggregate
C. Orchestrate and Instrument
D. Increase scale
E. More nodes
F. More aggregates
Automate
LabWiki,OEDL, and
GENI Desktop tutorials
Sponsored by the National Science Foundation 11Scaling Up – October 22, 2014
Process Recommendation
A. Build (smallest possible) topology by hand at a single aggregate
B. Automate topology creation at a single aggregate
C. Orchestrate and Instrument
D. Increase scale
E. More nodes
F. More aggregates
Automate
Scaling Up & geni-lib tutorials
Sponsored by the National Science Foundation 13Scaling Up – October 22, 2014
Experiment Workflow• Part I: Design/Setup
• Part II: Execute
• Part III: Finish
Sponsored by the National Science Foundation 14Scaling Up – October 22, 2014
Medium-scale GENI Experiments
• 150 node international topology– Brecht Vermeulen, iMinds & Thierry Rakotoarivelo, NICTA
• Domain Science Applications– Paul Ruth, RENCI
Courtesy of Ezra Kissel, Indiana University, GEC 20 Demo
Long-lived slicefor stitched, shared
VLAN
Dynamically add/remove nodes
as needed
Intelligent Data Movement System
Sponsored by the National Science Foundation 15Scaling Up – October 22, 2014
Why use this topology?
Large topologies at a single aggregate can take a
long time to come up
Stitched links fail with some frequency
Updating topologies is hard
Sponsored by the National Science Foundation 16Scaling Up – October 22, 2014
Single Aggregate
Single Aggregate / 1 SliceSingle Aggregate /
2 Slices with Shared VLAN
Proto-Backbone
Share VLAN:scalingup
Sponsored by the National Science Foundation 17Scaling Up – October 22, 2014
backbone
router
router.1
10.100.1.0/24
.1router
scalingup
.2
Illinois
Stanford
Wiscscalingupscalingup
10.100.2.0/24
.2
site-10
2host
3host
1router
.110
10.10.2.0/24
10.10.1.0/24
site-5 site-15
Topology: Multi-site, multi-slice, stitched
Sponsored by the National Science Foundation 18Scaling Up – October 22, 2014
General Procedure
1. Backbone Slice
– Reserve stitched backbone
– Share VLAN at each geographic location
2. At each geographic location
– Reserve a topology on the appropriate shared VLAN
3. Add, remove, update topologies at each geographic location as needed
http://groups.geni.net/geni/wiki/HowTo/ShareALan
Sponsored by the National Science Foundation 19Scaling Up – October 22, 2014
Tools to generate a scaled RSpec
(from bad to good)• Copy paste existing RSpec in a text editor• Manually create in an Rspec Editor (Flack, Jacks,
jFed)• Write a shell script to do
– Brecht and Thierry’s 150 node topology
• scaleup tool– We’ll use today!!!
Sponsored by the National Science Foundation 20Scaling Up – October 22, 2014
geni-lib library and scaleup tool
geni-lib is a python library to interact with the GENI Federation.
– Written by Nick Bastin, Barnstormer Softworks
geni-lib supports the creation of tools. An example of such a tool is …
scaleup is a script to create arbitrary topologies based on user-defined node types
– Written by Xuan Liu, University of Missouri, Kansas City– Distributed with geni-lib in tools directory
http://geni-lib.readthedocs.org/en/latest/intro/install.html
Sponsored by the National Science Foundation 21Scaling Up – October 22, 2014
Site-X scaleup config
[general]topo_type=star
subnet=10.X
node_type=host, routersingle_am=yes
output_rspec=site-X.xml
# Star Topology # n+1 nodes, node 1 is center[star]num_nodes=2
[host]# Plain Ubuntu 12 image. . .
node_list=2,3
[router]# XORP software router# OSPF auto-configuring install script
node_list=1
[add-shared-vlan]shared_vlans=scalingup
[scalingup]lans=[(1,)]
[am_nodes]# unbound RSpecany=ALL
Sponsored by the National Science Foundation 22Scaling Up – October 22, 2014
Procedure: Create a small topology
1. Modify site.txt config by replacing X with the value from your worksheet
2. Run scaleup on site.txt config
3. In Jacks, modify IP of shared VLAN interface with the value from your worksheet
4. Save file
5. Reserve Resources
Sponsored by the National Science Foundation 23Scaling Up – October 22, 2014
Experiment Workflow• Part I: Design/Setup
• Part II: Execute
• Part III: Finish
Sponsored by the National Science Foundation 24Scaling Up – October 22, 2014
Procedure: Test Connectivity
1. Login to a host node
2. Ping the backbone nodes
ping 10.100.1.1
ping 10.100.2.2
3. Ordinarily, this is when you would run your procedure (e.g. using LabWiki)
Sponsored by the National Science Foundation 25Scaling Up – October 22, 2014
Experiment Workflow• Part I: Design/Setup
• Part II: Execute
• Part III: Finish
Sponsored by the National Science Foundation 26Scaling Up – October 22, 2014
Procedure: Make a bigger topology
1. Delete your existing slice
2. Make a copy of site.txt
cp site.txt bigsite.txt
3. Add nodes to the star topology
num_nodes = 5
node_list=2,3,4,5,6
output_rspec=bigsite-X.xml
4. Repeat everything from Step 3.1.d onward including reservation
Sponsored by the National Science Foundation 27Scaling Up – October 22, 2014
Procedure: Try other topologies
• Create and view (but don’t reserve) other topologies:
– How make a topology besides a star?
– How install different software on one of the nodes?
Sponsored by the National Science Foundation 28Scaling Up – October 22, 2014
Scaling Up
Assumption #1You have a small scale working experiment
Assumption #2Install and orchestration scripts are auto-configuring
Today we have discussed how to make your
topology BIGGER
Sponsored by the National Science Foundation 29Scaling Up – October 22, 2014
Thank you!
Sarah EdwardsGENI Project Office
Xuan LiuUniversity of Missouri, Kansas City