Sponsored by the National Science Foundation

ViSE: A Virtualized Sensing EnvironmentSpiral 2 Year-end Project Review

ViSE: A Virtualized Sensing Environment

University of Massachusetts, Amherst

PI: Prashant Shenoy, Michael Zink, Jim Kurose

Staff: David IrwinStudents: Navin Sharma

August 6th, 2010

Sponsored by the National Science Foundation 2

Project Summary

• ViSE---a Virtualized Sensing Environment---focuses on: – Virtualizing access to sensors that produce high-bandwidth sensor data, such as pan-tilt-zoom

video cameras and weather radars, – Integrating sensor virtualization technology into GENI, and– Operating a testbed linked to GENI that enables researchers and end-users to control sensors

as part of their experiments.

• ViSE is affiliated with CASA, an NSF Engineering Research Center focused on Collaborative Adaptive Sensing of the Atmosphere, and shares its mission to "revolutionize the way we observe, understand, and predict hazardous weather.”

• Accomplishments– Deployed outdoor ViSE nodes in Western Massachusetts– Connected VLAN from ViSE gateway to NLR– Integrated ViSE with Orca/RENCI Clearinghouse (GEC 7/8 Demo)

• Links ViSE VLAN to resources at RENCI via Starlight

– Web portal access to standalone ViSE– Integrating with DiCloud

August 6th, 2010

Sponsored by the National Science Foundation 3

Milestone & QSR Status

ID Milestone Status On Time?

On Wiki?

GPO signoff?

S2.a

Complete Xen sensor slivering Completed. Source code released via wiki. Technical report released.

Yes Yes Yes

S2.b

Complete integration of your testbed with broker in cluster clearinghouse, so that your testbed becomes federated with the other associated testbeds. Demo functionality of your testbed in this environment, including access from experiment control tools and service managers that are remote from your testbed.

Completed. Integrated demos at GEC 7 and 8 with Orca/RENCI Clearinghouse and dynamic VLANs.

Yes Yes Yes

S2.c Deliver a first release (v1.x) of your testbed and web-based experiment control software, with documentation, to the GPO.

Completed. Source code released via wiki. Yes Yes Yes

S2.d

Work with GPO and cluster projects to complete a plan for the setup of VLANs between testbeds, to be carried by Internet 2 (or NLR) backbone network between the testbeds.

Completed. Static VLAN from ViSE to NOX via NEREN. Dynamic VLANs between RENCI and UMass demonstrated.

Yes Yes Yes

S2.e

Best-effort installation of Pelham tower x86 sensor node (note: funded from other sources), to include meteorological sensors, radar (if licensed), communications, computing. No camera. If Pelham node is problematic, optional rapidly-deployed node replaces Pelham node.

Completed. Rapidly deployable node operating in-house.

Yes Yes Yes

S2.f Installation and virtualization of camera devices on CSB and MA1 tower nodes.

Completed. Cameras deployed. See picture on front page.

Yes Yes Yes

S2.g

Integration of virtualization/slivering in testbed. Ported Xen virtualization software to vservers for use in testbed.

Yes Yes Yes

August 6th, 2010

Sponsored by the National Science Foundation 4

Milestone & QSR StatusID Milestone Status On

Time?On

Wiki?GPO

signoff?

S2.h Update experiment control framework (ECF), based upon updated reference software, provided by RENCI/Duke group at 2/1/10, and integrate new features as needed.

Completed. Up-to-date on the current Bella 2.1 release of Orca.

Yes Yes Yes

S2.i Demonstrate control of VLAN connections from ViSE testbed to backbone network, contingent upon availability of transport by backbone network.

Completed. Demos at GEC7 and GEC8. Yes Yes Yes

S2.j If needed, update experiment control framework (ECF), based upon updated reference software, provided by RENCI/Duke group at 6/1/10, and integrate new features as needed.

Completed. Up-to-date on the latest Bella 2.1 release of Orca. Working off the trunk as per our integrated demonstration with RENCI

Yes Yes Yes

S2.k Testbed allocation policy for sensors. Allocation of energy as a resource to be done on a best-effort basis. (note: power now available at all node sites).

Completed. Modified the basic allocation policy to support sensors and queuing.

Yes Yes Yes

S2.l Demo testbed resources shared among multiple experiments. Demo experiments that include resources in multiple testbeds. Demo easy access and testbed use by end-users at GEC. [Experimental control framework, exporting common functionality needed to execute experiments such as, automatic file distribution, sequenced process workflow execution, log file collection, and experiment monitoring.

Completed. See both GEC7 and GEC8 demonstrations. GEC7 was a plenary demonstration.

Yes Yes Yes

S2.m Make federated testbed available to GENI users Completed. Our testbed is available to use. Availability subject to our demo/work schedules, and Clearinghouse availability.

Yes Yes Yes

S2.n POC to GENI Response Team Completed. David Irwin is the POC Yes No No

August 6th, 2010

Sponsored by the National Science Foundation 5

Milestone & QSR StatusID Milestone Status On

Time?On

Wiki?GPO

signoff?

S2.o POC to GENI Security Team Completed Yes Yes Yes

S2.p Contribution to GENI Outreach Taught 3-day seminar at UPRM in Puerto Rico on GENI, networks, and virtualization. Continuing our collaboration with UPRM.

Yes Yes Yes

QSR: 4Q2009 Complete Yes Yes Yes

QSR: 1Q2010 Complete Yes Yes Yes

QSR: 2Q2010 Complete Yes Yes Yes

August 6th, 2010

Sponsored by the National Science Foundation 6

Accomplishments 1: Advancing GENI Spiral 2 Goals

• Integration – ViSE is using the common RENCI/Orca Clearinghouse when available and supports dynamic NLR VLANs with other Cluster D sites via Starlight. We demonstrated this at a GEC 7 plenary demonstration and other GEC 8 demonstrations

• Continuous Experimentation – We support simple web portal access to ViSE’s standalone testbed as well as programmatic access through an Orca site authority (note that RENCI using the programmatic access for VLANs). Our GEC 8 demonstration showed an example of NOWcast experiments. Additionally, we have setup a 4-node Eucalyptus cluster to provide general purpose resources to GENI.

• Instrumentation and Measurement – Mike Zink attended the I&M workshop and we have contributed documents describing radar sensor data formats (NetCDF) and data flow in ViSE.

• Interoperability – Our web portal interfaces with an Orca service manager, which is (or will be) capable of supporting a ProtoGENI interface.

• Identity Management – We have not been active in the identity management space. Our plan is to leverage any updates to identity management in the newest releases of the Orca software.

August 6th, 2010

Sponsored by the National Science Foundation 7

Accomplishments 2:Other Project Accomplishments

• Educational Benefits – We mentored 2 REU students this summer. One student looked at leveraging existing portal interfaces (e.g., VCL, HybridFox) to provide a better interface to GENI. The other student investigated power monitoring, since ViSE nodes are battery-powered (via solar energy).

• Outreach – We taught a 3-day class at UPRM on GENI and are continuing our collaboration. UPRM recently finished deploying a radar testbed similar to ViSE.

• External Publications and Presentations – We had GENI-related publications and presentations at TridentCom 2010, SECON 2010, AAMAS 2010, LANMAN 2010.

• GEC Demos – We conducted an integrated plenary demonstration at GEC7 (with Orca and Starlight). We are planning on a GEC9 integrated demonstration using our NOWcast experiments.

• Connectivity – We are continuing to work with UMass OIT to increase the number of VLANs we have available for experimenters.

• Project Support – We frequently respond to mailing list postings by other projects on technical questions related to Orca software.

August 6th, 2010

Sponsored by the National Science Foundation 8

Issues

• Improve foundation of Cluster D resources– Currently, resources are well-connected but too diverse– Many types of sensors, buses, VLANs, robots, storage,etc.– Better integration with other clusters would help and/or GENI racks– Difficult to get end-to-end users with such diversity

• Key to increasing user-base is increasing general-purpose resources

• Future plans– Are there plans for GENI Spiral 1 projects at the end of next year?

August 6th, 2010

Sponsored by the National Science Foundation 9

Plans

• What are you plans for the remainder of Spiral 2?– Focus primarily on GENI Alpha Demonstration– End-to-end Nowcasting experiments via NLR– Also, integrate our Eucalyptus cluster

• The GPO is starting to formulate goals for Spiral 3. What are your thoughts regarding potential Spiral 3 work?– Increase level of integration and uptime – Improve the uptime of the RENCI Clearinghouse and

the availability of the testbeds. – Increase the Cluster D Foundation – Add a 5 node Eucalyptus cluster to the Cluster D

foundation of general-purpose resources. Discuss increasing the number of VLANs available out of UMass. DiCloud resources should also help. Further, the ability for Orca to use ProtoGENI or PL resources or vice-versa would also be a viable option.

– Increase the user-base – Increasing the number of general-purpose resources and the number of VLANs should increase the potential for a broader set of end-users (e.g., not just those interested in radar sensing experiments or mobile testbed experiments).

August 6th, 2010