IMF Spiral 2 Year-end Project Review

Sponsored by the National Science Foundation

IMFSpiral 2 Year-end Project Review

Lead PI: Rudra Dutta

Co-PI: George RouskasStudents: Anjing Wang,

Can Babagolu

August 27th, 2010

PI: Keren BergmanStudents: Michael Wang,

Caroline Lai,

Bala Bathula,

Cathy Chen

PI: Ilia Baldine

Sponsored by the National Science Foundation 2August 27, 2010

Project Summary (1/3)

• Measurements are important to experimenters– Some measurements can be made by experimenter code, in or on top of slice, but –– Measurements from substrate are also very important– Experimenter cannot directly measure L1 or close to L1

• Substrates must provide measurement capability, as part of substrate capability– Especially optical substrates – measurement capability and technology is not trivial– Experimenter should be able to request measurement capability when requesting sliver– Access control, accounting etc. issues

• Experimenter must be able to consume measurements at any layer (in-slice), online– Consumer is automated protocol, designed by experimenter– Good deal of research in recent years has focused on cross-layer control– Normal consumption at “L8”, offline consumption, must also be enabled

• Desirable to integrate actuation in same design– Close the loop of feedback control by reactive protocols

• Plan: Build on UMF (GENI ERM project) to provide diverse optical substrate measurements uniformly, use SILO (NSF FIND project) to consume and react in-stack, offer to experimenter through ORCA

Sponsored by the National Science Foundation 3


August 27, 2010




Milestone & QSR StatusID Milestone Status On Time? On

Wiki?GPO

signoff?

IMF: S2.a

Initial architecture Presentation made at GEC6, slides on wiki On-time Yes (late)

Yes

IMF:S2.d

First component architecture Architecture document submitted with ticket, GEC7 slides, on wiki

On-time Yes Yes

IMF:S2.e

Initial IMF software Demonstrated at GEC7, code is in IMF Subversion repository

On-time Yes (late)

Yes

IMF:S2.f

Integrate IMF and UMF with BEN Demonstrated at GEC7, code is in IMF Subversion repository

On-time Yes (late)

Yes

IMF:S2.b

Initial ontology for measurements Postponed, to allow aligning with emerging GENI I&M frameworks; ticket closed

>2 months, incomplete

Yes (late)

No

IMF:S2.g

Protocol between SILO and UMF Finalized, integrated into s/w demonstrated at GEC8; in updated architecture document, on wiki

Early Yes (late)

No

IMF:S2.c

First GENI I&M architecture Finalized version of architecture, in updated architecture document, on wiki

On-time Yes (late)

No

IMF:S2.h

Update the IMF software Demonstrated at GEC8; further updates completed, code is in IMF Subversion repository

On-time Yes (late)

No

IMF:S2.i

First release of IMF and SILO software On track - - -

IMF:S2.j

Contribution to GENI outreach plan On track - - -

QSR: 4Q2009 N/A (project started late, Jan 2010) - - -

QSR: 1Q2010 >2 months, complete

Yes No

QSR: 2Q2010 <2 months, complete

Yes No


Accomplishments 1: Advancing GENI Spiral 2 Goals (1/2)

• IMF addresses the “Instrumentation and Measurements” Spiral 2 Goal of GENI

• Creates a framework for a specific measurement flow and utilization pathway• Demonstrates the practicality of using substrate measurements in slice

– Even (especially?) when the substrate uses specialized technology

• Articulates the connection between measurement (sensing) and actuation– Meaningful to address both in the same conceptual framework

• Also addresses the underlying philosophy of integration– Defined multiple modes to rendezvous producer and consumer of measurements– Unified pub-sub approach to realizing these modes

• Provides a structure to base further pertinent work on– Access control to measurement data – privilege to consume– Any and all substrates? Only substrates occupied by slice? Logged measurement data as

substrate spec?

• Year 1 accomplishments can be summed up by considering the GEC8 demo


Accomplishments 1: Advancing GENI Spiral 2 Goals (2/2)


Accomplishments 2:Other Project Accomplishments

• Attended GECs, demos• Attended and contributed to the I&M working group meetings• Collaborated with LEARN to synchronize substrate measurement effort• Expended effort in understanding perfSONAR

– Attended the perfSONAR workshop– Held one-on-one meeting with Martin Swany to discuss possibility of convergence– Jointly with LEARN, evaluated perfSONAR and potential convergence with IMF

• Currently making specific plans to introduce GENI and IMF coverage in courses and NCSU, Columbia– Special day-long courses under design at Columbia


Issues

• Initial delay in contract negotiation – GPO handled by delaying first milestone date– Kept to actual presentation at GEC6

• General delay in keeping up with milestones on wiki, and wiki updates– PI acknowledges problem, will do better

• Non-standard calendar causing some tension– Funds only till end of September– Initial refusal by admin staff to appoint RA– Also cannot hang on to ARRA money– Contact with GPO financial staff has brought no solution– Currently resolved – will face again next year


Plans – Rest of Spiral 2

• Complete packaging and release of software, together with complete h/w and demo specs

• Complete annual project report


Plans – Potential Spiral 3

• Stay on track for original goals– Catch up on measurement ontology – in concert with I&M frameworks– Contribute to emerging I&M architectures – integrate IMF as a unique capability

• Cross-layer, in-slice, optical substrate– Extend capabilities

• Develop suite of software libraries to expand the measurement capabilities of IMF• Increase set of programmable active components for actuation and cross-layer control

• Develop ORCA interface further– Allow SILO services and IMF capabilities to be represented in ORCA– Allow ORCA to advertise and provision measurement capabilities as SILO and IMF services

• Develop experimenter’s interface– Allow experimenter to specify what layers to cross-layer experiment on– Allow experimenter to load experimental code as SILO service– Allow experimenter to load experimental code as tuning algorithm

• Added specific directions– Interface / find convergence point with PerfSONAR, and any other useful architectures

• Continue outreach efforts

Documents

IMF Spiral 2 Year-end Project Review