© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

GENI Mesoscale and The GENI Experiment EngineTrans-Geo Demo Team

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3

3

GENI, JGN-X, FIRE, and the Emergence of the IntercloudThe Internet was about the seamless movement of data…• Internet protocols were fundamentally centered around transfer of

bulk data• ftp, http, voip,…• Fundamental to the design of TCP• Later, localized services offered over the wide areaThe Intercloud will be about the seamless movement of computation • Design and development of protocols, security procedures,

architectures, economic models that permit computation to move to data, rather than the other way around

GENI, FIRE, JGN-X are all early stabs at this…(more later)

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4

4

Implications for Infrastructure

Ubiquitous, isotropic cloudUbiquitous: Data collected everywhere, must compute where data is ⇒ compute everywhereIsotropic: Compute must be able to move between sites, easily – compute must be independent of site.Adaptive, Virtualizable NetworkCurrently, networking is application-agnostic (TCP is TCP….)Need to permit application to allocate network resources just as it now allocates storage, compute resourcesGuarantee QoS for high-priority flows, make transmission speeds latency- and loss-independent, virtual networks with admission control…

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5

5

GENI

Ubiquitous cloud with deeply-programmable networkingUbiquitous CloudAbstracted API that can be implemented by any popular cluster manager (Slice Federation Architecture)Designed for federationCertificate-based access control (No need for single sign-on, common AUP)Implementations with fine and deep control of resources (ProtoGENI)Deeply Programmable NetworkOpen Flow native Layer 2 backbone

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.6

6

GENI Mesoscale

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7

GENI And NSFNet: Back to the Future

GENI today is NSFNet circa 1985GENI and the SFA: Set of standards (e.g., TCP/IP) Mesoscale: Equivalent to NSF BackboneInstaGENI: Hardware/software instantiation of standards that sites can deploy instantlyEquivalent to VAX 11 running Berkeley UnixInstaGENI cluster running ProtoGENI and OpenFlowOther instantiations which are interoperableExoGENI (Ilia Baldine, Jeff Chase, RENCI and Duke)VNode (Aki Nakao, University of Tokyo and NICT)

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8

8

TransGeo: A Model TransCloud ApplicationScalable, Ubiquitous Geographic Information SystemOpen and PublicAnyone can contribute layersAnyone can host computationWhy GIS?Large and active communityCharacterized by large data sets (mostly satellite images)Much open-source easily deployable software, standard data formatsComputation naturally partitions and is loosely-coupledCollaborations across geographic regions and continents Very pretty…

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9

9

TransGeo Architecture

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10

10

TransGeo Sites (May 2013)

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11

11

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12

12

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13

13

Opening up TransGEO: The GENI Experiment EngineKey Idea: Genericize and make available the infrastructure behind the TransGEO demoOpen to every GENI, FIRE, JGN-X,…experimenter who wants to use itTransGEO is a trivial application on a generic infrastructurePerhaps 1000 lines of Python code on top of• Key-Value Store• Layer 2 network• Sandboxed Python programming environment• Messaging Service• Deployment Service• GIS Libraries

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.14

14

GENI Experiment EngineMcGeer, Mambretti, Bavier, Coady,

Permanent, Long-Running, Distributed File SystemPermanent, Long-Running, GENI-wide Message ServicePermanent, Long-Running, Distributed Python EnvironmentPermanent, world-wide Layer-2 VLANs on high-performance networksAll offered in slicesAll shared by many experimentersModel: Google App EngineAdvantage for GENI: Efficient use of resourcesAdvantage for Experimenters: Up and running in no time

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15

15

GENI Experiment Engine Architecture

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.16

16

Staged Rollout

Permanent Layer-2 Network Summer 2013Shared Fole System based on (Swift) Summer 2013First Python Users Fall 2013Shared Python environment Summer 2014

© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Thanks!