Embed Size (px)
Citation preview
5775AllentownBlvd.Suite101Harrisburg,PA17112
Internet2 Technology ExchangeOctober 17, 2017
GwendolynHuntoon- KINBERKennethMiller- PennStateJimStankiewicz - NJEDge.NetBarrvonOehsen - Rutgers
Regional Data DMZ in Support of Distributed Applications in Pennsylvania and New Jersey
Agenda• Motivation• CampusNetwork• RegionalNetwork• CurrentStatus• NextSteps
RegionalDataDMZ• High-bandwidthnetworkconnectivitybetweentheregionalnetworks,PennREN(KINBER)andNJEdge aswellasindividualorganizationslocatedinPennsylvaniaandNewJersey.
• Long-termgoalofconnectingthisregionalinfrastructuretothebroadercommunityviaregionalandnationalnetworkconnections,includingInternet2.
• InitialapplicationtoutilizethisinfrastructureistheVirtualDataCollaboratory (VDC).– NSFfundedDIBBSprojectwiththegoalofestablishingstateoftheartdata-intensivecomputingsolutions,storage,andnetworking,federatedwithaninnovativedataserviceslayer
DataDMZTopologyRutgers UniversityPennsylvania State University
NJEDge
KINBER
©2017 Rutgers, The State University of New Jersey All Rights Reserved
10G 10G
10G
100G
100G
10GHill CenterPiscataway
VDC Data Hub
NJEdgePhiladelphia
VDS Data Hub
10G
10G
Halsey StNewark
RutgersCampusNetwork
PennStateCampusNetwork
200G
200G
CoreRouter
PennStateScience
DMZ
200G
VDC Data DMZ Topology
BorderRouter
10G
Broad StPhiladelphia
Campus Edge RouterPhiladelphia
PennRENMPLS
Network
NJEdgeNewark
10G
VDCApplication• CIF21DIBBs:EI:VirtualDataCollaboratory:ARegional
CyberinfrastructureforCollaborativeDataIntensiveScience(NSFAward1640834)- PI:ManishParashar;Co-PI:GraceAgnew,JamesvonOehsen,
Jenni-LouiseEvans,Vasant Honavar- CollaborationbetweenRutgers,PennState,NJEdge andKINBER- LeveragesconceptsfromthePRP
• Applications– DecipheringSequenceandStructuralCorrelatesofProtein
NucleicAcidInteractions(H.Berman,RU&V.Honavar,PSU)– High-VolumeCityDataSharingandProcessingforSmart,
Resilient,andSustainableCities(J.Gong,RU;Z.Zhu,CUNY;X.Liang,UniversityofPittsburgh;M.Balduccini,DrexelUniversity)
– OceanObservatoriesInitiative(I.Rodero,RU,M.Parashar,RU)
• VDCHub:Scalabledata-intensivecomputingplatform
• Dataservicestosupportresearchworkflows
• RegionalsciencedataDMZnetwork
Network Service Layer
Data Service Layercataloging, curating, querying, discovery, federation, etc
Science & Education Use Cases
Data DMZ
PA VDC Data Hub NJ VDC Data Hub
KINBER NJEDGE
National Infr. National Infr.
PA VDC Spokes: Penn State, Univ. of Pittsburgh, Drexel, etc.
NJ VDC Spokes: Rutgers University (New Brunswick, Newark, Camden), etc.
VDCArchitecture
VDCDataDMZ• Supportsdataimport/exportserviceswithnecessaryqualitiesofservicestoenableefficientandtransparentaccesstodataandcomputeregardlessofascientist’slocation.
• Components– DataDMZbackboneconsistsofdirect10GEconnectionsbetweenRutgers,NJEdge andKINBER
– DataHubsconnectdirectlytotheDataDMZorthroughtheirregionalnetwork
– DataSpokesconnectthroughtheregionalnetwork
– FIONAsdeployedatHubandSpokesites
VDCProjectComponents• VDCHubs– systemsites– RutgersUniversity– MainCampus– PennState– MainCampus
• VDCSpokes– collaborationsites– NewJersey– RutgersCamden,RutgersNewark– Pennsylvania– Drexel,Temple,UniversityofPittsburgh
– NewYork– CityUniversityofNewYork• DataDMZBackbone– NJEdge andPennREN(KINBER)
Rutgers/NewJerseyApplications• BrainResearch• MedicalImaging• Genomics• Genetics• Bioinformatics• ObservationalAstronomy• ExperimentalPhysics• ClimateModeling• NetworkResearchCommunitiestofullyutilizeCICNet
RutgersDMZ– LocalResearchPlatform
RequiresACItobeinplace– fast/low-latencynetworks,ScienceDMZs,SDN,DataTransferNodes(FIONAs),perfSONAR,XDMod,AdvancedComputing,andStorage.Buildingblockforregion,national…
OneRutgersResearchPlatform• RequiresACItobeinplace– fast/low-latencynetworks,ScienceDMZs,
SDN,perfSONAR,AdvancedComputing,Storage,DataTransferNodes(DTNs),anda100Gb/sconnectiontotheoutsideworld
• ResourceswillbedistributedacrossNewBrunswick/Piscataway,Newark,andCamden
• TieredStoragesolutionthatwillincludeHIPAA/FISMAcompliance• Designedtobeatestbed toservemultipleresearchneeds(including
industry)• Elasticinthesensethatwewillgrowandshrinkintocloudresources
basedondemandandjobtype(OSG,Google,Amazon,Azure)• CouplesNSFfundednationalprojectsandcommercialcloudservices
directlyintoourenvironmentcreatingaone-stopshopfortheresearcher• DesignedtobeaPlug-N-PlayenvironmentwithdeploymentofDTNs
(FIONAS)• Asnetworkisupgraded,moreresearchgroupswillbeadded
PennState/PennsylvaniaApplications• Meteorology• ClimateModeling• Bioinformatics• BiochemistryandMolecularBiology• Cryo-electronmicroscopy• Astronomy
PennStateScienceDMZ
Collaboration• Formednetworkinggroupaspartofthecollaboration–Mailinglistandbiweeklymeetings– NetworkengineersandprojectparticipantsfromRutgers,PennState,KINBERandNJEdge
• Activities– TechnicaldetailsforimplementingDataDMZ– Generalexchangeoftechnicalinformation,bestpractices
ProjectStatus• Itishard!– Newnetworkconnections,forexample,tothespecificVDCHublocationateachcampus
– Accommodateinfrastructureupgrades• NewmachineroomatPennState• NJEdge backboneupgrade• PennRENmovetonewcolocationfacility
– Policy– whopaysforthecostsofthenewconnectionifitwasn’tincludedintheoriginalgrant
– Identifyinginitialtestingplatforms
Observations• Baselinenetworktests– ExistingperfSONARplatforms,eventuallyincludeFIONAplatformsateachsite
• NetworkconnectivitypriortoconnectingDMZ– Notoptimal– 3Internet2providers(OmniPoP,DrexelandMAGPI)
– InitialVDCHubtraceroute –• ReturnpathusedthecommoditynetworkconnectionandnottheregionalnetworkorInternet2connection
InitialDataDMZperfSONARDashboard
What’sNext
• LeveragethedataDMZconcepttodevelopa“regionalresearchplatform”.
• FindsciencedriversamongtheinitialhubandspokesitesassociatedwiththeVDC.
• Understandopportunitiesforexpandingtoothersites.– InNewJerseyandPennsylvaniausingtheregionalnetworksforconnectivity.
– Intheregion• Connecttothenationalfabric.
10/18/17 19
Q&A- Discussion
ContactInformation:
WendyHuntoon([email protected])BarrVonOeshen ([email protected])KenMiller([email protected])JimStankiewicz)([email protected])
