Understanding the Evolving Internet · 2020. 1. 10. · Dark fiber Lit fiber Conduit. 3 Level of...

UnderstandingtheEvolvingInternet

RamDurairajan

0

Assistant Professor, Computer and Information ScienceCo-director, Oregon Networking Research Group

University of Oregon

1PhysicalInternet

Users, Apps and Data

Datacenters and CDNs

Cloud Services

Mobile Devices

SDNs and NFVs

Internet of Things

Internetisacomplexsystem

PhysicalInternet

2

PointofPresence(POP)

Fiberopticslink

DatacenterColocationfacility…

Submarinecable

ToLondon

LitfiberDarkfiberConduit

3

LevelofRobustness

ExistingMechanisms(e.g.,trafficengineering)

Perfe

ctCon

nectivity

NoCo

nnectivity

Problem

• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?

(Robustness:abilityofthephysicalInternettocopewithevolution)

NoonehasacompleteviewoftheInternet

4Source:Lumeta Source:Peer1

Router-levelTopology

AutonomousSystems-levelTopology

5

LevelofRobustness

ExistingMechanisms(e.g.,trafficengineering)

Perfe

ctCon

nectivity

NoCo

nnectivity

Problem

• GiventheclaimthatInternet’sdesignisrobust,whydowehaveoutages?Performanceissues?Bandwidthondemand?

• HowdowetranscendthisrobustnessgaptobuildabetterInternet?

(Robustness:abilityofthephysicalInternettocopewithevolution)

• Whataboutevolvingcomponents?IoTs?Privateinterconnects?

Outline

IntroductionandMotivationUnravellingtheStructuralComplexity

- MappingtheInternetEcosystemProvidingFlexibleDecisionSupport

6

MappingtheInternetecosystem

• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro

7

MappingtheInternetecosystem

• XConnects,CloudconnectsandPrivateInterconnects• InternetofThings• Long-haulandMetro

8

MappingtheInternetofThings

• MapandCharacterizetheIoT devicesanddeployments• Anactivemeasurements-basedapproach• SpecificfocusonIPv6-enabledIoT devices

• Challenges• IPv6addressspaceislarge.HowtoefficientlyscanIPv6prefixes?• HowtodifferentiateIoT vs.non-IoT devices?

• Applythistoproblemsofinterest• Securityandprivacy,censusandsurvey,businessintelligence,etc.

9

Mappinglong-haulandmetro

• InternetAtlas:acomprehensiverepositoryofthePhysicalInternet• Search-baseddata• Mapsnodes,links,fiberstrands,etc.• Repositoryhasover1,400maps

• Applythistoproblemsofinterest• Robustness,performance,security,resilience,etc.

• PopularScience• BestofWhat’sNew,SecurityCategory,2017• Oneofthe100GreatestInnovationsof2017

10

MapofUSlong-haulfiber

11

Assessinginfrastructuresharing

• Strikingcharacteristicofconstructedmapsisconduitsharing• 20-yearfiberIRUtoreducecosts

12

Connectivity-onlysharedrisk• HowmanyISPsshareaconduit?

13

0

100

200

300

400

500

600

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

Rawnum

ber

NumberofISPssharingaconduit

542conduits89.67%

63.28%53.50%

12criticalchokepoints

Physical connectivity lacks much diversity that is a hallmark of commonly-known models.

Keyobservation

• ThereisalotofsharingintheInternet• Risksandoutages

• Opticalconnectionscannotbereconfigured• Inflexibility

• Risks+outages+inflexibility=NOTrobust!

14

Outline

IntroductionandMotivationUnravellingtheStructuralComplexityProvidingFlexibleDecisionSupport

- BuildingsystemstocreateabetterInternet

15

Needforflexibledecisionsupport• Flexibledecisionsupportisimportant• Enhancerobustness,resilience,security

• Resilience:removetheinflexibleleasingmodel(andreducesharedrisk)• Security:connectivity/bandwidthondemandtocountervolumetricDDoSattacks

• GiventheunderstandingofthephysicalInternet,whatradicalchangecanweintroducetobuildabetterInternet?• Wide-areaConnectivityasaService

• AgilitymeetstheInternet• E.g.,DeployNFVsinthewild

16

• Objective:asystem(calledGreyFiber)forcloudification ofthephysicalInternet• Cloud:Rentcycles,useresources,andrelease• GreyFiber:Rentconnectivity,transferdata,andreleaseconnectivity

• Systemconsiders• Infrastructureabundance(e.g.,unusedfiber)• Marketeconomics(e.g.,CAPEX,OPEX)• Technologytrends(e.g.,fastremotereconfigurationsinrouters)

• Flexibleaccesstofiber-opticpathsbetweenendpoints(e.g.,IXP)overarangeofusescenarios

17

Wide-areaConnectivityasaService

• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate

18

GreyFiber systemdesign

FiberExchange

BuyersSellers

GlobalController

GreyFiberGlobalControl

• Controlandcommandcenter• Sellers aremajorfiber/majorcableproviders

• Buyers arethecustomers(e.g.,CDNs,enterprisenetworks)

• Fiberexchange toenableeconomicviability• RunsGSPauctions

• Globalcontroller• Trafficengineering• Time-basedcircuitprovisioning• Networkmanagement• Backuprestoration

SiteALocal

ControllerSiteBLocal

Controller

SiteCLocal

Controller

FiberExchange

BuyersSellers

GlobalController

GreyFiberGlobalControl

GreyFiberLocalSiteControl

• Localcontrolovermarkedgeographicregion(e.g.,IXP)

• Mimicsminimalfunctionalitiesfromglobalcontrol• Configure links• Monitor connectivity• Report statisticstoglobalcontrol

SiteALocal

ControllerSiteBLocal

Controller

SiteCLocal

Controller

FiberExchange

BuyersSellers

GlobalController

GreyFiberGlobalControl

GreyFiberLocalSiteControl

PhysicalInfrastructure

• Composedoftraditionalnodesandlinks(e.g.,fiberpaths)

• Assumption• Fiberisalreadylit

• GreyFiber consistsofthreecomponents• Globalcontrol,localsitecontrolandphysicalinfrastructuresubstrate

• Supportsarangeofusescenarios• Small(secondstominutes),medium(hours),large(daystomonths)andextra-large(years)• Shortlifetimetoaddressunexpectedoutagesanddemands• Medium-to-largetoserviceunexpecteddemandswithoutdeadlines• Extra-largetosupporttraditionallease

22

GreyFiber systemdesign

GreyFiber implementationandevaluation

• Implementedin~22KlinesofPythoncode

• EvaluatedinGENIandCloudLab testbeds

23

Keyresults

• PerformancebenefitsofGreyFiber?

24

1GonGENI 10GonCloudLab

Questions?

25

RamDurairajanram@cs.uoregon.edu

ThankstoRezaRejaie,PaulBarford,JoelSommers,WalterWillinger and“great”students!