Janet UpdateMartin Dunmore

Multi-Service Networks 2012Cosener’s House, Abingdon, 12th July 2012

Topics•Intro to Janet

•Janet6

• Support for Network Research

Introduction to Janet

Area SitesHigher Education 211Further Education 520Local Authority

123Self-funded

53Research Council 41

948

Use of Janet

LA / Schools

HE/FE

Adult

Relative sizes of sectors: from funding body statistics on staff & student numbers

18 million possible users of JANET.

ConnectionsUsers

Network Figures

Routing equipment: ~100 routers in the core of JANET ~300 regional area routers ~520 end organisation routers

Circuits/fibres: ~1,500 circuits make up JANET

non-trivial task to monitor~80% of total outage time

The SuperJanet5 Network

•Six core points of presence.•A core across the UK of 20Gbit/s, 80Gbit/s and 100Gbit/s.

•19 regional distribution areas.

•Multiple connections for resilience.

•~900 organisations connected.

•Point to point “light path” connections for research.

•~400Gbit/s external connectivity.

Global Transit#2

Global Transit#1

Glasgow

Leeds

London

Bristol

Warrington

Reading

Telecity HX

Telehouse

10G40G

100G

The Network

Telecity Manchester

Global Transit#3

Major Peerings

Regularly Hitting > 100Gb/s of Traffic

From Janet To JanetMean 18.5 Gb/s 58.6 Gb/sMax 29.7 Gb/s 115 Gb/sMin 5.72 Gb/s 9.57 Gb/s

Typical week in May…

Total Janet Traffic PredictionJa

n'10

Mar

'10

May

'10

Jul'1

0

Sep'

10

Nov'

10

Jan'

11

Mar

'11

May

'11

Jul'1

1

Sep'

11

Nov'

11

Jan'

12

Mar

'12

May

'12

Jul'1

2

Sep'

12

Nov'

12

Jan'

13

Mar

'13

May

'13

Jul'1

3

Sep'

13

Nov'

13

Jan'

14

Mar

'14

May

'14

Jul'1

4

Sep'

14

Nov'

14

Jan'

15

Mar

'15

May

'15

Jul'1

5

Sep'

15

Nov'

15

0

100

200

300

400

500

600

All External TrafficActuals Projected If Traffic doubles every 2 Years (from Jan'2010)

Gbps

SuperJanet5 Janet6

Janet6

• Similar topology to SJ5.• Two north-south paths• New east-west path from

Birmingham to Nottingham– Erdington to Lowdham

• No backbone PoP at Reading– Still have a regional PoP

• New PoP in Acton, West London

Janet6: Backbone Resilience

• Contractual– Favourable: Mandated 40Gbit/s in 2006 contract– Favourable: Worked with Verizon for deployment of

100GE– Less Favourable: Maximum bandwidth available for use

on each link• Increasing those needed technical and legal negotiations

• Engineering– Legacy of layered optical systems

• Provide 40G SDH and 100GE over system not designed for it

• Large “guard bands” of wasted bandwidth

Limits of SuperJANET5

• Manage the optical layer directly• For more detail see Networkshop presentation

– ROADM• Flexible optical platform

– DWDM– Theoretically 80 channels

– 100Gbit/s per lambda from day 1– Plans for 400Gbit/s and 1Tbit/s with better spectral

density• “Data DelugeBonanza”

– Big Science• LHC, SKA, Bioinformatics, ITER, Radio Astronomy, Climate

Data– Day-to-day usage

Removing SJ5’s limits

• Original 2006 T-640 chassis still in service– 40Gbit/s per slot, 32 10Gbit/s ports per chassis

• Most upgraded to T-1600– Same chassis, new switching fabric and PSUs– 100Gbit/s per slot

• T-4000– Same chassis, new switching fabric and PSUs– 240Gbit/s per slot, 192 10Gbit/s ports per chassis– Two power supplied for resilience

• Each one takes 6, 60A, 48VDC feeds – 17kVA!• Migration

– Janet6 will be in new PoPs– Can’t move all the connections overnight– New routers and hand back the old

Janet6 IP Platform

• Investigated provisioning over optical platform– Not enough competitive offers for smaller chassis

• Investigated merging Lightpath and IP platforms– IP platforms are already short on chassis space, some

locations would require additional chassis• Keep on current MX960 platforms

– Upgrade interconnects to 100GE– Move 10GE lightpaths from lambdas to EoMPLS circuits

• Scope for point to point circuits without committed bandwidth– Shared with Janet IP access

Janet6 Lightpath Network

Janet6 Procurement Strategy• Options appraisal

• Procure dark fibre infrastructure

• Procure optical transmission equipment

• Management in-house by the Janet NOC

• Why? Agility• Janet NOC will have a view from the fibre up the stack to the

routers• Fewer contract/administrative boundaries or chains to cross• Directly translate the community’s requirements into engineering

• Why? Different contractual vehicles for fibre and equipment• Fibre: long-term, little need to change

• Optical equipment: rapidly evolving, highly competitive

competitive dialogue procedure

Janet6 Procurement Timeline

Progress to date• Procurement kicked off October 2011• Dialogue with 6 bidders during first half of

2012• Bids received from 2 suppliers

Procurement Update – Fibre

Current Status• SSET selected as preferred supplier• Design optimisation• Finalising contract & schedules• Signature by end July 2012

Procurement Update – Fibre

Progress to date• Procurement kicked off November 2011• Dialogue with 6 bidders during first half of

2012

Procurement Update – Equipment

Current Status• Bids received from all 6 suppliers• Evaluation underway• Selection by end July 2012• Signature by mid September 2012

Procurement Update – Equipment

• Fibre delivery by end March 2013• Equipment delivery by end April 2013• Commissioning• Migration by end July 2013

Rollout & Transition

Support for Network Research

Stuff we can help with•Router configs•Network diagrams•Access to Netsight (SNMP data)

– Be careful what you wish for!•Netflow data

– SBR exporters (1:10 to 1:50)– Some BAR exporters– Regional routers as and when we can

• TVN, Eastern– Subject to agreement data is non-anonymised– We don’t have much disk space to store it – 100GB!

UK Testbed for Loc / ID Research•Loc / ID – Decoupling Location and Identity from the IP address

– LISP, HIP, ILNP, SHIM6, others•Stimulate synergy between UK researchers in this area•Janet wants to get a handle on the operational pros/cons•Call for proposals should go out later this year

– Has been ready for a while but we need to resource internally•Modest funding: max 30k•12 months but testbed would stay up after that

SDN / OpenFlow Testbed?•Start off small scale

– 3x OF switches in Core PoPs– 10G inter-switch– 1G switch to user

• ‘Usual Suspects’– 1 or 2 controllers

•Scale up organically•Who manages the

– HW ?– Service ?

THANK YOU