10th June 2004 HiSEEN Presentation 1

ESA Earth Observation High Speed Network

(HiSEEN)

Rhodes, 10th June 2004

10th June 2004 HiSEEN Presentation 2

Agenda

• The ESA Earth Observation use of NREN/GEANT

• Network solution – Technical description– Pre-operations schedule

• Challenges– Implementation– Operational

• Issues for discussion

• Conclusions and way forward

10th June 2004 HiSEEN Presentation 3

The ESA Earth Observation use of NREN/GEANT

10th June 2004 HiSEEN Presentation 4

The European Space Agency promotes the exploration and development of space activities in Europe

The member states can perform more ambitious programmes while combining their know-how and financial resources

15 members states

Funded in 1969

ESRIN

ESOC

ESTEC

HQ

The European Space Agency

10th June 2004 HiSEEN Presentation 5

Which are the ESA activities ?

COLUMBUS (2004)Scientific laboratory for the ISS

HUBBLE (1990) Universe exploration

MARS ESPRESS (2003)Looking for live signs in Mars

SOHO (1995)Sun observation

GALILEO (2004, 2008)The European satellite navigation system

ARTEMIS (2001)New telecommunication technologies

ERS (1991,1995), ENVISAT (2002)

Earth Study

Develop technologies based in the satellites use

Promote the European industry activities

Increase the knowledge of the: solar system and universe Earth and its environment

The European Space Agency

10th June 2004 HiSEEN Presentation 6

ESA ESRIN organisation

• Earth Observation Directorate– Science and Application Department– Ground Segment Department

• Operations and Infrastructure Directorate– Information Systems Department

• ESACOM Network (WAN, LAN)• Security & Mobility• IT infrastructure

10th June 2004 HiSEEN Presentation 7

Satellites observing the Earth

10th June 2004 HiSEEN Presentation 8

EO data: Ozone hole

Derivated UV index

10th June 2004 HiSEEN Presentation 9

Roma DEM derivated from SAR

EO data: Digital Elevation Model

10th June 2004 HiSEEN Presentation 10Amsterdam Airport

(ERS SAR, 25 m)

EO data

10th June 2004 HiSEEN Presentation 11

KIRUNA

ESA/ESRIN

ENVISAT

X-Band

ARTEMIS

The Earth Observation Ground Segment

USERS

NRT Products

NRT

Prod

ucts

Ka-Band

Ka-Band

10th June 2004 HiSEEN Presentation 12

F-PAC

E-PACD-PAC

I-PAC

UK-PAC S-PACPDHS-K

PDHS-E

NRT Processing Centres at ESRIN and Kiruna

Processing and Archiving Centres (PAC) in different European locations

Data shipment in the Ground Segment

10th June 2004 HiSEEN Presentation 13

F-PAC

E-PACD-PAC

I-PAC

UK-PAC S-PACPDHS-K

PDHS-E

NRT Processing Centres at ESRIN and Kiruna

Processing and Archiving Centres (PAC) in different European locations

Data shipment in the Ground Segment

10th June 2004 HiSEEN Presentation 14

Online Data Access Objectives

• The EO products shall be distributed electronically to the end users located around the world

• The EO data (Raw, and level 1 products) shall be primarily distributed in the Payload Data Segment electronically

• Phase 1 – 2004– On-demand products distribution– Electronic data circulation between centres

• Phase 2 – 2005– Interactive online data request and retrieval – Integration of non-ESA missions

10th June 2004 HiSEEN Presentation 15

Basic Principles

• On-line Archive: Mass Storage Tape Libraries or on disk• User data request via Internet (order or subscription)• Product retrieval via Internet:

– High speed Internet backbone (GEANT/NREN)– ISP augmented with load-balancing and re-routing COTS

• Product distribution via Satellite

• Electronic data distribution between GS Centers using High Speed Intranet VPN (based on GEANT/NREN)

• Security – Detect and avoid unauthorized use of EO data

• User authentication• Standard COTS encryption (IP VPN)• Accounting of data downloaded

– Protection from malicious intrusion• ESA Network Security policy as baseline with Intrusion Detection System

10th June 2004 HiSEEN Presentation 16

Archive

TX

Architecture

Acq Stations

INTERNET

EndUsers

Acq. Stations

Archive

SATELLITE

PFD-NSDFFSEWFS

MUIS

PFD-NSDFFSEWFS

ESRIN

Archive PFD-NSDFFS

INTRANET

SD

SS

DS

SD

S

10th June 2004 HiSEEN Presentation 17

Centres

• Frascati (IT): ERS, Envisat• Kiruna Salmijarvi (SE): ERS, Envisat, Cryosat• Kiruna ESRANGE (SE): Landsat MMS, ALOS• Farnborough (UK): ERS, Envisat• Oberpfaffenhofen DLR (DE): ERS, Envisat, MODIS, DLR

missions• Matera (IT): ERS, Envisat, Landsat TM/ETM• Maspalomas (ES): Envisat, ERS, SeaWiFs, NOAA• CNES, Toulouse (FR): Envisat, CNES missions, Cryosat• Svalbard (NO): Envisat, ADM• Tromsoe (NO): ERS-2 ATSR, TPM• Neustrelitz (DE): TPM, ALOS

• Gatineau (Canada) ERS-2, ADM• Prince Albert (Canada) ERS-2, ADM• (Finland) Envisat

10th June 2004 HiSEEN Presentation 18

Initial requirements

• Electronic data shipment between Centers– 34 Mbps incoming or outgoing nominally 60% occupied– ~200 GByte per day– MTTR maximum 1 day

• Internet Data distribution to users– > 34 Mbps outgoing per Centre– High availability and guaranteed QoS for NRT users

• Bandwidth requirements evolution (next 10 years)– X10 for EO constellations for Global Environmental

Monitoring (GMES) – X50 for high resolution satellites

10th June 2004 HiSEEN Presentation 19

Network solution

10th June 2004 HiSEEN Presentation 20

HiSEEN: High-Speed Network

GEANT

G-WIN (Germany)

Neustrelitz (DLR)

Oberpfaffenhofen (DLR)

Uninett (Norway)

Tromsoe(KSAT)

SUNET (Sweden)

Kiruna Salmijarvi (SSC)

Esrange (SSC)

GARR (Italy)

Matera (ASI, Telespazio)Frascati

(ESA)

Toulouse (CNES)

Maspalomas (INSA)

Farnborough (Infoterra)

Renater (France)

RedIRIS (Spain)

Ukerna (UK)

Svalbard (KSAT)

HiSEENHiSEEN

100 34

100 1000

34

34

1616

(155)

20-30

17

16

10th June 2004 HiSEEN Presentation 21

HiSEEN NREN Connections Status

Country Site NREN NREN Service

Frascati OK

Matera August

Kiruna Salmijarvi OKKiruna Esrange OK (via

Salmijarvi)

Oberpfaffenhofen OK

Neustrelitz SeptemberUK Farnborough UKERNA OK

Svalbard OK (via

Tromsoe)

Tromsoe OKSpain Maspalomas RedIRIS SeptemberFrance Toulouse Renater September

Italy

Sweden

Germany

Norway

G-WIN

SUNET

GARR

UNINETT

10th June 2004 HiSEEN Presentation 22

EO Centres Connections Speed

Country Site NREN Bandwidth [Mbps]

Frascati 8 (16)

Matera 16 (24)

Kiruna Salmijarvi 34

Kiruna Esrange 34Oberpfaffenhofen 34

Neustrelitz 34

UK Farnborough UKERNA 17Svalbard 34

Tromsoe 34

Spain Maspalomas RedIRIS 16France Toulouse Renater 16

Italy

Germany

Norway

DFN

GARR

UNINETT

SUNETSweden

10th June 2004 HiSEEN Presentation 23

HiSEEN NREN Connections Interfaces

Country Site Access Router Interface

Italy Frascati Cisco 3745 ATMItaly Matera Cisco 3745 FESweden Kiruna Salmijarvi Cisco 3745 FESweden Kiruna Esrange Cisco 3745 GEGermany Oberpfaffenhofen Cisco 3745 E3/G.703Germany Neustrelitz Cisco 3745 E3/G.703UK Farnborough Cisco 3745 FENorway Svalbard Cisco 3745 E3/G.703Norway Tromsoe Cisco 7206 GESpain Maspalomas Cisco 3745 FEFrance Toulouse Cisco 3745 FE

10th June 2004 HiSEEN Presentation 24

HiSEEN Generic Centre Design

Others ISP Internet

Others ISP Internet

NREN/GEANTInternet

NREN/GEANTInternet

HiSEEN Router

High-Speed Firewall

Data Access Portal and

Distribution Server

Data Access Portal and

Distribution Server

Com-NetCom-Net

Data Acquisition and

Processing

Data Acquisition and

Processing

Site Front-End LAN

Site Front-End LAN

Data Archive

Data Archive

EO Centre

Electronic Data

Shipment

Electronic Data

ShipmentSatellite

Distribution Network

Satellite Distribution

Network

10th June 2004 HiSEEN Presentation 25

HiSEEN Secure Centre-to-Centre Communication

Electronic Data Shipment

Electronic Data Shipment

HiSEEN Router

High-Speed Firewall

HiSEEN Router

NREN/GEANT Internet NREN/GEANT Internet

VPN

High-Speed Firewall

Centre A Centre B

Electronic Data Shipment

Electronic Data Shipment

10th June 2004 HiSEEN Presentation 26

HiSEEN User Scenario

Local ISP Internet

Local ISP Internet

NREN/GEANTInternet

NREN/GEANTInternetAcademic

User

Sat User

Generic User

HiSEEN Router

Data Access Portal and

Distribution Server

Data Access Portal and

Distribution Server

Com-NetCom-Net

Data Acquisition and

Processing

Data Acquisition and

Processing

Site Front-End LAN

Site Front-End LAN

Data Archive

Data Archive

EO Centre

Electronic Data

Shipment

Electronic Data

ShipmentSatellite

Distribution Network

Satellite Distribution

Network

10th June 2004 HiSEEN Presentation 27

Pre Operations

Country Site NREN Site Pre Operational

Frascati June

Matera September

Kiruna Salmijarvi JuneKiruna Esrange JuneOberpfaffenhofen June

Neustrelitz OctoberUK Farnborough UKERNA June

Svalbard June

Tromsoe JuneSpain Maspalomas RedIRIS OctoberFrance Toulouse Renater October

DFN

SUNET

GARR

UNINETT

Italy

Sweden

Germany

Norway

10th June 2004 HiSEEN Presentation 28

Challenges:ESA is a customer with points of

presence in many countries

10th June 2004 HiSEEN Presentation 29

ESACOM IP VPN

ESTEC (Noordwijk)

Kiruna

ReduEAC CologneESOC (Darmstadt)

ESRIN (Frascati)Fucino

Perth

Moscow

Malindi

Maspalomas

Kourou

CDN

WashingtonHouston

BrusselsESA ParisToulouse

Villafranca

Ground stations used by ESA

ESA ground stations

Offices

Establishments

Ariane downrange stations

Natal

Libreville

Ascension

10th June 2004 HiSEEN Presentation 30

ESACOM IP VPN Map

10th June 2004 HiSEEN Presentation 31

HiSEEN Implementation Challenges

• Several and different contracts and prizing policy to manage

• Different approaches in procurement phase– Direct via NRENs– Indirect via 3rd Party (SSC, KSAT)

• Complex interface with national TELCO– changes from country to country– difficult in some locations

• Different technology for Access Routers to be procured and configured– ATM, F/G-Ethernet, E3/G.703

10th June 2004 HiSEEN Presentation 32

Implementation Challenges

• In few words:

– A new NREN is another small new project with consequent cost

– fortunately the implementation challenges are “one off”

– unfortunately some of the issues remain over time during the operational phase.

10th June 2004 HiSEEN Presentation 33

HiSEEN Operational Challenges

• Operations are carried by the ESANOC as for the ESACOM– ESANOC Team located in Italy interface with:

• NRENS, • customer, • implement changes, • manage the network and related IT Infrastructure• perform the administrative day to day tasks

• “One to many” interface with NRENs is complex • Interfacing with different NREN implies:

– Learning different operational procedures for handling:• trouble ticket / troubleshooting• maintenance• changes management

– often using different languages

10th June 2004 HiSEEN Presentation 34

HiSEEN Operational Challenges

• Not all NRENs provide the same services

• Different access to important information likes:

• Network Maps

• Tools for bandwidth utilization

• Tools for link health status

• Access to router configurations

10th June 2004 HiSEEN Presentation 35

Services that not all NRENs provide

• Tools for:– access link bandwidth utilization– link health– logical and geographical network maps and information

related to utilization and available bandwidth.

• Notification services to the customer:– planned outages, – detected faults – foreseen time to recover

• Burst rate options rather than pure committed fixed rate

10th June 2004 HiSEEN Presentation 36

Issues for discussion

• A “more standard” interface for the customer rather then different interfaces

• End-to-end QoS– Today maybe possible only by direct agreement

between 2 NRENs. • Service Level Agreement (SLA) for:

– performance– availability– time to repair– etc…

• Quick time for bandwidth adaptation– E.g. time commitment for increase of capacity

10th June 2004 HiSEEN Presentation 37

Connectivity Requirements

•Connectivity with commercial providers for Data Access

•Connectivity with US, Canada and Japan and southern hemisphere for Data exchange amongst Centers

10th June 2004 HiSEEN Presentation 38

Policy and Limitations to use the NREN/GEANT network?

• Earth Observation scenarios– Data:

• ESA or other space agencies missions• Dual use missions• Value-adding data for service provision • EO Commercial missions (I.e.: SPOT, Ikonos

– Data source:• ESA centres hosted at ESA or other establishments• Research institutes• Public organisations• Commercial centres

– Destination / users• Scientific users• Experimental value-adding• Public value-adding service providers• Commercial value-adding service providers• Defense

10th June 2004 HiSEEN Presentation 39

Discussion and Way forward