20
Integrations of the ESA Geohazards and Hydrology Exploitation Platforms with the EGI infrastructure Cesare Rossi, Cloud Solutions Manager Krakow, September 29th 2016

Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Integrations of the ESA Geohazards and Hydrology Exploitation Platforms with the

EGI infrastructureCesare Rossi, Cloud Solutions Manager

Krakow, September 29th 2016

Page 2: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

About our CompanyTerradue’s fact sheet

We support Earth Sciencesat many scales

”“

PassionatePeople15

EU Nationalities5

DevOps Culture1

Page 3: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Thematic Exploitation Platforms

■ Develop and employ open-source software

■ Implement standards■ Implement infrastructure

independence■ Include pay-per-use options

■ Leverage also commercial providers

■ Secure IPR■ Be community and impact

driven■ Enable sustainability

The fundamental principle is to move the User to the data and tools

”From TEP Official Website

Principles

Page 4: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Thematic Exploitation Platforms

Page 5: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

■ Specific fields in the domain○ Geohazards domain

■ Earthquakes■ Volcanoes■ Landslides

○ Hydrology domain■ Hydrological modelling■ Flood mapping■ Water quality monitoring

■ Data-intensive research○ Targeted data○ Targeted software

THEMATIC Exploitation Platforms

Page 6: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

■ Very fast access to large volume of data○ EO data

○ In-situ data

■ Distributed processing○ Hybrid Cloud infrastructure

○ Access to GRID resources

Thematic EXPLOITATION Platforms

Page 7: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

■ Collaborative tools○ Referencing Publications

○ Sharing processing results

■ Different roles○ Community scientists

○ Data providers

○ Resource providers

Thematic Exploitation PLATFORMS

Page 8: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Geohazards and Hydrology TEPs

■ SaaS “Software-as-a-Service”○ Offering your EO processor on

the platform as a Service

○ With your data selection

■ PaaS “Platform-as-a-Service”○ Hadoop Cloud Sandboxes

“processor incubation chambers”

○ Catalogue for EO dataset and

time series and Data Storage

Infrastructure services

Page 9: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Terradue Cloud PlatformHybrid infrastructure

Cloudstack

Interoute

EC2 - powered by jclouds

Amazon Web Services

OCCI

EGI Federated Cloud

Opennebula registered partner

Terradue

Cloudsigma API [upcoming]

Cloudsigma

AWS

EGI

CSG

IRT

T2

Page 10: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

EGI Foundation and Terradue partnershipKey outcomes

The M2M communication is realised through the Open Cloud Computing Interface (OCCI), ensuring integration, portability, interoperability and innovation.

Use of standard interfaces

We can rely on well-defined operational processes, having the EGI Foundation partner acting as single point of contact of the EGI Federated Cloud.

Reliable operations

We use Cloud resources within the European boundaries. In fact, it is mandatory for certain processing services due to their organisations’ policies.

European cloud resources

The partnership with EGI Foundation enhances the sustainability of the involved projects, helping in maintaining the systems operational beyond the life of the relative projects.

Project(s) sustainability

Page 11: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Integration Process

the technical requirements

Analysing

the OCCI interfaceIntegrating

functional and performance results

Evaluating

Assess Develop Validate Operate

users to run near real-time processing

Supporting

Page 12: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Integration RoadmapWhere do we stand

2015 2016 2017 2018

Feas

ibili

ty

stud

yIn

fras

truc

ture

se

tup

Dev

elop

men

tR

C A

ccep

tanc

e

GEP

and

H

EP P

ilots

Mon

itor a

nd

impr

ove

SLA

s

Mon

itor a

nd

impr

ove

SLA

s

GEP

Pilo

ts

RC

Acc

epta

nce

Page 13: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Current Agreements StatusWhat we access from EGI

800 360 6

GB RAM vCPUs Resource Centers

Page 14: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

DemoGeohazards TEP systematic processing

The data are automatically selected on a regular basis, according to different policies:

■ Time driven■ Data driven

Scheduled User Processing

https://geohazards-tep.eo.esa.int

Page 15: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

DemoGeohazards TEP systematic processing

It’s a data driven systematic processing. The service will follow a ramp-up period starting from September 2016 until Spring 2017:

■ EU Tectonic area■ World tectonic area (40%)■ World tectonic area (70%)■ World tectonic area (100%)

DLR InSAR Browse Medium Resolution Service

https://geohazards-tep.eo.esa.int

Will be supported by

Page 16: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

DemoGeohazards TEP systematic processing

It’s a data driven systematic processing. This service provides an amplitude and coherence product at 50m systematically from Sentinel-1 data for a number of volcanoes globally.

DLR InSAR High Resolution Change Monitoring Service

https://geohazards-tep.eo.esa.int

Will be supported by

Page 17: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

DemoGeohazards TEP processing on-demand

The User triggers the processing services from the Geobrowser Web interface.The User searches and filters the EO data from an Opensearch Catalogue, then passes the selected inputs to a processing service.

User-Driven processing

https://geohazards-tep.eo.esa.int

Page 18: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

DemoGeohazards TEP processing on-demand

ADORE stands for Automated DORIS Environment. It is development started at the University of Miami Geodesy Group, to help researchers generate interferograms with ease. They are open-source projects.

Interferometry with ADORE DORIS

https://geohazards-tep.eo.esa.int

Page 19: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

DemoGeohazards TEP processing on-demand

Land surface temperature map (Celsius degrees) obtained by multi-spectral optical sensors (LANDSAT 8) generated in GeoTIFF format.Upcoming versions will process S-2 and S-3 data.

INGV STEMP Optical chain for Volcanoes

https://geohazards-tep.eo.esa.int

Will be supported by

Page 20: Integrations of the ESA Geohazards and Hydrology ... 2016_CR.pdffrom September 2016 until Spring 2017: EU Tectonic area World tectonic area (40%) World tectonic area (70%) World tectonic

Thank you !

https://www.terradue.com