15
EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator ERF Meeting, Brussels, 7 May 2014

EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

EUDAT Common Data Services for

Science Peter Wittenburg, EUDAT Scientific Coordinator

Kimmo Koski, EUDAT Project Coordinator

ERF Meeting, Brussels, 7 May 2014

Page 2: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Data Loss is real and significant ...

2

Nature  news,  19  December  2013  

…and so is Data growth

Page 3: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Collaborative Data Infrastructure

Trust  

Data  Cura7

on  

Data  Generators   Users  

Common  Data  Services  

Community  Support  Services  

curation is a task of all parties

organizational and cultural closeness are primary for TRUST

accepting a rich data landscape with many actors & centers taking various roles

Page 4: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Widely observed trend

4

discipline specific sensors,

algorithms

discipline specific processing algorithms

discipline independent data management, storage, processing

frameworks

discipline specific data management, storage, processing

frameworks

discipline specific sensors,

algorithms

discipline specific processing algorithms

data staid in institutions data can move around

how far can we go?

network capacity and security

most restricting factors

all at different locations

Page 5: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

EUDAT – Federation of Centers

5

AND: communities were put into the driving seat

results:

- we have services ready but lack an overall architecture ☺

- we rejected all technology not mature enough such as AAI

Page 6: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

EUDAT Nodes Community Center EUDAT Data Center

number of community nodes growing due to collaboration projects

Page 7: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

EUDAT Service Overview

being offered in progress to come

Type  Registry  data intelligence  

RDA  Outcome  

installed Working Groups

Page 8: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

DRIHM – B2SHARE for Citizen Data

Community Domain Specific Metadata

Citizens

Describe

Page 9: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

VPH B2SAFE Replication + B2STAGE Processing Data

Replication at physical layer is simple (File, Cloud-Objects, etc)

Replication including logical nformation is complex (all different)

Staging to HPC complex as well

Page 10: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Collaboration Projects

10

Service   Collabora9on  B2FIND   17  B2SAFE   16  B2SHARE   14  B2STAGE   9  BNOTE   4  PID   3  AAI   1  WF   1  

Community  /  Focus  Atmospheric  science  Biobanks  Biodiversity  Biology  Cross-­‐disciplinary  Libraries  Climate    &  Climate  Modelling  Toxico  genomics  Environmental  Science  GeoSpa9al  Life  science    Marine  biology  Medical  science  Molecular  dynamics  Neuro  informa9cs  Physics,  chemistry,  nano-­‐science  and  materials  science  Seismology  Solid  Earth  GeoScience  Vulcanology  

Over  30  applica-ons  from  a  vast  range  of  scien-fic  communi-es  covering,  but  not  limited  to,  life  sciences,  atmospheric  sciences,  marine  biology,  physics,  chemistry,  nano-­‐science  and  materials  science,  medical  science,  biodiversity  and  climate  modelling

Page 11: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

DONA – world wide PID System

11

Digital  Object  Numbering  Authority  Senior  Experts  from  all  con9nents  Stewards  of  the  Handle  System  

Worldwide  Registra9on  Authori9es  Datacite,  EPIC,  CNRI,  etc.  

DONA  is  a  Swiss  founda7on  under  the  umbrella  of  ITU.  

compliant  with  RDA  

Page 12: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Sustainability from User Perspective

12

•  CSC, SARA, BSC, CINECA, FZJ, RZG etc. will have a long lifetime as far as we can see – they are anchors in science landscape

•  CLARIN, EPOS, ENES, etc. have their natural “entry nodes” which i often based on some history

•  Proper agreements between community and entry node (SLA, etc) •  EUDAT Data centers also have their agreements (SLA, OLA, joint

business model, etc) – some agreements driven by requirements are in place

•  moving ahead to EUDAT 2 – but there will definitively be no EUDAT3 EUDAT must have a sustainable funding model based on services and contracts

Page 13: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Thanks for your attention.

13

EUDAT is ready to serve science! http://www.eudat.eu

Page 14: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

A Network of Trusted Centers

•  Independent Centers working within a Common Framework to develop Services

•  Generic Data Centers with long experience of working together

•  Community Data Sites with connection to at least one Generic Center

•  EUDAT is about providing solutions in a federated environment

Generic  data  centres  

Community    data  sites  

Page 15: EUDAT Common Data Services for Science - ELETTRA Shapi… · EUDAT Common Data Services for Science Peter Wittenburg, EUDAT Scientific Coordinator Kimmo Koski, EUDAT Project Coordinator

Using Vs Joining •  using EUDAT

services: finding and accessing data, for instance, or storing smaller data sets by interacting with one of the CDI public front-end services vs

•  joining the CDI : implies a tighter integration with at least one of the EUDAT centre.

15