30
MaNIDA - Marine Network for Integrated Data Access Data Portal German Marine Research Status quo and perspectives Data-Workshop EMODnet BSH, Hamburg 18.02.2016 A. Schäfer, R. Koppe & MaNIDA-Team

2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

  • Upload
    vanthuy

  • View
    212

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

MaNIDA - Marine Network for Integrated Data Access

Data Portal German Marine Research Status quo and perspectives

Data-Workshop EMODnet BSH, Hamburg 18.02.2016 A. Schäfer, R. Koppe & MaNIDA-Team

Page 2: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Status

Central search and access of data and publications of German marine research via the data portal

Helmholtz Impulse & Networking Fund 2012 – 2015

Focus on research vessels and platforms

Actual 4 data providers and 4 repositories

Open consortia:

Page 3: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Access to marine research data

Page 4: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Access to marine research data

Page 5: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

MaNIDA – cross-partner working groups

Portal – architecture, interfaces, standards

Catalogue – expedition meta data, reports, CSR

Underway Daten – DShip, devices, validation

Hydro acoustics – case study bathymetry data

Harmonisation – vocabularies, quality, standards and aggregation of data

Monitoring and near real-time data (German Bight)

Data Curation Center Landstation

Policies and directives

PreparationExpeditionCampaign

Archiving PublishingValidation

Page 6: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Architecture

FeatureCatalogue

GEOMAR

DOD/BSH

PANGAEA

COSYNA

AWI-Bathy

epic-AWI

HZG

Data PortalGerman Marine

Research

ExpeditionCatalogue

Index

Har

vest

er

Interfaces

Dat

a A

cces

s

data

pro

vide

r

*

* Harmonisation

publ

icat

ion

repo

sito

ries

MARUM

DOIs → Elsevier http://manida.awi.de/wshttp://manida.awi.de/sws

Page 7: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx
Page 8: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx
Page 9: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Keywords

Google/Amazonlike search

Page 10: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Facets, e.g.

region

expedition

device

parameter

author / PI

Geographic and temporal

coverage

...

Google/Amazonlike search

Page 11: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Google/Amazonlike search

Information on and citation of data sets

Meta data

Digital Object Identifiers DOI, global handles

Direct data download link (data provider redirect)

Relationships to other objects and publications

Page 12: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Harmonisation and identification of

Expedition information meta data

national/intern. identifiers, CSR

devices

parameters/attributes

projects

…07.10.2013 SEKOM12

Expeditions

Actual data compilations per cruise

Page 13: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

MonitoringÜbersicht

Web services of research platforms for operational and NRT-data to find and access directly

Page 14: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx
Page 15: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

User integration

We address marine scientists and scientific networks

and regulating funding and policy actors

Small user-workshops (institutional level, working groups and graduate schools)

Questionnaire for discussion and user survey ()

Usage tracking - data portal ()

(200 users/month → 150 redirects to data providers)

Feedback-function - data portal ( → ticketing is planed)

Presentation at funders, congresses, steering committees → KDM, BMBF, HGF-Dialogplattform Erde-Umwelt

Integration of/in EU- and international data infrastructures

Page 16: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Status – Nutzer Tracking im PortalUsage tracking in the data portal

Page 17: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Status – Nutzer Feedback im PortalFeedback function

Page 18: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

User dialog

Improvement of data content (repositories)

Where are my data?

Why there aren‘t any data of …?

→ Could you share and publish your data?

Insufficient harmonisation/categorising to find/aggregate data

I can’t find data under this term or name!

The data don’t fit together!

User requests ↔ ongoing improvements

Priorities ↔ resources

Page 19: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Status quo – MaNIDA / Data Portal

Less than 25% of data submission per ship’s station of our research vessel data are available (big research vessels)

→ not validated, not traceable, not in our repositories

We have to work continuously on a common base for harmonisation and categorising

We have to work on common workflows and defined responsibilities including resources.

Granularities of data sets are different:

1. supplement to publications 2. by cruise 3. single parameter

We need common guidelines / directives.

Page 20: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Perspectives – MaNIDA / Data Portal

1) Improvements of data portal and data providers

Harmonisation via internat. standards/vocabularies

Reasonable direct data access ( aggregation, products)

2) Guidelines

for data providers ()

Joint policy / DM-concept AWI, GEOMAR, HZG (½ 02/2016)

3) Central “Landstation” (incl. ~data curation center) for national (middle-big) research vessels (draft proposal )

Basic workflows underway data (coast calculation )

DMP → ticketing → responsible staff

Ship‘s device server http://www.dship-devices.de/web/search_device ()

4) Permanent funding for basic operation (HGF/POF/ LK2 ???)

Page 21: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Granularity, harmonisation and direct data access

Data Portal German Marine Research

DOD-BSH~ 900 Parameter

COSYNA~ 50 Parameter

PANGAEA> 130.000 parameters

Search by keywords / facetsdifferent granularity →

data sets of similar parameters→ bessere Kategorisierung

über einen Feature Catalogue

direct data access1:1-mapping of parameters

Ausweitung auf 10 Parameter→ Aggregation gleicher Parameter

über ein Datenwarenhaus→ better categorisationvia a Feature Catalogue

extend to more parameters→ aggregation of exact

parameters via data warehouse

Page 22: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Search by keywordsof meta data and abstractsvia Lucene Elastic Search

Page 23: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Direkter Datenzugriff

direct data access of precisely mapped parameters

Page 24: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Direkter Datenzugriff

direct data access of precisely mapped parameters

Download with individual DOIs and

handles

Page 25: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Web servicebathymetry

in preparation

integrated, visual selective access to hydro acoustic data (WMS, WFS)

http://manida.awi.de/geoserver/bathy/wms?service=WMS&version=1.1.0&request=GetMap&layers=bathy:v_swathfileident50

Page 26: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Web servicebathymetry

in preparation

Page 27: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Web servicebathymetry

in preparation

Page 28: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Download

Web servicebathymetry

in preparation

Page 29: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

Perspectives – central “Landstation”

Searchability and access of complete, quality assured and published primary data and data products

Linking of data and scientific publications

Visibility and citability of data and scientific results

International networking of national contributions

Validated information on expeditions

Transparency of the use of funds for evaluation

Enhanced planning of research projects and expeditions

PreparationDMP

ExpeditionData acquisition

ArchivingCitability

PublicationReuse

Validation

Page 30: 2016 02 18 EMODnet KDM BSH HZG MaNIDA as Print · 8VDJHWUDFNLQJLQ WKHGDWDSRUWDO6WDWXV ±1XW]HU 7UDFNLQJ LP 3RUWDO) ... Microsoft PowerPoint - 2016_02_18_EMODnet_KDM_BSH_HZG_MaNIDA_as_Print.pptx

…please use the data portaland leave us some feedback

Thank you