Embed Size (px)
Citation preview
WP 4Data management and
harmonisation
Robert Huber ([email protected])Andree Behnken ([email protected])
marum, University of Bremen
General Assembly 2017Vilanova i la Geltrú, Spain; 27 – 29 June 2017
NERC, OGS, HCMR, UiB, PLOCAN, AWI, Ifremer, INGV, UNIABDN, CNRS, IEO, INDP, UPC, 52°North GmbH,
CNR
Improve access to marine observatory data
Harmonise standards, formats and workflows covering the complete life cycle from real-time data acquisition to long-term archiving
Provide a formal basis for data exchange between FixO³ infrastructures by addressing data policy aspects and providing a common FixO³ data policy
Improve standardisation, interoperability and harmonisation with European and international initiatives
Coordinate and harmonise implementation / integration of Service Activities
ObjectivesWP 4 – Data management and harmonisation
Data policy● Nice and brief: 2 pages
● provides a formal base for data exchange by defining specific data formats and transport protocols that observatory operators agreed to adhere to by signing a Statement of Compliance for the FixO³ data policy.
● Has come to the attention of the European marine observing community
WP HighlightsWP 4 – Data management and harmonisation
Metadata catalogue● distributed data available from one location
WP HighlightsWP 4 – Data management and harmonisation
OceanSites
Moist (INGV)
PLOCAN
COPERNICUS
PANGAEA
FTP servers(at institutes)
Datafiles located at:
Transfer Transfer
Automated process:
Metadata extractionand creation of
Dublin Core files topopulate metadata
catalogue
Metadata files
Metadata cataloguelocation: PANGAEA
Metadata files
Metadata catalogue● distributed data available from one location
WP HighlightsWP 4 – Data management and harmonisation
Datalinks provided by BLIT
NetCDF to metadata conversion (Dublin Core)
Metadatacatalogue
Metadata catalogue● distributed data available from one location
WP HighlightsWP 4 – Data management and harmonisation
Datalinks provided by BLIT
NetCDF to metadata conversion (Dublin Core)
PANGAEA OAI-PMH results
Metadatacatalogue
Metadata catalogue● distributed data available from one location
WP HighlightsWP 4 – Data management and harmonisation
Datalinks provided by BLIT
NetCDF to metadata conversion (Dublin Core)
PANGAEA OAI-PMH results
Metadatacatalogue
IFREMER SEANOE OAI-PMH (under development)
Metadata catalogue
WP HighlightsWP 4 – Data management and harmonisation
Metadata catalogue
WP HighlightsWP 4 – Data management and harmonisation
GEOSS standards and services registry● Implementation based on GEOSS CSR API
● Quick and easy access to observatory information, GEOSS resource pages and ISO-compliant raw xml
● Additional way of standardised FixO³ information and data dissemination
WP HighlightsWP 4 – Data management and harmonisation
GEOSS standards and services registry
WP HighlightsWP 4 – Data management and harmonisation
GEOSS standards and services registry
WP HighlightsWP 4 – Data management and harmonisation
SOS servers and SWE technologies● 4 SOS instances serving data from 6 observatories
● WP4 co-initiated and actively contributes to the marine-swe-profiles group* hosted by 52°North. This group develops standardised SensorML and Observations & Measurements profiles for marine observations. These profiles are crucial for flawless communication between SOS servers and clients.
● Group has grown rapidly and has members from across Europe and beyond which shows the large interest and the necessity to further develop and propagate these techniques
*https://wiki.52north.org/SensorWeb/MarineProfilesForSWE/WebHome
WP HighlightsWP 4 – Data management and harmonisation
Integration of FixO³ as a data network into the EMODNet physics portal
● Increases visibility and strengthens FixO³ within the European marine observations community
WP HighlightsWP 4 – Data management and harmonisation
WP HighlightsWP 4 – Data management and harmonisation
Workshop: “An introduction and practical use of European marine data infrastructures”
● workshop organized and conducted by the PANGAEA group at marum in 2015
● 2 days, 19 attendees● EMODnet/EuroGOOS, MyOcean, ICES, EurOBIS, PANGAEA and
SeaDataNet
EMODnet
WP8 (BLIT): seamless integration of metadata catalogue and registry into FixO³ portal
52North: SOS servers / SWE technologies
IFREMER SeaNOE: OAI-PMH server for direct metadata harvesting (under development)
CollaborationWP 4 – Data management and harmonisation
Create correct and complete metadata and provide it (and the corresponding data) timely
When creating metadata, consider what data consumers might search for and edit your metadata accordingly
Description, platform name, date and time formats…
Keep pushing new technologies (SWE...)
Lessons LearnedWP 4 – Data management and harmonisation
Ensure consistency of metadata catalogue
Prepare transfer of metadata catalogue (and other candidate components) to EMSO
(Final report)
Remaining ActivityWP 4 – Data management and harmonisation
Metadata catalogue
Standards and services registry
SOS servers and SWE components
Data policy
FixO3 LegacyWP 4 – Data management and harmonisation
FixO3 LegacyWP 4 – Data management and harmonisation
FixO3 LegacyWP 4 – Data management and harmonisation
FixO3 LegacyWP 4 – Data management and harmonisation
Thank you!
