MAMA Workshop MAMA Workshop on Marine Data & Information Managementon Marine Data & Information Management
Malta, 28Malta, 28thth January 2004 January 2004
Recent experiences and future plans in oceanographic data management
of the Mediterranean and Black Sea
Several data management actions have been made in a global international context
1996-1999 MTPII-MATERwww.ifremer.fr/sismer/program/mater/
1998-2001 MEDAR/MEDATLAS IIwww.ifremer.fr/sismer/program/mater/
MFSPP-MFSTEP1998-20012003-2006 www.bo.ingv.it/mfstep/
+ meta-data: Sea-search, EDIOS
They have been made possible by the development of common standards and infrastructures
WOCE/JGOFS, OMEX, CANIGO
GODAR
ARGO
MTPII-MATER 1996-1999MAss Transfer and Ecosystem Response
58 research groups from 10 EU Member States and 3 non-EU States 108 cruises (more than 1000 days of ship time)
130 long time series from fixed mooring and lagrangian drifters
254 main scientific equipments
A reference good quality multidisciplinary database > 200 parameters collected by:
MATER Database
Data Management Structure
Three regional Data CentresWesternCentralEastern
Publication of the Database on CDRom
MEDAR/MEDATLAS IIMEDAR/MEDATLAS II
EC-MAST Concerted Action (MAS3-CT98-0174/ERBIC20-CT98-0103)
DATA BASE CONTENTDATA BASE CONTENT(PARAMETERS)
Parameter Nb of Profiles Parameter Nb of Profiles
Temperature
284 371 Nitrite 10 508
Salinity 118 009 Ammonium 5 239
Oxygen 44 928 Chlorophyll 4 672
Phosphate 20 761 Alkalinity 2 548
Silicate 15 920 Total Phosphorus
2 381
PH 14 512 H2S 1 843
Nitrate 10 572 Total Nitrogen
153
SALINITYSALINITY
CHLOROPHYLLCHLOROPHYLL
CLIMATOLOGYMethodology
Computation of Climatological Analysis by Variational Inverse Model (VIM) algorithms
Computation made on finite elements and then re-interpolated on a regular grid (0.2 degrees in Latitude and Longitude), with smaller scales for local computations
T, S and bio-chemical climatology reviewed by regional experts and modellers
http://modb.oce.ulg.ac.be/Medar
CLIMATOLOGY - CLIMATOLOGY - ResultsResults
Selected numerical fields depending on data availability:
Annual , seasonal and monthly climatology
Temperature, Salinity
Annual and seasonal
Oxygen, Silicate, Phosphate
Hydrogen sulphide (H2S) in the Black Sea
Annual only
Nitrate, Nitrite, pH, Ammonium, Alkalinity, Chlorophyll
No climatology
Total Phosphorus, Total Nitrogen+ 2500 horizontal maps, vertical sections and data
location
SALINITY at 10m SALINITY at 10m DepthDepth
CD-ROM 4: climatology Black Sea + E-Mediterranean
CD-ROM 3: ClimatologyGlobal + W-Mediterranean
DATA PRODUCTDATA PRODUCT(A set of 4 CD-ROMs)
CD-ROM 2: DatabaseObserved data + SELMED interface for extraction (according to various criteria), interpolation and visualization - export formats: MEDATLAS, CSV or ODV.
CD-ROM 1: Documentation on the project and its resultsCruise inventorySoftware
QCmedarODV
MFSPP Real time data management
VOS Voluntary Observing ShipM3A Multisensor Moored Array MEDARGO Subsurface Profiling SystemGLIDERS Basin Wide Monitoring Technology Atmospheric forcing dataSatellite Data
MFSTEP RT Data Access XBt
MFSTEP RT Data Access – MEDARGO Floats
Standardization
mandatory meta-dataISO 19115
common exchange format(s) : ASCII : MEDATLAS NetCdf : ARGO/MFSTEP
quality controlsOn dataOn products
Requested for interoperability :Communication protocol
Marine XML
QUALITY CHECKS
QCO : Automatic check of the formatQC1 : Automatic and visual check of the headers
QC2 : Automatic and visual check of the data points
a quality flag to each numerical value (GTSPP flag scale)
QC1: Location, date, duplicates
QC-2 : check of the data points
Automatic Checks ResultPressure + one more
observation (E)Out of the regional scale
(min & max values)Increasing pressure
Data below the bottom depthCoherence with pre-existing
statistics (LEVITUS, MODB, MEDATLAS)
No constant profilesSpikesVertical stability
E= Elimination
Conclusion 1: Present available Conclusion 1: Present available data infrastructure and services data infrastructure and services for the Mediterranean and Black for the Mediterranean and Black
SeaSea
The data management network of NODC/DNA disseminate data from national and international programs provides basic data services:Implementation of internationally agreed protocols (when available) and practices for data formatting and checking,Continuous compilation of national data, quality checking with feedback to source scientists, perennial archiving,Data dissemination : routine regional or thematic subsets, and answers to specific requests,State of the art watch to develop standards and make use of the communication technology.
Conclusion 2: What remain to be done
Direct internet access to the most complete and integrated data sets : historical data + data released in recent projects +real time data more quality data and products such as estimates of the mean, decadal, seasonal, monthly statistics at basin, regional and shelf scalesInsure continuity and integration with other Pan-European and international programs:
Avoid to stop the dynamicsCompatibility with other networks
Develop the standardization with ISO 19115 and Marine XML, especially for meta-data and communicationDevelop marketing to and feedback from the users
Avoid to create new non compatible systems
SEA-DATANET : New concerted actions in
preparationto develop :
An internet integrated portalA communication protocol (ISO19115, Marine XML) between local systemsQuality Control procedures to be applied on data and products according to the existing international standards or standards developed in the project, especially for non-physical dataMarketing of the user community, to get more data and provide better servicesEnhanced international cooperation & capacity building activities
Sea Data network
a semi-distributed model that incorporates, but enhances, the existing infrastructures
professional archiving centresscientific centres SMEs
User
Elements of the Oceanographic Data System
Science Centres
Data Centres
Data & Meta Data Scientific
ProductsStandard Products
Phases of Sea-Datanet
1. Design study : protoype of the system On line networking of a limited number
of centre to provide data Access to all via internet Test of feasibility and cost estimation
for any current parameter2. Development of the system
On extended network of data sources On a limited number of parameters
3. Implementation and evolution
Expected long term results of Sea DataNet
Standardize, secure and disseminate the data holding of the Pan-European communityDecrease or optimisation of the overall costs of the data management of the projects Training on standards and methodologies developed in the projectRobust statistics and trends over the last decades of the physical and bio-chemical parametersA recognised Pan-European data infrastructure able to contributes to international programmes related to GOOS/MEDGOOS, CLIVAR,JGOFS..