Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
The Mediterranean Data portal
EMODNET ADRIATIC meeting, Split, 3-4 December 2013
Leonidas Perivoliotis
Hellenic Center for Marine Research, Greece
Background on the data collection, processing and distribution in the Mediterranean: Platform-oriented data centers
20 ARGO floats deployed from VOS (few hours delay)
Daily satellite SST interpolated in RT on model grid (one day delay)
XBT VOS high resolution system (12 nm along track and full profile transmission, few hours delay)
Multiparametric buoys in: Ligurian Sea, Adriatic Sea and
Cretan Sea (few hours delay)
Open ocean monitoring by gliders (few hours delay)
Scatterometer DAILY winds analysis, 1/2x1/2 (one week delay)
JASON-1, GFO, ENVISAT, T/P Sea Level Anomalies
(few days delay)
T/¨P
ENVISAT
ERS
JASON
GFO
Collects and process data from Insitu platforms in the
Mediterranean Sea The regional node for the Insitu component of Marine Core
Service (MCS) Single point access for data provision to Med Marine Forecasting
Center (MFC) Distributes added value (quality controlled) data in a unique
format Built through MyOcean I&II, but it supports the Mediterranean
observing component of major EU projects in Operational Oceanography (Jerico, Perseus, FixO3).
Continuous expansion in terms of capacity in order to become the Regional Insitu MONGOOS Data Center.
The Mediterranean Data Portal
Infrastructure built on EuroGOOS strategy and supported through MyOcean I&II projects
Insitu Thematic Assembly Centers (TACs): A regional organization
Black Sea IOBAS/Bulgaria all data
Baltic Sea: SMHI/Sweden •Temp & Salinity : BSH/Germany •Current: SMHI/Sweden •Sea Level: DMI/Denmark •Bio : FMI-Syke/Finland
South West Shelves: Puertos Del Estado/Spain •Mooring : PdE •Underway data: Coriolis/France
North West Shelves: BSH/Germany •Temp & Salinity : BSH/Germany •Current: SMHI/Sweden •Sea Level: DMI/Denmark
Global Ocean : Coriolis/France •Link with international network s: Coriolis/France •ARGO: Coriolis,BODC,BSH •European Vessels: NIVA/Norway
Arctic: IMR / Norway all data
Mediterranean Sea : HCMR/Greece •Mooring : HCMR/Greece •XBT/CTD: ENEA/Italy •Drifter & Argo: OGS/Italy •Glider and Argo: Coriolis/France
16 Partners/ 11 countries Ensure the link with :
•International networks •EuroGOOS ROOSes •SeaDataNet
Process data in a common but distributed manner for MyO & ROOSes needs
The core tasks for the Insitu TACs
Define common distribution means: vocabularies, formats, organization, monitoring tools,…
Build a reliable distributed architecture for in-situ data delivery to Marine Forecasting Centers (MFCs) and MyOcean users
Converge on common quality control procedures and flag conventions
• Enhance the T&S basin scale consistency methods for global ocean and adapt them to regional scales, if possible
• Develop methods for Quality Control of biogeochemical data both in real time and delayed mode and provide recommendations for acquisition of biogeochemical data from various platforms
Turn into operation enhanced calibration/validation methods
The Role of Mediterranean Insitu TAC
Number of parameters:
•Physical: T&S, current, sea level
•Biogeochemical: Chlorophyll/Fluorescence, Oxygen, Nutrients
•Atmospheric: Air Temperature, Wind, Air Pressure
•Sea State: Waves (Significant Height, Direction, Period)
•Any additional parameters that may be available (radiation, sound data, etc.)
Integrate in-situ data in product accessible through global and regional portals
•Common format
•Common NRT QC
•Common Quality flags
•Common distribution tools
•Single access point
Ensure a minimum level of quality on the data delivered
• In Near real time ( 24h to a week)
• In delayed mode
Assessment of the products at basin scale
Required by MyOcean
The Insitu TAC relies on close collaboration with:
EuroGOOS – Coordination of the observing networks in European scale
JCOMM - Coordination of the international observing networks
SeaDataNet which consolidates the NODC network and provides delayed mode products
Temperature & Salinity data
Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October 2013 – http://www.mongoos.eu
Total number of stations
Meteo parameters
Waves data
Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October 2013 – http://www.mongoos.eu
Current recordings
Sea level
Mediterranean observing capacity: Fixed stations MONGOOS inventory, updated on October 2013 – http://www.mongoos.eu
Data acquistion:
• Data are collected through direct links with the Production Units
• Data are converted in a unique format (Oceansites netcdf v1.1 compatible)
• Extended guidance for new partners in order to provide all the necessary information
Quality control:
• Apply automatic quality control procedures on each parameter, elaborated in coherence with international agreement (in particular SeaDataNet).
• Procedures applied after agreement with the data originators in order to avoid conflicts and effort duplications.
Validation/Assessment :
• Assess the consistency of the data over a period of time in an area. The aim is to detect possible incoherencies with nearby data that could not be detected by automatic QC.
Distribution:
• Disseminates the data through MyOcean/EMODET to the external users
The Mediterranean Data Portal
Main functions
Data acquisition
Main steps:
• Direct connection is established (usually through ftp protocol) between the Med portal and the data provider
• Information is provided about the required metadata that should be supplied together with data (ex. station position, date, frequency of measurement, platform name, depth of each sensor, contact person, PI, etc.)
• Guidance is also provided on how the required daily and monthly files should be created.
• Information exchanged about the QC procedures
• Data are provided in the originator’s native format, no need for conversion to NetCDF. This procedure is performed by the IT staff of Med portal.
The Mediterranean Data Portal
The Mediterranean Data Portal Sample of data global attributes – NIB Vida buoy
Data carry complete information about the originator and the assembly center(s)
Real Time QC Function :
Quality Control procedures are applied in:
• Temperature and Salinity
• Sea Level
• Current from drifters or Current from moorings
• Bio-geochemical (Still under development)
Implementation
• automated procedure that should avoid flagging good data
• applied through an agreement with the primary Production Unit
• In most cases minor corrections are applied to the flags that have already been assigned by the Production Unit
The Mediterranean Data Portal
Meta data-implementation and/or verification: Position, Date, Method, Specification, PI, Processing, Comments
Automatic QC for Argo, gliders, CTDs and XBTs Visual QC QC Flag Scale
Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Pressure Increasing Test Test 9: Spike Test Test 10: Top and Bottom Spike Test Test 11: Gradient Test Test 12: Digit Rollover Test Test 13: Stuck Value Test Test 14: Density Inversion Test 15: Grey List (Argo, Glider) Test 16: Gross salinity or temperature sensor drift (Argo, Glider) Test 18: Frozen Profile Test
code Meaning 0 no QC was performed 1 good data 2 probably good data 3 bad data, but correctable 4 bad data 5 value changed 6 below detection limit 7 in excess of quoted value 8 interpolated value 9 missing value A Incomplete information mandatory for automated QC
Extended QC: Comparison to a climatology and the surrounding measurements: objective mapping or local interpolation method. Other comparisons.
•display Meta data •display the profiles •T/S diagrams •time/depth plots •scatter plots •maps displaying location •control of spikes and other irregularities •control of density profile if extended QC is included, visual QC can be reduced to be only applied on alerted profiles
Real-time quality control on temperature and salinity data
Test 1: Platform identification Test 2: Impossible Date Test Test 3: Impossible Location Test Test 4: Position on Land Test Test 5: Impossible Speed Test Test 6: Global Range Test Test 7: Regional Global Parameter Test 8: Spike Test Test 9: Climatology Test 11: Instrument range Test 12: Rate of change in time Test 13: Stationary Test
Automatic QC for time series
The Mediterranean Data Portal
ftp Serv.
HCMR
Data
Base
Mooring
Data
Vessel
Data
Glider
Data
Cross-Validation of T, S
Float
Data
VALIDATION
RT FILES DM FILES
HCMR Data Base
In-Situ Product
Validation of Temperature and Salinity data
Validation procedure: Cross-validation of the physical variables (T, S) as derived from VOS, moorings, floats and gliders. The estimated differences will be analyzed as a function of the spatial and temporal distances between the measurements
The Mediterranean Data Portal
The portal structure is in compliance with MyOcean standards
The Mediterranean Data Portal
HCMR Moorings
(M3A, Poseidon network)
ENEA CTDs/XBTs
OGS Drifters – ARGO DM
IFREMER Gliders ARGO RT GTS
Additional Providers
(CNR, OC-UCY, ISPRA, NIB, OGS,…)
HCMR
MONGOOS Regional DU
Me
dite
rranean
In Situ
TAC
Daily files
T S
B i o c h e m I c a l
Real Time QC
ftp Serv.
GDAC
External Users (RIU, EIA) -Public, -Standard, -Specific -Privileged (Downstream)
MFC’s
The Med portal contains
data beyond the
MyOcean portfolio by
hosting all the available
data from the different
platforms (meteo &
wave data, additional
marine parameters)
PdE Mooring + tide gauges
EMODNET PP
The Mediterranean Data Portal – Production line
Monitoring performance
Daily recording of several indicators regarding data capacity, quality of information and timely update of the portal from the data originators
The Mediterranean Data Portal
Data availability on 27th of November 2013 (1990-now)
126 profilers 42 active
27 Gliders 3 active
95 moorings 66 active
1298 drifters 6 active
134 XBTs 3 active
72 CTDs
82 Thermosalinographs
6 active
2168 unique platforms
30258 total files
The Mediterranean Data Portal
Building historical data sets • Historical datasets have been created for the time period since 1990
(depends on each platform’s availability) • Data sets were produced merging the monthly files • Validation/Assessment procedures have been applied • The historical dataset building was not possible in some cases due to
metadata inconsistency
Platform type Number of different platform codes
Number of historical netCDF created
Drifter 1283 1283
Profiler-Glider 334 334
Vessel 298 298
Mooring 92 52
etc 35 35
The Mediterranean Data Portal
1600 cruises (1990-2012) from SeaDataNet : 35332 T&S casts
Assessment of historical data set
Data aggregation from SeaDataNet
The Mediterranean Data Portal
Data availability (active stations) on 27/11/13
EMED is clearly Under Sampling (at least in NRT)
The Mediterranean Data Portal
View on the data - Gliders: Levantine Sea, April 2012
Start
End
Start
Start
End
End
Temperature and Salinity data collected through a glider mission in Levantine Sea during April 2012. The presence of the newly formed Levantine Intermediate Water (LIW) with salinity values higher than 39.1 psu is clearly identified between 100-300m.
Moreover, as the glider is moving northwards, enters in a area of anticyclonic movement, as it can be seen by the deepening of the temperature and salinity contour lines.
View on the data - Moorings: Long time series data, Pylos, Ionian Sea
Three years T&S data between 0-500m from the POSEIDON buoy in Pylos. The LIW signal, between 150-400m, is clearly stronger in 2010 with higher values both in salinity (>39 spu) and temperature.
View on the data - Drifters: Ligurian and Balearic Seas, April 2012
Start
End
The well known westwards surface flow along the Italian and French coasts towards the Gibraltar straits has been verified by the drifters trajectories released in the area during April 2012. Surface waters are 2-3oC warmer in the Ligurian Sea compared with those observed around the Gulf of Lions.
None of the drifters released in the Ligurian Sea entered the Gulf of Lions. It seems that the presence of an anticyclonic movement inside the gulf does not allow the entrance of the drifters and push them more westwards. The trajectory of the only drifter released inside the gulf verifies the existence of this anticyclone.
CNR - ISMAR Expecting 7 mooring stations Currently receiving data from 5 moorings NADR-SNG, Data from: 01/01/2013
Parameters: DRYT, WSPD, WDIR, TEMP, PRES Molo-Bandiera, Data from: 05/07/2013
Parameters: DRYT, WSPD, GSPD, WDIR, TEMP Molo-Sartorio, Data from: 05/07/2013
Parameters: SLEV ISMAR-Head-Office, Data from: 05/07/2013
Parameters: ATMS, PRRT PALOMA, Data from: 05/07/2013
Parameters: TEMP, DRYT
Data Aggregation through Jerico Project
OGS Expecting 9 mooring stations Currently receiving data from 2 moorings ADN-MAMBO1
Parameters: WSPD, WDIR, RELH, ATMS ADN-MAMBO4
Parameters: WSPD, WDIR, RELH, ATMS Currently only latest data available. Expecting
monthly files along with the other moorings
ISPRA Expecting 15 mooring stations Data from 12 moorings available in monthly directory. Daily
transmission from 9 moorings. ANCONA-61218 Starting date of data: 01/06/2013 CATANIA-61207 Starting date of data: 01/06/2013 CETRARO-61211 Starting date of data: 01/06/2013 CIVITAVECCHIA-61216 Starting date of data: 01/06/2013 CROTONE-61210 Starting date of data: 01/06/2013 LASPEZIA-61219 Starting date of data: 01/06/2013 MONOPOLI-61215 Starting date of data: 01/06/2013 PALERMO-61209 Starting date of data: 01/06/2013 PONZA-61214 Starting date of data: 01/06/2013 VANEZIA-61220 Starting date of data: 01/06/2013 CAGLIARI-61221 Starting date of data: 12/08/2013 MAZARA-61208 Starting date of data: 29/08/2013 Parameters:
RELH, TEMP, VDIR, VSMC, VTDH, VTPK, WDIR, WSPD
NIB-MBSS 1 mooring station VIDA
Parameters: EWCT, NSCT, WSPD, WDIR, DRYT, RELH, TEMP, PSAL
Data from: 17/06/2013
Expansion the data capacity – Engage more partners
Further expansion expected through PERSEUS project
The Mediterranean Data Portal
The Mediterranean Data Portal
A closer look in the Central Mediterranean
Green Stations: Already in the MED portal
Brown Stations: Agreement reached for their dissemination – Not yet available (remaining ISPRA stations)
Red Stations: Known to operate – Not in the Med portal
Stations positions according to MONGOOS inventory, updated on October 2013
The Mediterranean Data Portal
Focus on the Adriatic Sea Acquired stations
Gulf of Trieste : OGS and CNR-ISMAR coastal facilities have been aggregated through JERICO project
ISPRA stations have been acquired through EMODNET
NIB MBS - Vida station (Slovenia) has been provided to support the expansion of the MED data portal
The Mediterranean Data Portal
Focus on the Adriatic Sea Missing stations
CNR – ISMAR offshore stations : PTF Acqua Alta, Meda Gargano, BB, DD – Discussions on dissemination agreement
OGS : E2M3A Station – Agreement has been reached
Croatian stations (HHI, IZOR ) are missing
Data from Adriatic Stations – T & S
The Mediterranean Data Portal
Data from Adriatic Stations - Sea level
The Mediterranean Data Portal
Adriatic Sea (already presented) Corsica/Sicily
Data from offshore platforms operated by CNR-ISMAR is missing
Malta Coastal stations are missing (T&S, sea level)
Cyprus Missing coastal stations (T&S, sea level) Data from glider missions is included
Turkey Data from Mediterranean platforms is missing
Israel Coastal stations (T&S, sea level) are missing
Northern African coast No data is available – Limited knowledge about capacity
Known gaps in spatial coverage
The Mediterranean Data Portal
Data capacity • Engage more partners to contribute their data in the portal – Filling the
known gaps. • EMODENT Adriatic meeting is the first coordinated action to gather and
disseminate the missing data to the marine community. • Building stronger connections with Northern African countries.
Development • Complete support for the data conversion from any kind of input to
OceanSites NetCDF format. • Data base support for the whole extend of the data • Enhance QC system • Plans for development a regional data visualization and downloading system
Future plans under EMODENT support
The Mediterranean Data Portal
• The building of Mediterranean Data portal has been funded by
MyOcean I & II projects in order to become the regional node for the insitu component of the Marine Core Service (MCS).
• It’s the integrated forward step from the platform-oriented data centers that exist in the Med.
• It is established in compliance with EuroGOOS regional implementation policy, enhancing the expected MyOcean capacity by engaging new partners and hosting additional parameters.
• It supports all the major Operational Oceanography projects in the Mediterranean (Jerico, FixO3, Perseus) through the assembly and process of the relevant data. The participation of Med portal in these projects increases the data interoperability and prevents the unnecessary duplication of efforts.
Summarizing
The Mediterranean Data Portal
• It is one of the main components of the EMODNET
• The majority of the data coming from insitu platforms in the Mediterranean is already available, but significant known gaps in spatial coverage exist, especially in the Eastern part of the basin
• Collecting the missing data will complete the real-time marine information of the Mediterranean enhancing also the forecasting products that are delivered through various centers along the basin
Summarizing
The Mediterranean Data Portal
Supporting a Sustainable Ocean Observing System
Contact details
Leonidas Perivoliotis Institute of Oceanography Hellenic Center for Marine Research Telephone: +30 2291076400 Email: [email protected]
The Mediterranean Data Portal
Thank you for your attention