Embed Size (px)
Citation preview
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
End-user gateway for climate services and data initiatives
Big Data Europe Workshop Brussels Belgium 15th June 2015
Antonio S Cofintildeo
antoniocofinounicanesMeteorology GroupClimate Data ServicesUniversidad de Cantabria (UC) httpwwwmeteounicanes
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Outline
ECOMS User Data Gateway Datasets Variables How to access data
Registration and authorization OpenDAP access R Interface
Work in Progress
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
ECOMS
The European initiative forclimate service
observation and modelling
ECOMS
Improve the climate prediction systems
Improve the usability and use of prediction
Observations (decadal scale)
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Other initiatives
VALUE COST Action ES1102
Validating and Integrating
Downscaling Methods for Climate Change
Research
CORDEX Empirical Statistical
Downscaling
PUBLIC and PRIVATE
datasets for community
Datasets of postprocessed predictors statistical downscaling purposes and hi-res observational gridded datasets over different world regions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
User Data Gateway
The User Data Gateway (UDG) provides a homogeneous access end-point to collections of impact-relevant variables
The aim of UDG is to gather different data sources with different terms of use (policies) in a single data servicce so that users can access all the data and metadata they typically need (seasonal forecasts reanalysis and observations) in a homogeneous and simple way
without worrying about the inherent complexities of data access download and post- processing of the variables stored in massive archive systems at different institutions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Wiki doc
Fully documentedFeedback welcome
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Outline
ECOMS User Data Gateway Datasets Variables How to access data
Registration and authorization OpenDAP access R Interface
Work in Progress
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
ECOMS
The European initiative forclimate service
observation and modelling
ECOMS
Improve the climate prediction systems
Improve the usability and use of prediction
Observations (decadal scale)
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Other initiatives
VALUE COST Action ES1102
Validating and Integrating
Downscaling Methods for Climate Change
Research
CORDEX Empirical Statistical
Downscaling
PUBLIC and PRIVATE
datasets for community
Datasets of postprocessed predictors statistical downscaling purposes and hi-res observational gridded datasets over different world regions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
User Data Gateway
The User Data Gateway (UDG) provides a homogeneous access end-point to collections of impact-relevant variables
The aim of UDG is to gather different data sources with different terms of use (policies) in a single data servicce so that users can access all the data and metadata they typically need (seasonal forecasts reanalysis and observations) in a homogeneous and simple way
without worrying about the inherent complexities of data access download and post- processing of the variables stored in massive archive systems at different institutions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Wiki doc
Fully documentedFeedback welcome
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
ECOMS
The European initiative forclimate service
observation and modelling
ECOMS
Improve the climate prediction systems
Improve the usability and use of prediction
Observations (decadal scale)
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Other initiatives
VALUE COST Action ES1102
Validating and Integrating
Downscaling Methods for Climate Change
Research
CORDEX Empirical Statistical
Downscaling
PUBLIC and PRIVATE
datasets for community
Datasets of postprocessed predictors statistical downscaling purposes and hi-res observational gridded datasets over different world regions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
User Data Gateway
The User Data Gateway (UDG) provides a homogeneous access end-point to collections of impact-relevant variables
The aim of UDG is to gather different data sources with different terms of use (policies) in a single data servicce so that users can access all the data and metadata they typically need (seasonal forecasts reanalysis and observations) in a homogeneous and simple way
without worrying about the inherent complexities of data access download and post- processing of the variables stored in massive archive systems at different institutions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Wiki doc
Fully documentedFeedback welcome
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Other initiatives
VALUE COST Action ES1102
Validating and Integrating
Downscaling Methods for Climate Change
Research
CORDEX Empirical Statistical
Downscaling
PUBLIC and PRIVATE
datasets for community
Datasets of postprocessed predictors statistical downscaling purposes and hi-res observational gridded datasets over different world regions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
User Data Gateway
The User Data Gateway (UDG) provides a homogeneous access end-point to collections of impact-relevant variables
The aim of UDG is to gather different data sources with different terms of use (policies) in a single data servicce so that users can access all the data and metadata they typically need (seasonal forecasts reanalysis and observations) in a homogeneous and simple way
without worrying about the inherent complexities of data access download and post- processing of the variables stored in massive archive systems at different institutions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Wiki doc
Fully documentedFeedback welcome
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
User Data Gateway
The User Data Gateway (UDG) provides a homogeneous access end-point to collections of impact-relevant variables
The aim of UDG is to gather different data sources with different terms of use (policies) in a single data servicce so that users can access all the data and metadata they typically need (seasonal forecasts reanalysis and observations) in a homogeneous and simple way
without worrying about the inherent complexities of data access download and post- processing of the variables stored in massive archive systems at different institutions
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Wiki doc
Fully documentedFeedback welcome
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Wiki doc
Fully documentedFeedback welcome
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available datasets
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Available variables
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Architecture
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Registration and Authorization
The registration and authorization process is been managed by the the TAP service
The user has to enrol into different projects which are collections of datasets This enrolment may be supervised by the groupsproject administrator
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Policies and terms of use
The enrolment process may also include the acceptance of policies or terms of use imposed by data providers
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP access
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
The ECOMS-UDG provides access to datasets with no worries about files The UDG can offer views for a dataset and just one endpoint for the view
This makes possible to forget about file-name-mangling and focus on information contained into the dataset
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k 4 -s -d 6 httpopendap-urldodsvar1[] local-file_varnc
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climatehttpwwwmeteounicanes
Meteorology Group A multidisciplinary approach for weather amp climate
This makes possible to forget about file-name-mangling and focus on information contained into the datasetForecast198506INTERIM075_19850603_0000_SFC_201128_fcgrb
This is possible thanks to the THREDDS capabilities to aggregate collections of files as one ldquoNetCDFrdquo entity
Datasetname
files
Rawsize
Raw format
System4 135000 13TB GRIB1
CFSRR 110638 8TB GRIB2
ERAInterim 303474 3TB GRIB1
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
username
httpwwwmeteounicanestds5catalogssystem4System4Datasetshtml
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
Dataset Float32 mx2t24[run = 1][member = 1][time24 = 215][lat = 1][lon = 1] system4System4_Seasonal_15Membersncml---------------------------------------------mx2t24[1][1][215][1][1][0][0][0][0] 2722452[0][0][1][0] 2718321[0][0][2][0] 27253897[0][0][3][0] 27333136[0][0][4][0] 27371527[0][0][5][0] 2730291[0][0][6][0] 27369446[0][0][7][0] 27358426[0][0][8][0] 27418262[0][0][9][0] 27399835[0][0][10][0] 2737032[0][0][11][0] 27391562[0][0][12][0] 27413705[0][0][13][0] 27387527[0][0][14][0] 27417377[0][0][15][0] 27440704[0][0][16][0] 27437482[0][0][17][0] 27418506[0][0][18][0] 27385782[0][0][19][0] 2735874[0][0][20][0] 27481393[0][0][21][0] 2739504[0][0][22][0] 27335272[0][0][23][0] 27358716[0][0][24][0] 27413608[0][0][25][0] 27415384
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
OpenDAP data access
This approach allows to clients to materialize their own views to local files From netcdf-library (gt41) compiled with opendap support you can do (netcdf-4 file with shuffling and deflate filters)
nccopy -k4 -s -d6 httpopendap-urldodsvar1[] local-file_varnc
and subsetting on dimensions to request only desire data
nccopy -k4 -s -d6 httpopendap-urldodsmslp[336012][30601] lfnc
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
G
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface
library(ecomsUDGRaccess)loginECOMS_UDG(username password)
Authentication rarr
Data load rarr
Data processing Regridding Bias (mock up) Plot
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
R Interface middot Training
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Visualization
Visualization Tutorial
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Some work in progress
More datasets from different providers OpenID registration based on ESGFs IdPs More tools and examples on accessing and
processing datasets based on scientific toolssoftware used by impact community
Server-side processing capabilities based on WPS Job management will based meta-scheduling capabilities offered by DRM4G
Remote access on-demand for ESGF datasets ie SPECS simulations Improvement of replicacache strategies
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
A multidisciplinary approach to weather amp climate
Meteorology Group A multidisciplinary approach for weather amp climate
httpwwwmeteounicanes
Thank youECOMS User Data Gateway info
httpsmeteounicanestracwikiudgecoms
ECOMS User Data Gateway access request
httpsmeteounicanesudg-tap
R packages
httpsgithubcomSantanderMetGroupecomsUDGRaccess
httpsgithubcomSantanderMetGroupdownscaleR
Hands-on training workshop material
httpwwwmeteounicanesprojectsspecsworkshop2014
