View
417
Download
0
Category
Preview:
DESCRIPTION
New data access paradigms support a variety of human and machine access paths with data servers (THREDDS, https://www.unidata.ucar.edu/software/thredds/current/tds/ and Hyrax, http://opendap.org) that support multiple services for a given dataset. We need metadata that can describe those services and unambiguously differentiate between access paths for humans and for machines. The ISO 19115 metadata standard includes service metadata and allows data and services for that data to be described in the same record. I propose that we use the service metadata for machine access and the more traditional distribution information for human access. This talk was presented at the ESIP (espied.org) meeting during January 2014.
Citation preview
ESIP Winter 2014 1
Metadata For Humans
Ted HabermannDirector of Earth Science The HDF Groupthabermann@hdfgroup.org
January 8-10, 2014
and Machines
2ESIP Winter 2014
Evolving Data Access
January 8-10, 2014
FTPHTTP
Data Center
HDF HDF
3ESIP Winter 2014
Evolving Data Access
January 8-10, 2014
FTPHTTP
Data Center
HDF HDF
<metadata> <distinfo> <stdorder> <digform> <digtinfo> <formname> ASCII </formname> <transize> 208.000000 </transize> </digtinfo> <digtopt> <onlinopt> <computer> <networka> <networkr> http://www.ngdc.noaa.gov/geomag/aromag.shtml </networkr> </networka> </computer> </onlinopt> </digtopt> </digform> <fees> Depends on the Data Set </fees> <ordering> Price information is available upon request. </ordering> <turnarnd> 4 Days </turnarnd> </stdorder> </distinfo></metadata>
4ESIP Winter 2014
Evolving Data Access
January 8-10, 2014
FTPHTTP
Data Center
HDF HDF
<metadata> <distinfo> <stdorder> <digform> <digtinfo> <formname> ASCII </formname> <transize> 208.000000 </transize> </digtinfo> <digtopt> <onlinopt> <computer> <networka> <networkr> http://www.ngdc.noaa.gov/geomag/aromag.shtml </networkr> </networka> </computer> </onlinopt> </digtopt> </digform> <fees> Depends on the Data Set </fees> <ordering> Price information is available upon request. </ordering> <turnarnd> 4 Days </turnarnd> </stdorder> </distinfo></metadata>
5
Evolving Data Access
January 10, 2014
OPeNDAP
HTTP
WMS/WCS
Metadata
or
HYRAX
THREDDS
Data Center
THREDDS = Data + Services
January 8-10, 2014
THREDDS = Data + Services
January 8-10, 2014
THREDDS = Data + Services
January 8-10, 2014
Data Services
8ESIP Winter 2014
THREDDS = Data + Services
January 8-10, 2014
Metadata Services
9ESIP Winter 2014
THREDDS = Data + Services
January 8-10, 2014
Tools
11ESIP Winter 2014
Multiple Services = Good Thing
January 8-10, 2014
12ESIP Winter 2014
Service Metadata (nciSO NcML)
January 8-10, 2014
<group name="THREDDSMetadata"> <attribute name="id" value="hdf4DatasetScan/NASAHDF/SW_S3E_2003100.20053531923.hdf" /> <attribute name="full_name" value="NASAHDF/SW_S3E_2003100.20053531923.hdf" /> <attribute name="data_type" value="GRID" />
<group name="services"> <attribute name="opendap_service" value="http://eosdap.hdfgroup.uiuc.edu:8887/thredds/dodsC/mnt/ftp/
pub/outgoing/NASAHDF/SW_S3E_2003100.20053531923.hdf" />
<attribute name="httpserver_service" value="http://eosdap.hdfgroup.uiuc.edu:8887/thredds/fileServer/mnt/ftp/pub/outgoing/NASAHDF/SW_S3E_2003100.20053531923.hdf" />
<attribute name="wcs_service" value="http://eosdap.hdfgroup.uiuc.edu:8887/thredds/wcs/mnt/ftp/pub/outgoing/NASAHDF/SW_S3E_2003100.20053531923.hdf?service=WCS&version=1.0.0&request=GetCapabilities" />
<attribute name="wms_service" value="http://eosdap.hdfgroup.uiuc.edu:8887/thredds/wms/mnt/ftp/pub/outgoing/NASAHDF/SW_S3E_2003100.20053531923.hdf?service=WMS&version=1.3.0&request=GetCapabilities" />
<attribute name="nccs_service" value="http://eosdap.hdfgroup.uiuc.edu:8887/thredds/ncss/grid/mnt/ftp/pub/outgoing/NASAHDF/SW_S3E_2003100.20053531923.hdf/dataset.html" />
</group>
13ESIP Winter 2014
ISO Online Resource
January 8-10, 2014
14ESIP Winter 2014
ISO Online Resource
January 8-10, 2014
15ESIP Winter 2014
ISO Online Resource
January 8-10, 2014
16ESIP Winter 2014
Metadata (ISO)
January 8-10, 2014
1 data identification4 service identification
2 transfer options
17ESIP Winter 2014
Service Information
January 8-10, 2014
18ESIP Winter 2014
Service Information
January 8-10, 2014
For M
achines
19ESIP Winter 2014
Distribution Information
January 8-10, 2014
20ESIP Winter 2014
Distribution Information
January 8-10, 2014
For H
umans
21
Questions?
tedhabermann@hdfgroup.org
22BESSIG
Acknowledgements
July 24, 2013
This work was partially supported by contract number NNG10HP02C from NASA.
Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author and do not necessarily reflect the views of NASA or The HDF Group.
Recommended