17
Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003

HDF-EOS Data Extractor & Metadata Updater

Embed Size (px)

DESCRIPTION

Source: http://hdfeos.org/workshops/ws07/presentations/Yin/Yin_exmu.ppt

Citation preview

Page 1: HDF-EOS Data Extractor & Metadata Updater

Zhangshi Yin, Jingli Yang, Bob Bane,Muhammad Rabi, Richard Ullman

Data Usability Group, NASA/GSFCNASA/GSFC, Code 423

For HDF-EOS Workshop VIISeptember 23-25, 2003

Page 2: HDF-EOS Data Extractor & Metadata Updater

HDF-EOS Data Extractor (HEEX) is a tool for data users to extract HDF-EOS data to binary or ASCII data format in HTML or XML.

Page 3: HDF-EOS Data Extractor & Metadata Updater

Flat binary and ASCII data are required by some users.They can be imported to IDL, ARC/INFO and used in any programming.Extracted flat binary and ASCII data can be another intermediate data format for storing EOS data.

Page 4: HDF-EOS Data Extractor & Metadata Updater

HDF-EOS Data

ASCII DataASCII DataBinary Data

HTML XML

Binary Data

Page 5: HDF-EOS Data Extractor & Metadata Updater

heex [-aehx] [-f] [FieldName] -o OutputDirectory HDF-EOS5FileNameHDF-EOS5FileName: HDF-EOS5 file name. Required.-a Extract data to ASCII format. Default is binary. Optional. -e Extract every field. Optional.-f FieldName: extract a field data specified by objec/field. Optional.

If no -e and -f options, only index file, no data.-h Help message. Optional.-o OutputDirectory: the directory to put data. Required.-x Extract IndexFile data to XML format. Default is html. Optional.

Page 6: HDF-EOS Data Extractor & Metadata Updater

HEEX will extract all data into a directory indicated in -o optional by user. A file called Index.html or Index.xml in the directory will show all HDF-EOS data structure and where data are.

Page 7: HDF-EOS Data Extractor & Metadata Updater

-HDFEOS-File Name=grid.he Type="HDFEOS" -HDFEOS

-GRIDS -Grid

+Parameters +Dimension -GridDataField

+sst_mask_1 -HDFEOS_INFORMATION

-COREMETADATA +CoreMetadata.0

+ARCHIVEMETADATA

Page 8: HDF-EOS Data Extractor & Metadata Updater

-sst_mask_1 DataType=IntegerSign=falseSize=1+DimList +FieldStorage Data: ./Grid/sst_mask_1.dat

Page 9: HDF-EOS Data Extractor & Metadata Updater

HDF-EOS Metadata Updater (HEMU) is a tool for data producers or users to update metadata inside an HDF-EOS file (HDF-EOS2 and HDF-EOS5).

Page 10: HDF-EOS Data Extractor & Metadata Updater

Users need to read metadata from HDF-EOS data.Users need to write metadata files to HDF-EOS data replace all metadata in the HDF-EOS data.Users need to update metadata in HDF-EOS data by merging metadata inside HDF-EOS data and metadata from .met files.

Page 11: HDF-EOS Data Extractor & Metadata Updater

1. Extract metadata from a dataset (-x option) to a text file which can then be modified with any text editor. This option does not modify the HDF-EOS file.

2. Replace metadata with text from an external file (-f option). The text is syntax-checked for validity as ODL before updating.

3. Update metadata with text from an external file (-m option). This option is designed to update metadata using a .met file.

Page 12: HDF-EOS Data Extractor & Metadata Updater

HDF-EOS Data

Read CoreMetadata

InventoryMetadataArchiveMetadata

Metadata

Page 13: HDF-EOS Data Extractor & Metadata Updater

HDF-EOS Data.Met Data

Read Metadata

Check Syntax

Read Metadata

Check Values:SHORTNAME

PRODUCTIONDATETIMEVERSIONID

If equal, replace metadata in HDF-EOSusing metadata in .met

Check Syntax

If not equal, exit

Page 14: HDF-EOS Data Extractor & Metadata Updater

HDF-EOS Data.Met Data

Read Metadata

Check Syntax

Read Metadata

Check Values:SHORTNAME

PRODUCTIONDATETIMEVERSIONID

If equal, replace metadata in HDF-EOS using CollectionMetadata

InventoryMetadata in .metand ArchiveMetadata in HDF-EOS

Check Syntax

If not equal, exit

Page 15: HDF-EOS Data Extractor & Metadata Updater

hemu [-h] HDF-EOSFileName -xmf [MetadataFileName]-h Print help message.-x Extract metadata from HDFEOS file.-m Update metadata with a .met file input. -f Forcibly replace metadata with metadata from input.HDF-EOSFileName: HDF-EOS file. Required.MetadataFileName: Metadata file. Optional (default is standard input/output).

Page 16: HDF-EOS Data Extractor & Metadata Updater

HEMU will check metadata syntax by ODL program. For -m and –f options (update metadata with a .met file), three parameters in INVENTORYMETADATA group (SHORTNAME, PRODUCTIONDATETIME, and VERSIONID) must match before the tool will modify the metadata.

Page 17: HDF-EOS Data Extractor & Metadata Updater

http://hdfeos.gsfc.nasa.gov/hdfeos/index.cfm