19
December 16, 2013 The Hierarchical Data Format (HDF): A Foundation for Sustainable Data and Software Ted Habermann, Mike Folk, The HDF Group 1 Services Formats Conventions Tools AGU, Fall 2013

The hierarchical data format (hdf) a foundation for sustainable data and software

Embed Size (px)

Citation preview

Page 1: The hierarchical data format (hdf)  a foundation for sustainable data and software

December 16, 2013

The Hierarchical Data Format (HDF): A Foundation for Sustainable Data and Software

Ted Habermann, Mike Folk, The HDF Group

1

ServicesFo

rmat

sC

on

ventio

ns

Tools

AGU, Fall 2013

Page 2: The hierarchical data format (hdf)  a foundation for sustainable data and software

Crossing the Chasm

December 16, 2013 2American Geophysical Union, Fall 2014

Page 3: The hierarchical data format (hdf)  a foundation for sustainable data and software

Conventions

(Standards)

Training &

Support

Additional

Software

Tools

System

Integration

Adoption

Processes ?

Core

Product

Crossing the Chasm

December 16, 2013 3American Geophysical Union, Fall 2014

The

Whole

Product

Crossing Geoffrey Moore’s chasm

requires a whole product.

Page 4: The hierarchical data format (hdf)  a foundation for sustainable data and software

Conventions

(Standards)

Training &

Support

Additional

Software

Tools

System

Integration

Adoption

Processes ?

Core

Product

Crossing the Chasm

December 16, 2013 4American Geophysical Union, Fall 2014

The

Whole

Product

Crossing Geoffrey Moore’s chasm

requires a whole product.

Creating the whole product

requires partners.

Page 5: The hierarchical data format (hdf)  a foundation for sustainable data and software

Conventions

(Standards)

Training &

Support

Additional

Software

Tools

System

Integration

Adoption

Processes ?

Core

Product

Crossing the Chasm

December 16, 2013 5American Geophysical Union, Fall 2014

The

Whole

Product

Crossing Geoffrey Moore’s chasm

requires a whole product.

Creating the whole product

requires partners.

Page 6: The hierarchical data format (hdf)  a foundation for sustainable data and software

Whole Product Partners

December 16, 2013 6American Geophysical Union, Fall 2014

Page 7: The hierarchical data format (hdf)  a foundation for sustainable data and software

IMPACT

Whole Product Partners

December 16, 2013 7American Geophysical Union, Fall 2014

Page 8: The hierarchical data format (hdf)  a foundation for sustainable data and software

IMPACT

Whole Product Partners

December 16, 2013 8American Geophysical Union, Fall 2014

Page 9: The hierarchical data format (hdf)  a foundation for sustainable data and software

IMPACT

Whole Product Partners

December 16, 2013 9American Geophysical Union, Fall 2014

Page 10: The hierarchical data format (hdf)  a foundation for sustainable data and software

The Common Data Model

December 16, 2013 10American Geophysical Union, Fall 2014

The Common Data Model

developed at Unidata to bring

together important common

features of many data types.

The netCDF4 library implements

the Common Data Model in

HDF5.

Page 11: The hierarchical data format (hdf)  a foundation for sustainable data and software

Grouping Data and Metadata (HDF-EOS)

11AGU, Fall 2013

Grids

Grid_1 Grid_N

Data Fields Attributes

Data Field.1

Data Field.2

Swaths

Swath_1 Swath_N

Data Fields

Data Field.1

Data Field.2

Profile FieldsGeolocation

Fields

Latitude

Longitude

Time

Colatitude

Profile Field.1

Profile Field.2

HDF File with HDF-EOS Conventions

Zonal Averages

Points

December 12, 2013

Page 12: The hierarchical data format (hdf)  a foundation for sustainable data and software

IHO Standard Bathemetric Attributed Grid

December 16, 2013 12American Geophysical Union, Fall 2014

Page 13: The hierarchical data format (hdf)  a foundation for sustainable data and software

IHO Standard Bathemetric Attributed Grid

December 16, 2013 13American Geophysical Union, Fall 2014

Page 14: The hierarchical data format (hdf)  a foundation for sustainable data and software

IHO Standard Bathemetric Attributed Grid

December 16, 2013 14American Geophysical Union, Fall 2014

Page 15: The hierarchical data format (hdf)  a foundation for sustainable data and software

Tools

December 16, 2013 15American Geophysical Union, Fall 2014

Page 16: The hierarchical data format (hdf)  a foundation for sustainable data and software

Tools

December 16, 2013 16American Geophysical Union, Fall 2014

Page 17: The hierarchical data format (hdf)  a foundation for sustainable data and software

Tools

December 16, 2013 17American Geophysical Union, Fall 2014

Page 18: The hierarchical data format (hdf)  a foundation for sustainable data and software

Community

18AGU, Fall 2013December 12, 2013

Page 19: The hierarchical data format (hdf)  a foundation for sustainable data and software

Community

19AGU, Fall 2013December 12, 2013

Using HDF to share data?

Tweet #HDFInside