DMAC ST and the Activities of the IOOS PO

DMAC ST and the Activities of the IOOS PO

Derrick SnowdenDMAC Steering Team

2013-02-28

The recent IOOS summit issued a few recommendations or challenges wrt DMAC

• Clear instructions on how to participate• Define a way to measure progress

Presentation ObjectiveRecent progress and near term plans for IOOS in the context of these two challenges

Great, a challenge, now what?

• Clear instructions to participate – (in what?)

• Metrics for progress – (towards what?)

http:

//m

anic

depr

essiv

eblo

g.w

ordp

ress

.com

/201

1/05

/05/

man

ic-

depr

essiv

e-ill

ness

-con

fusio

n-an

d-fe

ar-o

f-san

ity/

There are several valid descriptions of “what” DMAC is

GEOSS Architecture AIP-6

EarthCube Concept Groups esp.Layered Architecture Cross Domain Interoperability

NOAA Environmental Data Management Framework (v0.4)

Alternatively, these are efforts to define the scope of the system we need.

IOOS

IOOSIOOS

IOOSIOOS

ClientsDi

scov

ery

Serv

ice

Access Service

The trouble with catalogs…

8Illustrates the Publish, Find, Bind Pattern. OGC Reference Model (OGC 08-062r7)

IOOS

GEOSS

WMO WIS

data.gov

One of the summit requests was for metrics to measure progress and community catalogs offer one possibility to focus on.

More and better data services, more and better tools to use data, all data and tools registered in a catalog somewhere.

https://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/iso/index-secure.html

Metrics: Registry Inventories, quantity

• GEOSS – 286 services• IOOS - 239 records• NODC - 26778 records• NGDC - 22469 records• NCDC - 283 records • NASA PO.DAAC - 381

datasets

Metrics: Registry Inventories, quality • ISO 19115

metadata completeness, internal consistency, accuracy

https://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/iso/index-secure.html

Another viewpoint on maturity and measuring progress

Clear directions for participating

• Guidelines for implementing a IOOS profile of SOS (http://ioostech.googlecode.com)

Tools to make it easier: Servers• THREDDS 4.3 released (Unidata)

– ncISO continued support– ncSOS new release – Continued development on triangular mesh

grids• 52North SOS implementing

IOOS Profile• SciWMS – Open source WMS server

optimized for large netCDF data sets with some curvilinear grid support

ncSOS: SOS Service on top of THREDDS

• Open source plugin for TDS• Maps CF (v1.6) Discrete Sampling

Geometries to SWE Common SOS response types

• Wiki with installation instructions, compatible data sets and hints for use (http://asascience-open.github.com/ncSOS/)

• USGS fork at https://github.com/USGS-CIDA/ncSOSx

52North.org SWE tools • Adopted SOS service and modified to

support IOOS Profile (beta released, needs testers)

• SOS2NC Archiver tools (periodic dump to NODC netcdf templates)

• Implicit QC routines built in to SOS• 52North OXF Web Client

Tools: Clients• Python library for SOS • Java-netCDF IOSP for SOS output• Java SWE parsing library• ncToolbox: Matlab library for CF-

netCDF and soon SOS/SWE• Python based CF netCDF compliance

checker• Javascript SOS client• Environmental Data Connector

Training w

ww

.nod

c.no

aa.g

ov a

cces

sed

2013

-02-

26