DMAC ST and the Activities of the IOOS PO
Derrick SnowdenDMAC Steering Team
2013-02-28
The recent IOOS summit issued a few recommendations or challenges wrt DMAC
• Clear instructions on how to participate• Define a way to measure progress
Presentation ObjectiveRecent progress and near term plans for IOOS in the context of these two challenges
Great, a challenge, now what?
• Clear instructions to participate – (in what?)
• Metrics for progress – (towards what?)
http:
//m
anic
depr
essiv
eblo
g.w
ordp
ress
.com
/201
1/05
/05/
man
ic-
depr
essiv
e-ill
ness
-con
fusio
n-an
d-fe
ar-o
f-san
ity/
There are several valid descriptions of “what” DMAC is
GEOSS Architecture AIP-6
EarthCube Concept Groups esp.Layered Architecture Cross Domain Interoperability
NOAA Environmental Data Management Framework (v0.4)
Alternatively, these are efforts to define the scope of the system we need.
IOOS
IOOSIOOS
IOOSIOOS
ClientsDi
scov
ery
Serv
ice
Access Service
The trouble with catalogs…
8Illustrates the Publish, Find, Bind Pattern. OGC Reference Model (OGC 08-062r7)
IOOS
GEOSS
WMO WIS
data.gov
One of the summit requests was for metrics to measure progress and community catalogs offer one possibility to focus on.
More and better data services, more and better tools to use data, all data and tools registered in a catalog somewhere.
https://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/iso/index-secure.html
Metrics: Registry Inventories, quantity
• GEOSS – 286 services• IOOS - 239 records• NODC - 26778 records• NGDC - 22469 records• NCDC - 283 records • NASA PO.DAAC - 381
datasets
Metrics: Registry Inventories, quality • ISO 19115
metadata completeness, internal consistency, accuracy
https://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/iso/index-secure.html
Another viewpoint on maturity and measuring progress
Clear directions for participating
• Guidelines for implementing a IOOS profile of SOS (http://ioostech.googlecode.com)
Tools to make it easier: Servers• THREDDS 4.3 released (Unidata)
– ncISO continued support– ncSOS new release – Continued development on triangular mesh
grids• 52North SOS implementing
IOOS Profile• SciWMS – Open source WMS server
optimized for large netCDF data sets with some curvilinear grid support
ncSOS: SOS Service on top of THREDDS
• Open source plugin for TDS• Maps CF (v1.6) Discrete Sampling
Geometries to SWE Common SOS response types
• Wiki with installation instructions, compatible data sets and hints for use (http://asascience-open.github.com/ncSOS/)
• USGS fork at https://github.com/USGS-CIDA/ncSOSx
52North.org SWE tools • Adopted SOS service and modified to
support IOOS Profile (beta released, needs testers)
• SOS2NC Archiver tools (periodic dump to NODC netcdf templates)
• Implicit QC routines built in to SOS• 52North OXF Web Client
Tools: Clients• Python library for SOS • Java-netCDF IOSP for SOS output• Java SWE parsing library• ncToolbox: Matlab library for CF-
netCDF and soon SOS/SWE• Python based CF netCDF compliance
checker• Javascript SOS client• Environmental Data Connector