The Observing System Monitoring Center (OSMC)

The Observing System The Observing System Monitoring Center (OSMC)Monitoring Center (OSMC)

… … steps towards climate data steps towards climate data integration integration

Steve Hankin, NOAA/PMELSteve Hankin, NOAA/PMEL

Sept '08Sept '08 OCO Annual ReviewOCO Annual Review 22

Observing System Monitoring CenterObserving System Monitoring Center

Background:

The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system.

The heart of the OSMC is a database of the times, locations, platform information, and parameter values.

Background:

The OSMC is a software tool to assist managers and scientists with monitoring global ocean in-situ observations as a system.

The heart of the OSMC is a database of the times, locations, platform information, and parameter values.

A partnership:A partnership:

PMELPMEL Steve Hankin PISteve Hankin PINGDCNGDC Ted Habermann PITed Habermann PINDBCNDBC Kevin Kern PIKevin Kern PI

OCOOCO Derrick SnowdenxDerrick Snowdenx


3 areas of integration under OSMC3 areas of integration under OSMC

1.1. Climate platforms via realtime input from Climate platforms via realtime input from GTSGTS

2.2. Climate archives (‘DACs’ and ‘GDACs’)Climate archives (‘DACs’ and ‘GDACs’)

3.3. Climate products and dataClimate products and data


1. Integration of …1. Integration of …platform management info. from GTSplatform management info. from GTS

Aug. 22





Colored by platform type



Colored by country



Colored by age of

observation





Observing system for SST



Colored by parameter

value





Moorings observing SST



The geospatial analysis capabilities of the OSMC data base are being developed to track progress on XBT lines.

XBT castsin 1 week (Aug. 16-22)



Platform information














GTS data provides just a starting pointGTS data provides just a starting point – – incomplete, minimal QCincomplete, minimal QC

OSMC needs to monitor our stewardship of OSMC needs to monitor our stewardship of the “ocean climate data record”the “ocean climate data record”

Since we’re integrating anyway, lets do it in Since we’re integrating anyway, lets do it in a manner that serves the broadest needs a manner that serves the broadest needs of the science communityof the science community

2. Integration of …2. Integration of …climate ‘DACs’ and ‘GDACs’climate ‘DACs’ and ‘GDACs’


Example #1: U. Hawaii Sea Level CenterExample #1: U. Hawaii Sea Level Center



Example: U. Hawaii Sea Level Center – todayExample: U. Hawaii Sea Level Center – today


CF MetadataClimate and Forecast Conventions

A subset were in a community standard format


inco

min

g

data

Example: U. Hawaii Sea Level Center – standards-based architecture (Jan. ‘09)Example: U. Hawaii Sea Level Center – standards-based architecture (Jan. ‘09)


Relational data base

Sea level time

series

OPeNDAPserver w/THREDDScatalog

available thru a standard web

service

Research Quality

Pacific Ocean

Lat34N, Long120W

Lat36N.Long: 121W…

Atlantic Ocean…

Fast Delivery

Pacific Ocean

…

...…

all in standard format: netCDF+CF

What do we gain through this standards-based approach?



Jan. ’09 milestone:Jan. ’09 milestone:1.1. Through THREDDS human-readable platform info at U. Hawaii becomes Through THREDDS human-readable platform info at U. Hawaii becomes

machine readable … in the OSMCmachine readable … in the OSMC

Jan. ’09 milestone:Jan. ’09 milestone:1.1. Through THREDDS human-readable platform info at U. Hawaii becomes Through THREDDS human-readable platform info at U. Hawaii becomes

machine readable … in the OSMCmachine readable … in the OSMC



Jan. ’09 milestone:Jan. ’09 milestone:2.2. “Drilling down” on a U. Hawaii Sea Level station will “Drilling down” on a U. Hawaii Sea Level station will

access the research-quality archives via OPeNDAPaccess the research-quality archives via OPeNDAP

Jan. ’09 milestone:Jan. ’09 milestone:2.2. “Drilling down” on a U. Hawaii Sea Level station will “Drilling down” on a U. Hawaii Sea Level station will

access the research-quality archives via OPeNDAPaccess the research-quality archives via OPeNDAP



Jan. ’09 milestone:Jan. ’09 milestone:3.3. Scientists will get desktop access to these data Scientists will get desktop access to these data

in their familiar desktop science toolsin their familiar desktop science tools

Jan. ’09 milestone:Jan. ’09 milestone:3.3. Scientists will get desktop access to these data Scientists will get desktop access to these data

in their familiar desktop science toolsin their familiar desktop science tools

… a Ferret session

… a Matlab session



Jan. ’09 milestone:Jan. ’09 milestone:4.4. Software solutions can be shared. OSMC-developed Software solutions can be shared. OSMC-developed

tools are planned for use in the U.Hawaii system.tools are planned for use in the U.Hawaii system.

Jan. ’09 milestone:Jan. ’09 milestone:4.4. Software solutions can be shared. OSMC-developed Software solutions can be shared. OSMC-developed

tools are planned for use in the U.Hawaii system.tools are planned for use in the U.Hawaii system.

This example shows OSMC tools automatically connecting to a 3rd party site that follows these standards

Menus inferred from THREDDS catalog (XML)

Access to observations via OPeNDAP


Example #2: Underway ocean carbon obsExample #2: Underway ocean carbon obsSurface Ocean COSurface Ocean CO22 Atlas (SOCAT) Atlas (SOCAT)


Relational data baseASCII file

Summary in CSML(*)

* Climate Systems Markup Language (XML)

CO2 data viewer



Example: Underway ocean carbon obsExample: Underway ocean carbon obs– Takahashi collection today … SOCAT Jan. ‘09– Takahashi collection today … SOCAT Jan. ‘09

Improved metadata in SOCAT will allow OSMC to differentiate cruises



netCDF

cruise plot

cruise log (metadata)

ASCII data

“drill down” will become available Jan.

‘09


Example #3: IOOS coastal observationsExample #3: IOOS coastal observations(not “climate ‘DACs’ and ‘GDACs’” yet, but …)(not “climate ‘DACs’ and ‘GDACs’” yet, but …)


Relational data

bases

SOS and O&M(*)“Regional”

observations

* Open Geospatial Consortium (OGC) standards: Sensor Observation Services, Observations & Measurements model

SOS, O&MSOS, O&M

OSMC

HABsforecasts

HurricaneIntensity

CoastalInnundation

IntegratedEcosystem

Analysis

NDBC

US coastal ocean obs

regionA

regionB

Global ocean obs

Global met obs

All global real-time users

Climate

GTS

Sea Level

Underway

Time series

Climate “DAC’s”

…

IOOS - OSMC collaborationIOOS - OSMC collaboration

GTSGTS

Several (by datatype)Several (by datatype)

NDBC customNDBC custom

familiar science tools

COOPS

SOS, O&M

GTS

protocols


Example #3: IOOS coastal observationsExample #3: IOOS coastal observations


IOOS regional platforms

(conceptual plot:feature available

November)



Roll-out plan Roll-out plan by platformby platform

OSMC-DAC OSMC-DAC partnershipspartnerships

U. Hawaii sea level time series -- Jan. '09 U. Hawaii sea level time series -- Jan. '09 OceanSites -- use same techniques (thru GDAC at NDBC)OceanSites -- use same techniques (thru GDAC at NDBC)

Carbon underway -- Takahashi collection now. SOCAT Dec. '08Carbon underway -- Takahashi collection now. SOCAT Dec. '08 SAMOS underway -- anticipate June '09SAMOS underway -- anticipate June '09

IOOS – taking shape in the coming monthsIOOS – taking shape in the coming months

other platform programs other platform programs (unscheduled, details tbd)(unscheduled, details tbd)

Argo -- via FNMOC/NRL GDAC Argo -- via FNMOC/NRL GDAC (w/ NOAA funding)(w/ NOAA funding)

VOS -- at NDBCVOS -- at NDBC

Surface drifters - at AOMLSurface drifters - at AOML

SOOP XBTs -- U.S. XBTs only at AOML (International tbd)SOOP XBTs -- U.S. XBTs only at AOML (International tbd)

Repeat hydrography dataRepeat hydrography data

GOSUD -- tbd on completion of SAMOSGOSUD -- tbd on completion of SAMOS

NOAA CO-OPS tide gauges (those not on GTS) NOAA CO-OPS tide gauges (those not on GTS)


3. Integration of …3. Integration of … climate products and data climate products and data

IPCC AR4 model outputs:

“Graphics such as this from Held and Soden (2006) are so routinely produced from the IPCC AR4 database that we’ve ceased to marvel at it. This is a composite of output from 20 models worldwide….”

V. Balaji, GFDL



Tony Barnston -- http://iri.columbia.edu/climate/ENSO/

“Often, the anomalies are provided directly in a graph or a table by the respective forecasting centers for the Nino 3.4 region. In some cases, however, they are given for 1-month periods, for 3-month periods that skip some of the periods in the above table, and/or only for a region (or regions) other than Nino 3.4”



• Publishing images and analyses of data products on Web sites is worthwhile …

• … but it is no longer sufficient. Nor is FTP access to files.

• Making data available through Web services like OPeNDAP and SOS will significantly advance climate science

• It can be done at low effort. Many groups are already doing it.



Surface TemperatureSalinity at 105m

Zonal current at 160W

3-month average meridional current in

Atlantic at 24N

Sea Level

Surface Salinity

GODAS

Zonal current averaged 130E to

80W

Salinity ProfileCurrent Vectors Meridional Current

SODA

Sea Level Height

Meridional velocity

Pacific SalinityTime vs longitude

OSCAR

Sea Surface Height

AVISO

ECCO-JPL

GHRSST-JPL

SODA minus COADS COADS minus ECCO-JPL

ECCO-JPL minus SODA

ECCO-JPL minus World Ocean Atlas



Many climate products are already available via OPeNDAP(though not all are kept up to date). Why not all of them ?

(GRIB is supported aswell as netCDF-CF)

OSMC can offer toolsto compare and evaluateproducts

Reynolds bias error with ocean obs



The OSMC ‘Climate Services’ tab is a work in progress.

Help us succeed bytelling us whatwould be most usefulto you.

IT projects are mostsuccessful when theyget strong input fromusers.

Adequacy of sampling for SST


Data needs metadata (standard-format documentation) -- both to Data needs metadata (standard-format documentation) -- both to be "discoverable" and to provide essential background informationbe "discoverable" and to provide essential background information

NOAA’s Climate Services plan (short-term goal): a web site NOAA’s Climate Services plan (short-term goal): a web site (“portal”) where users can locate web sites for NOAA data(“portal”) where users can locate web sites for NOAA data(This is not “data integration” as we’ve been discussing it.)(This is not “data integration” as we’ve been discussing it.)

The ocean-climate community needs to submit metadata to this The ocean-climate community needs to submit metadata to this portal.portal.

For nowFor now a single metadata record for each ocean data activity: a single metadata record for each ocean data activity: drifter program, XBT/SOOP program, Argo program, TAO, etc.drifter program, XBT/SOOP program, Argo program, TAO, etc.

Starting point: Many programs have submitted such metadata to Starting point: Many programs have submitted such metadata to NASA GCMD. But much is out of date, incomplete or misleading.NASA GCMD. But much is out of date, incomplete or misleading.

ACTION ITEM: To meet NOAA's short term goals, Derrick Snowden will ACTION ITEM: To meet NOAA's short term goals, Derrick Snowden will be contacting the OCO-funded programs. He’ll try to guess the right be contacting the OCO-funded programs. He’ll try to guess the right contact person …contact person …but better if you contact him firstbut better if you contact him first..

3. One final topic: metadata3. One final topic: metadata

(Thank you Derrick!)(Thank you Derrick!)


With relatively small amounts of effort we can With relatively small amounts of effort we can make “quantum” improvements in access to make “quantum” improvements in access to data from climate DACsdata from climate DACs

The OSMC project hopes to work in The OSMC project hopes to work in partnership with the DACs 1 by 1 to make this partnership with the DACs 1 by 1 to make this happenhappen

Significant data problems have not been Significant data problems have not been addressed here: QC standards, metadata addressed here: QC standards, metadata quality, and data discovery to name a fewquality, and data discovery to name a few

Those will be tackled too. Don’t let perfect be Those will be tackled too. Don’t let perfect be the enemy of good.the enemy of good.

Author’s message:Author’s message:


DiscussionDiscussion(Thank you)(Thank you)

Documents

The Observing System Monitoring Center (OSMC)