CEOS WGISS CEOS WGISS May 2006May 2006

NASA Support for WTF-CEOP

May 2006

Ken McDonald, NASAYonsook Enloe, SGT Inc.

CEOS WGISS CEOS WGISS May 2006May 2006

CEOP/CEOS CEOP/CEOS CollaborationCollaboration

• CEOP Scientists need efficient access to CEOP Scientists need efficient access to satellite data, model output data, and field satellite data, model output data, and field data data

• CEOP science community lack advanced CEOP science community lack advanced tools to access the satellite data with the tools to access the satellite data with the services needed to support data integrationservices needed to support data integration

• CEOP Program initiated a discussion with CEOP Program initiated a discussion with CEOS WGISS to ask for assistance in solving CEOS WGISS to ask for assistance in solving this problemthis problem

• CEOP science community and CEOS WGISS CEOP science community and CEOS WGISS information technologists have teamed information technologists have teamed together to remove IT barriers to access and together to remove IT barriers to access and use satellite data for CEOP data integrationuse satellite data for CEOP data integration

CEOS WGISS CEOS WGISS May 2006May 2006

CEOP Data Integration CEOP Data Integration

Data location

Standalone physical location

Distributed sites reference by links

Data types

Model output dataInsitu dataSatellite data

Data sources

Services

Metadata keyword search

Data value search

File format translation

Reprojection

Regridding

Data Interpolation

Integrated datasets

Multiple files from individual

member datasets

SpatialTemporalrectificatio

n

Spatialrectificatio

n

IntercomparisonOf

Integrated Datasets

CEOS WGISS CEOS WGISS May 2006May 2006

CEOP Satellite Data CEOP Satellite Data ServerServer

• CEOP science community is using the CEOP science community is using the OPeNDAP enabled clients and servers to OPeNDAP enabled clients and servers to analyze the field data and model dataanalyze the field data and model data

• CEOP science community had difficulty CEOP science community had difficulty using satellite data because of the lack of using satellite data because of the lack of toolstools

• NASA’s Satellite Data Server prototype was NASA’s Satellite Data Server prototype was developed that demonstrated OPeNDAP developed that demonstrated OPeNDAP client (Grads) access to the WCS server client (Grads) access to the WCS server capabilities.capabilities.

• Prototype was demonstrated at CEOP Prototype was demonstrated at CEOP Implementation Planning meeting and Implementation Planning meeting and previous WGISS meetings.previous WGISS meetings.

CEOS WGISS CEOS WGISS May 2006May 2006

Satellite Data Server Satellite Data Server

NWGISS WCS

WCS Client

Satellite Data, Swath and Grid

Grads Client

Grads-DODSServer (GDS)

Other OPeNDAP Clients

Field DataModel Output

Standard Functionse.g. subsetting

Standard Functionse.g. subsettingCustom Functions(Grads)

OPeNDAPRequest TranslatorDefault georectification

CF Attrubute ConstrtuctionCustom Requests (future)

CEOS WGISS CEOS WGISS May 2006May 2006

Integration of Satellite and Model Integration of Satellite and Model DataData

CEOS WGISS CEOS WGISS May 2006May 2006

Continuing SupportContinuing Support• Using the prototype as a basis, the NASA team Using the prototype as a basis, the NASA team

(McDonald/GSFC, Di/GMU, Enloe/SGT, (McDonald/GSFC, Di/GMU, Enloe/SGT, Holloway/OPeNDAP) proposed to NASA’s Holloway/OPeNDAP) proposed to NASA’s Advancing Collaborative Connections for Earth-Advancing Collaborative Connections for Earth-Sun System Science (ACCESS) Program.Sun System Science (ACCESS) Program.

• NASA team awarded 2 year ACCESS funding to NASA team awarded 2 year ACCESS funding to develop the Satellite Data Server with an develop the Satellite Data Server with an optional 3optional 3rdrd year. year.

• A second proposal to develop a gateway that A second proposal to develop a gateway that would make OPeNDAP servers accessible to would make OPeNDAP servers accessible to OGC clients was partially supported and OGC clients was partially supported and merged with this effort - added two additional merged with this effort - added two additional team members (Domenico/Unidata, team members (Domenico/Unidata, Rutledge/NOAA-NCDC).Rutledge/NOAA-NCDC).

CEOS WGISS CEOS WGISS May 2006May 2006

Status and PlansStatus and Plans

• Held kick-off meeting with combined team in MarchHeld kick-off meeting with combined team in March• Finalized work plan for both gatewaysFinalized work plan for both gateways• Satellite Data Server will be developed as proposed, Satellite Data Server will be developed as proposed,

allowing the CEOP scientists to inter-compare allowing the CEOP scientists to inter-compare satellite data with model output data and field datasatellite data with model output data and field data

• Plan to deploy the Satellite Data Server at JAXA and Plan to deploy the Satellite Data Server at JAXA and other sites with satellite data of interest to the other sites with satellite data of interest to the CEOP communityCEOP community

• OGC/Geoscience Gateway will focus on catalog OGC/Geoscience Gateway will focus on catalog services - WCS access will be addressed with 3rd services - WCS access will be addressed with 3rd year fundingyear funding

• Paper describing the Satellite Data Server and the Paper describing the Satellite Data Server and the OGC/Geoscience Gateway accepted for the IGARSS OGC/Geoscience Gateway accepted for the IGARSS 06 conference06 conference

CEOS WGISS CEOS WGISS May 2006May 2006

CEOP SDS CEOP SDS ArchitectureArchitecture

CEOS WGISS CEOS WGISS May 2006May 2006

OGC/Geoscience OGC/Geoscience GatewayGateway

DataCatalog

SemanticCatalog

THREDDSCatalog

Catalog Ingestor

GeoscienceServers

ToolsW

CS

WF

SCS/W protocol WCS protocol WFS protocol

Geoscience Protocols

DataCatalog

SemanticCatalog

THREDDSCatalog

Catalog Ingestor

GeoscienceServers

ToolsW

CS

WF

SCS/W protocol WCS protocol WFS protocol

Geoscience Protocols

CEOS WGISS CEOS WGISS May 2006May 2006

OPeNDAP & ECHOOPeNDAP & ECHO• OPeNDAP and ECHO team are working together OPeNDAP and ECHO team are working together

to provide direct search and access to ECHO via to provide direct search and access to ECHO via OPeNDAP enabled clients (e.g. Matlab) using OPeNDAP enabled clients (e.g. Matlab) using ECHO’s web services. (Interim prototype ECHO’s web services. (Interim prototype demoed at the DSTT presentation on Tuesday.)demoed at the DSTT presentation on Tuesday.)

• ECHO search query implemented as an ECHO ECHO search query implemented as an ECHO web service, using ECHO’s 8.0 web service web service, using ECHO’s 8.0 web service APIs. APIs.

• A demo of matlab searching and accessing A demo of matlab searching and accessing ECHO via the ECHO search query implemented ECHO via the ECHO search query implemented as a web service is scheduled for July.as a web service is scheduled for July.

• Future work could include other OPeNDAP Future work could include other OPeNDAP enabled clients directly searching ECHO.enabled clients directly searching ECHO.

CEOS WGISS CEOS WGISS May 2006May 2006

WIST DemonstrationWIST Demonstration• WIST is the comprehensive search tool WIST is the comprehensive search tool

for ECHO. Comparable functionality with for ECHO. Comparable functionality with EDGEDG

• Some test CEOP metadata (2 collections Some test CEOP metadata (2 collections and 4 granules) ingested into a test and 4 granules) ingested into a test ECHO system. Currently there are ECHO system. Currently there are 10,000 satellite products of interest to 10,000 satellite products of interest to CEOP. Could have over 1M products in CEOP. Could have over 1M products in the future.the future.

• Demo will search for CEOP metadata Demo will search for CEOP metadata ingested into a test ECHO system.ingested into a test ECHO system.