www.csiro.au

Harmonisation of Grid and Geospatial Services Standards in the Earth and Environmental Sciences

Simon Cox1, Lesley Wyborn2, Andrew Woolf3, Robert Woodcock1, Rob Atkinson4, Joan Esterle1

1CSIRO Exploration and Mining2Geoscience Australia3e-Science Centre Rutherford Appleton Lab4Social Change Online

24 May 2005

Cox/2005 AGU Spring

Overview

e-Science / NERC Datagrid

Oceans & Atmospheres data

Solid Earth and Environment community

HPC services for simulation & inversion

Standards-based loosely-coupled data services

SEE Grid

Cox/2005 AGU Spring

NERC DataGrid - data transfer

e.g. Climate Science Modelling Language (CSML)ProfileFeature

GridFeature

ProfileSeriesFeature

Focus on large datasets, simple structures

Time-series, profiles, gridded datasets

Series and collections

BADC

Cox/2005 AGU Spring

Some solid-earth e-Science/Grid projects

GEON

NSF “Cyberinfrastructure”

EarthByte

Sydney University/Caltech/CSIRO

APAC Geosciences

Australian Partnership for Advanced Computing

pmd*CRC

Cooperative Research Centre for Predictive Mineral Exploration

Cox/2005 AGU Spring

pmd*CRC - geologic process simulations

Archives

Data Service

Cox/2005 AGU Spring

Status quo: Different formats and standards

Data Structures

Proprietary Software

Versions of Software

User

Cox/2005 AGU Spring

Open Geospatial Consortium - Web Feature Service

GML WFSServer

Data-source organised for custodian’s requirements

Community-specific GML application language

TigerGML, LandGML, O&M, XMML, CGI-GML, ADX, GPML, CSML, MarineXML etc

private public boundary

WFSClient

HTML

Cox/2005 AGU Spring

Standard transfer format allows multiple data sources

WFSClient

WFSServer

WFSServer

B

WFSServer

C

Cox/2005 AGU Spring

Same format and standards

User

GML for geochemistry:

XMML and OGC O&M

XMML

XMML

XMML

Cox/2005 AGU Spring

XMML data packet

<GeochemMeasurement gml:id="WA_1_139459_Ag">

<om:eventTime xsi:nil="true"/>

<om:eventLocation xlink:href="urn:x-seegrid:feature:xmml:GeochemSpecimen:WA_1_139459/location"/>

<om:responsible xlink:href="urn:x-seegrid:person:wyb123"/>

<om:procedureUsed>

<AssayProcedure gml:id="ICPMS_1_139459_Ag">

<gml:name>Inductively coupled mass spectrometry</gml:name>

<om:method>ICPMS</om:method>

<analyteDetails>

<AnalyteSensitivity>

<analyte>Ag</analyte>

<lowerDetectionLimit uom="ppm">0.01</lowerDetectionLimit>

</AnalyteSensitivity>

</analyteDetails>

</AssayProcedure>

</om:procedureUsed>

<om:target xlink:href="urn:x-seegrid:feature:xmml:GeochemSpecimen:WA_1_139459"/>

<om:result relativeMeasure="lessThan" uom="1">1.e-8</om:result>

<analyte>Ag</analyte>

</GeochemMeasurement>

All this (and more) required to properly transmit one number!

Cox/2005 AGU Spring PIRSA DOIR GA

Mapping client

http://cgsrv3.arrc.csiro.au/seegrid/savedapps/filter

Three servers, one map

Cox/2005 AGU Spring

Report client

http://www.ga.gov.au/wfs/reader/wfsGeochemReaderHome.jsp

Three servers, one report

Cox/2005 AGU Spring

One service – many uses

GML-based data can be …. Rendered into a

queryable map …

… formatted into a

report or ….

… read and used by any

WFS/GML enabled application

Condition: community-standard data model/encoding

Cox/2005 AGU Spring

APAC Trial Application… Interactions between discrete http-hosted services

Resource Registry

Service Registry

Results Archive

Data Management

Portal

Job Management

Portal

HPC Repository

Login Job Monitor

Run Simulation

Edit Problem Description

Local Repository

Archive Search

Geology S.A

Geology W.A Rock Prop.

N.S.W

Rock Prop. W.A

Observational Databases

Authorization, Authentication

& Audit

Job Management

Service

Snark Service

EarthByte Service

UserWorkflow...

WS-Security, SAML, Shibboleth…

ebRIM, OGC Catalog Service…

OGC WFS, XMML, Service Profiles…

Snark Profile, GPML, XMML…

Gridsphere, JSR 168 Portlets…

EarthByte Profile, GPML, XMML…

SRB, ebRIM…

ebRIM, WSDL, UDDI…

Globus, WS-RF…

Cox/2005 AGU Spring

Fields vs. objects

classic geology“Feature” viewpoint

classic geophysics“Coverage” viewpoint

• simple data structures• collated/gridded

ready for analysisnetCDF, HDF-EOS

• complex data • database insertion• complete feature interpretations XML documents

Cox/2005 AGU Spring

Key Points

e-Science depends on

Informational Services – to supply modelling constraints

Computational Services – to supply simulators and solvers

e-Science community focus on “Grid” services

high-performance computing, PDE solvers – remote but tight connections

large datasets, data warehouses – simple data structures

Geospatial community working on REST web-services

loosely-coupled, decision-support– on-demand discovery, binding and chaining,

detailed semantics – complex data-structures, community schemas

www.csiro.au

Thank You

CSIRO Exploration and Mining

Name Simon Cox

Title Research Scientist

Phone +61 8 6436 8639

Email Simon.Cox@csiro.au

Web www.seegrid.csiro.au

Contact CSIRO

Phone 1300 363 400

+61 3 9545 2176

Email enquiries@csiro.au

Web www.csiro.au