M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010

M. Lautenschlager, H. Ramthun1 Metafor Review 5 / 2010

METAFOR:WP 6: CIM Creation Tools


WP6 - CIM Creation Tools, Metadata

- Metadata sources- community:

- ESG Publisher database - CMIP5 questionnaire

- local:- modelling environment (e.g. ESMF, IMDI)- legacy datamangement (e.g. CERA)

- human

- Metadata capture methods- access to legacy databases (e.g. ESG Publisher)- XML output of CMIP5 questionnaire- GeoNetwork (view and edit)


WP6 - CIM MetadataActivity:

dataProcessing * from CMIP5 questionnaire

ensemble * from ESG Publisher

numericalExperimentsimulationComposite *

simulationRun *Software:

deployment * modelComponent *

processorComponentData:

dataObject * *Grid:

gridSpecCIM objects:

CIMRecordSet (some objects of the list) CIMRecord (one object of the list)


WP6 - Metadata data flow

ESG publisherESG Data Node

Metadata Capture

model environmentdatamanagement

human

CIM dataObject

Questionnaire

Completion / Repositoryfor Metafor / IS-ENES / ESG

CIM Model / SIM

ESG Gateway

CIM ingestion

CIM population

Database /THREDDS APIAPI

Intermediate CIM XML


GUI for interactive CIM completion

WP6 - CIM XML Architecture

CIM XML (instance) - provided on OAI server- transfer with FTP/Atom


CIM complete?

YES

NO

CIM repository

Metadata sources

CIM correct?

YES

NO

GeoNetwork (DKRZ/MPI)Create/UpdateCIM instances


CIM world CIM repository(Central CIM db)

WP6 - CIM world(detailed metadata flow)

data files(archive)

Metadata Capturing

MetadataDatabase


ESG publisherTHREDDS

rdb access

GeoNetwork

CMIP5 questionnaire

portal

viewer

query

compare

GUI

ESG (RDF)


<dataObject> … <content> <topic>CF-Topic from ESG database</topic> <unit value=“unit from ESG database"> <server>default controlled vocabulary server</server> </unit> <aggregation>aggregation from ESG database</aggregation>… </content>… </dataObject>

WP6 – THREDDS to CIM

data files(archive with CMIP5 structure)


ESG Publisher

modeloutput

Postgres RDBMS

THREDDS Catalog

THREDDS to CIM API- python script- access / transform with lxml- into intermediate CIM XML

CMOR2

controlled by esg.ini

CIM dataObject template


WP6 – GeoNetwork (features)Technology

Ajax (Asynchronous JavaScript Technology and XML) http://geonetwork-opensource.org/

Implementation at: http://cera-www.dkrz.de/geonetwork

Advantages Java + JavaScript capability simple and advanced search (on Lucene index) CV implementation by XML / RDF file access database MySQL, Oracle, postgresSQL XML handling (with XSLT) document view types: flat, advanced, XML schematron rules OAI server included multiple schemas User administration (incl. LDAP and Shibboleth)

http://geonetwork-opensource.org/






WP6 – GeoNetwork (query)

some text

any

any

Text to be searched in all text fields


WP6 – GeoNetwork (result)


WP6 – GeoNetwork (example: dataObject)

incomplete mandatory field


WP6 – GeoNetwork (example: modelComponent)



WP6 – GeoNetwork (example: simulationRun)



WP6 – GeoNetwork (issues for CIM completion)

performance of XML document loading implementation of:

complete Metafor CV helptext (from questionnaire)

Atom support OpenID support


WP6 - Next steps

GeoNetwork issues:

- complete integration of Metafor controlled vocabulary (CV)- complete integration of Metafor helptext- implementation of Atom- implementation of OpenID authentification

CIM service:

- tool / service to access THREDDS catalog

CIM service:

- tool / service for upload XML into questionnaire


WP6 – ...

Thank You!

Documents

M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010