������������

1

OGSAOGSA--DAI related DAI related R&D Activities in AISTR&D Activities in AIST

JapanJapan

Isao KojimaIsao KojimaITRI/AISTITRI/AIST

JapanJapan

������������

2

AIST http://www.aist.go.jp/• National Research Institute of

Advanced Industrial Science & Technology JAPAN– Computer Science & Electronics– Bio/Life Sciences– Nanotechnology, Materials and Manufacturing – Geology & Geosciences– Environment & Energy– Metrology

• ~3000 Researchers + ~2000 Visiting Scientists – Main Campus Located at Tsukuba Science City – 7 Regional Institutes.

ITRI

������������

3

ITRI:Information Technology Research Institute

of AIST• ~90 Researchers + visitors

– Formerly Known as “Grid Technology Research Center”(~2007)– Expanding our vision to cover general IT issues. (2007~Now)

• Grid Service-ware Research Group– Upper layer of the Grid R&D

(Database, HPC applications, Security Framework, etc)

– Database Team <10 researchers ;-< http://www.dbgrid.org• Small team• In charge of R&D for database projects in AIST

– GEO Grid– AIST Research RepositoriesEtc.

������������

4

Our Contributions to OGSA-DAI

• Use OGSA-DAI for our research projects.– GEO Grid

• Enhance OGSA-DAI as our research projects– OGSA-WebDB– OGSA-DAI-RDF– OGSA-DQP with XML/WebDB

������������

5

GEO Grid: • e-Infrastructure for Geosciences

Functionalities provided in GEO Grid• Geospatial Database Federations• Distributed File Systems• Large Scale Grid/Computing Platform• Workflows• Web Interfaces/Portals• User Management• VO(Virtual Organization) Managementetc.

http://www.geogrid.org

OGSA-DAI

For Details, Please have a look our IEEE Systems Journal Paper “Design Principles and IT Overviews of the GEO Grid” Vol2. No.3, 2008.09 Special Issue for GEOSS

������������

6

GEO Grid Architecture

AIST: OGF Gold sponsor (a founding member)

AIST: OGC Associate member (since 2007)

Grid Infrastructure

Support OGCSpecs

Web2.0 basedInterface

������������

7

GEO Grid Application Example• Creating Hazard Maps

Digital Elevation Maps using Satellite

Images

AMEDAS Rain sensors

Landslide Simulation

Display Hazard MapsGeological Data

ASTER

GEOMET

DatabaseFederation

������������

8

The reasons of using OGSA-DAI

• Service-based Database Access – World-wide Database federation over the Internet

• Support of VO based Security Mechanism– VOMS/GSI

• Harmonize with other Grid Tools– GridFTP, GRAM,Gfarm etc.

• Programming Framework to support Applications– Activity workflows

������������

9

Data stored in our GEO GridData stored in our GEO Grid

Raster DATARaster DATA

Sensor DATASensor DATA Vector DATAVector DATA

•Geological maps•Roads,railways, etc

GML/WFS

•ASTER •MODIS•PALSAR

GeoTiff/WCS

•PENSensorML/SOS

GIS Data

Satellite Images

Sensor Net

Linked by:- Geolocation- Observation/creation time- Specific parameter

- Owned by institutions/organizations- Many of them are not free

Source: Shunske Kodama SC08 Presentation

������������

10

Query Metadata with OGSA-DAI to PostGIS -> Large Images are Transferred with GridFTP

ASTER Satellite = Japan(METI)-made optical sensor on NASA TERRA SatelliteArchive is stored at ERSDAC(Japan) (and AIST GEO Grid)Resolution =15m Time-Series Images from Prof. S.Yokoyama of rinzo.ma project(our GUI project)

(Detail of the images will be presented at DEIM 2009 forum in Japan

Image files are stored with Gfarm file system

������������

11

Satellite Data in GEO Grid (as of 2009.02)

In Service Category resolution Observation Period

Scenes Data Size Description Note

ASTER opt 15m 2000- ~1,300,000 ~200TB

MODIS opt 250m 2000- �10�000 Japan& surrounding area

Working for federating with MODIS@NASA

FORMOSAT2

opt 8m2m(PAN)

2004- - NSPO@TAIWANcatalog only

Temporally Unavailable

Work in Progress

Category resolution Observation Period

Scenes Data Size Description Note

PALSAR sar 10m 2006- 12000 4.5TB Southeast Asia

LANDSAT opt 80m(1) ~ 15m(7)

1978- 2~4PBIn total

Planning&Negotiating

Category resolution Observation Period

Scenes Data Size Description Note

PRISM opt 2.5m 2007(?)-

GOSAT atm 2009?

JERS-1 opt&sar 18m(sar)18mx24m(opt)

1992-

All databases are

stored & federatedusing

OGSA-DAI/w Gfarm file system

Hope to be aNational Data Archive

for Satellite Data

Thanks to: Y.Takeyama, K.Iwao and N.Yamamoto

������������

12

GEO Grid & OMII

Good Support provided by OMII group• Several our requests are realized

– PerformDoc based interface• To have the compatibility with old programs

– Extended SQLBag Function• RemoteResourceGroup to join several satellite databases

with same schema– ….,

• Helps, Advises and Codes– OGSA-DAI with VOMS/GLite

������������

13

AIST OGSAAIST OGSA--DAI extensionsDAI extensionsHeterogeneous Database Integration MiddlewareOGSA-WebDB

extends OGSA-DAI SQL access to Web DatabasesOGSA-DAI-RDF

extends OGSA-DAI to support RDF databases/SPARQLOGSA-DQP Extensions

extends DQP to support XML databases and WebDBOGSA-DQPOGSA-DQP

OGSA-DAIOGSA-DAI OGSA-DAI

Web DBXML DBRelational DB

client OGSA-DQPExtensions

OGSA-WebDB OGSA-DAI-RDF

RDF DB

OGSA-DQPExtensions

Working to provideheterogeneity

������������

14

The Web

GUI environmentGUI environment

OGSAOGSA--DAIDAI

OGSAOGSA--WebDBWebDB

Japanese Database of Japanese Database of Single Nucleotide Single Nucleotide Polymorphisms Polymorphisms

Online Mendelian Online Mendelian Inheritance in Man Inheritance in Man

Analyze relationships between Analyze relationships between diseases, drugs & Sidediseases, drugs & Side--Effects, Effects, SNPs etc. from many aspectsSNPs etc. from many aspects

Medical Medical Bibliographic/Bibliographic/Citation DatabaseCitation Database

Pharmacogenetics & Pharmacogenetics & Pharmacogenomics Pharmacogenomics Knowledge Base Knowledge Base

OGSA-WebDB Medical ApplicationSearch for Cancer PreventionSearch for Cancer Prevention

OGSA-DAI SQLJOIN

������������

15

OGSAOGSA--DAIDAI--RDFRDF: Service based Access to the: Service based Access to theSemantic Web(RDF) DatabasesSemantic Web(RDF) Databases

OGSAOGSA--DAI RDFDAI RDF

Apache/TomcatApache/TomcatGT4GT4��OMIIOMII

��OGSA-DAI

SQL ActivitiesSQL Activities

XMLDBXMLDB ActivitiesActivities

Data Transport ActivitiesData Transport Activities

Data Manipulation ActivitiesData Manipulation Activities

SPARQL/XML &RDF

RDBRDBXMLDBXMLDB

GridFTP/FTPGridFTP/FTP

XSLTXSLT

SesameOGSA-DAI-RDF

OGSAOGSA--DAIDAI--RDF ActivitiesRDF ActivitiesSPARQL

Ontology

Insert/Delete

ReasoningJenaOGSA-DAI-RDF

Extend OGSA-DAIto

RDF databases(Sesame, jena)

ComplyComplyOGF(Open Grid Forum)OGF(Open Grid Forum)

StandardStandardWSWS--DAIDAI

To appear the NEXT issue of “Concurrency and Computation” Journal

������������

16

��

GUIGUIGUI

Grid Resource Ontology

OGSA-DAI-RDF

���

(Jena)

Sesame

Detecting AnormallyUsing Rule Processing Real-Time

Resource MonitoringUsing Continual Queries

Jena

Data and Metadata ManagementUsing OGSA-DAI framework

SPARQL

Reasoning

Machmaking of Service Description

Semantic GridSemantic GridResource ManagementResource Management(Semantic(Semantic--MDS)MDS)

Semantic Web Semantic Web Service Service ManagementManagement(OWL(OWL--S)S)

S(Semantic)S(Semantic)--MDSMDS

�Discover• Register

Application of DAIApplication of DAI--RDF: AISTRDF: AIST--SOA Semantic RepositorySOA Semantic RepositoryIntegrated Management of Integrated Management of SemanticSemantic Grid Resources Grid Resources and and

SemanticSemantic Web ServicesWeb Services(prototype demonstrated 2008.03)(prototype demonstrated 2008.03)

�Service ontology�RDF)�Object��text, imagae�

��������

��Store• Query

Monitoring Info(Owl-S)

�

Distributed Environment

���

(Jena)

SesameRelational DB�Files

Boca

������������

17

OGSA-DQP Extension

• Integration of WebDB, relational, XML data

<authors><author><name>Steven Lynden</name> <field>Grid Computing</field>

</author><author><name>…</name> <field>…</field>

</author>…

</authors>

AUTHOR PUBLICATION CITESEER

XML Relational Databases Web databases

Detail is shown in our Grid2008 PaperS.Lynden et al.Service-based Data Integration using OGSA-DQP and OGSA-WebDB

������������

18

OpenXML

select xauthor.name, publication.title,citeseer.url, xauthor.field

from publication, citeseer,OpenXML(

author,'//author','//name/text() name, //field/text() field‘

) as xauthorwhere publication.title=citeseer.titleand xauthor.name=publication.author;

<authors><author><name>Steven Lynden</name> <field>Grid Computing</field>

</author><author><name>…</name> <field>…</field>

</author>…

</authors>

<author><name>Steven Lynden</name> <field>Grid Computing</field>

</author>

<author><name>…</name> <field>…</field>

</author>title url fieldname… … … …… … … … Detail is shown in our Grid2008 Paper

S.Lynden et al.Service-based Data Integration using OGSA-DQP and OGSA-WebDB

������������

19

Summary

• AIST OGSA-DAI related projects– GEO Grid

• Use of OGSA-DAI– OGSA-DQPExtension,WebDB,DAI-RDF

• Extend OGSA-DAI to support heterogeneity

• Got good results in overall– want to continue/expand the relationship with OMII