1
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large astro nomical facilities, such as the SUBARU telescop, the 45 m radio telescope and the Nobeyama Millimeter Ar ray, and plans to construct the ALMA under close collaborations with the US and the EU. Since January 20 02, the NAOJ has been connected to the SuperSINET with 10 Gbps, and it has become possible to provide hu ge amount of observed multi-color data and analyses facilities to other astronomical institutions. Thus we have started the Japanese Virtual Observatory (JVO) project since April 2002. JVO utilizes the Grid t echnology to combine several remote computational facilities. We have completed to define the query lang uage for the JVO, and have been designing on the deployment of JVO components. We plan to construct a JV O-prototype by the end of 2002. More information is provided at: Yoshihiko MIZUMOTO, Masatoshi OHISHI, Naoki YASUDA, Yuji SHIRASAKI, Masahiro TANAKA (NA OJ), Yoshifumi MASUNAGA (Ochanomizu Univ. and NAOJ), Ken MIURA, Hirokuni MONZEN, Kenji KAWARAI, Yasuhide ISHIHARA, Yasushi YAMAGUCHI and Hiroshi YANAKA (Fujitsu Ltd.) Contact Address: [email protected] User’s own service Security mngmt Resource mngmt M VC MVC MV C JVO Portal Astronomical Catalog Query Service Globus Toolkit Catalog DB Service Registry Researcher Browser for JVO Viewer for JVO Data Archive Service Data manage DB Data Virtual Observation execution service Data Analysis service Service Registry Other VO services Other Catalog services Globus Toolkit JVO GRID Environment Other GRID Environment UDDI serv er (FreeS oft) Web Browser Web ブブブブ Commands callable from GT2 Globus Toolkit V 2 Data management skycat Security mngmt Resource mngmt Data management Super SINET is an ultrahigh-speed network intended to develop and promote Japanese academic researches by strengthening collaboration a mong leading academic research institutes. The National Institute of Informatics has been operating the network since January 4, 2002. The Internet backbone connects research institutes at 10 Gbps and the lea ding research facilities in the research institutes are directly conn ected at 1 Gbps. Ultrahigh-speed network and JVO JVO@NAO ALMA @ Chile Radio Telescope @ Nobey ama Subaru Telescope @ Hawaii JVO @ NAOJ Subaru 0.3m~20m ~20TB/yr Nobeyama 10GHz~230GHz ~1TB/yr ALMA (plan) 30GHz~950GHz ~PB/yr Properties of the astronomical data base utilized by JVO Regist ry = Inter- nation al VO Schematic diagram of JVO system Distributed computing system Distributed data base system Users 10Gbps Super SINET, linked with GRID technology GRID JVO @ NAOJ - JVO consists of a distributed computing system (DCS) which is dep loyed over the GRID technology and a registry which provides inform ation required for DCS to query the distributed DB system. - All the computers of the DCS have an equivalent function and any of them can takes place of another machine, which is important for robustness of JVO system. - Selection of a machine for servicing the JVO users is automatical ly performed by GRID system based on the system load average. - JVO has inter-operability with the other VOs. The JVO Query Language JVOQL has an ability to query image data without referring to catalogs. This ability is useful for multi-color or multi-epoch analyses. The above JVOQL example shows how to obtain R-band select s.a, t.a, ... from SUBARU.R s, 2MASS.K t, ... where (s.AREA() OVERLAP t.AREA()) as a • Federate with more data Data of SUBARU open use/Nobeyama Radio Observatory • Interoperability with other VOs Toward International VO • CPU intensive image analysis tools Deconvolution, image subtraction, ... Run on PC cluster via GRID • Data mining / visualization tools Manage huge amount of data Future Plan First of all, researchers provide the JVO with simple instructions how they plan to use their own ''Virtual Observation''. The JVO portal in terprets them and generates a work flow through consulting the UDDI se rvers, where available JVO services are registered. Based on the work flow, built-in or user-defined services are called. The GRID framewor k is used for dynamical assignment of distributed resources according to their availabilities. Execution results of the work flow are trans ferred through GridFTP and presented to the researchers with the skyca t, etc. Three-Tiered Design of the JVO Prototype The JVO protot ype is now und er developmen t. The design of the JVO pro totype is show n as a schemat ic diagram. W e adopted to u se the Globus Toolkit V2 for our prototype. However we al so take into a ccount the We b service conc ept which will be included in the Globus Too lkit V3. The JVO, the distributed data base systems of Subaru and Nobeyama observat ories, and astronomers in the research institutes are linked over create view myEROtable as select s.Bmag, s.Rmag, t.Hmag, t.Kmag, ..., sr.BOX(POINT(s.ra,s.dec),w,h) as Rimage, tk.BOX(POINT(s.ra,s.dec),w,h) as Kimage, ... from SUBARU s, 2MASS t, ..., SUBARU.R sr, 2MASS.K tk, ... where XMATCH(s,b,...) < 3 arcsec and (s.Rmag-t.Kmag) > 6 mag and BOX(POINT(ra0,dec0), w0, h0) and ... Specify search area with the same syntax as cutout image specification. Create view with the user specified name in JVO system. Select attributes from each catalog server. Column names can be expressed in UCD. Select the catalog server. Select the image data server. Cross-match distributed catalogs. Query condition based on distributed catalog. Select cutout images from each image data server. Image area can be specified by BOX or CIRCLE operand. The JVO Query Language (JVOQL) is used in JVO as a language to specify a variety of user queries. The JVOQL has been designed to keep upward- compatibility with the standard relational database language, Structured Query Language (SQL), to enable in handling image data and cross- matching among distributed databases. The interpreter of JVOQL communicates with the registry of available databases and issues query sequences to distributed databases. SUBARU.R s 2MASS.K t s.AREA() t.AREA() AREA table cutout request OVERLAP s t a1 a2 a3 Partition to small segment http://jvo.nao.ac. http://jvo.nao.ac. jp jp the GRID technology through the 10Gbps Super SINET (http://www.sine t.ad.jp/english/). images taken by SUBARU and K-band images by 2MASS in an area where both SUBARU and 2MASS observed. The operand “OVERLAP” returns overlapped area of the two data. Similarly the operand “X.AREA()” returns the observed area of server X.

Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large

Embed Size (px)

Citation preview

Page 1: Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large

Construction of the Japanese Virtual Observatory (JVO)

Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large astronomical facilities, such as the SUBARU telescop, the 45 m radio telescope and the Nobeyama Millimeter Array, and plans to construct the ALMA under close collaborations with the US and the EU. Since January 2002, the NAOJ has been connected to the SuperSINET with 10 Gbps, and it has become possible to provide huge amount of observed multi-color data and analyses facilities to other astronomical institutions. Thus we have started the Japanese Virtual Observatory (JVO) project since April 2002. JVO utilizes the Grid technology to combine several remote computational facilities. We have completed to define the query language for the JVO, and have been designing on the deployment of JVO components. We plan to construct a JVO-prototype by the end of 2002. More information is provided at:

Yoshihiko MIZUMOTO, Masatoshi OHISHI, Naoki YASUDA, Yuji SHIRASAKI, Masahiro TANAKA (NAOJ), Yoshifumi MASUNAGA (Ochanomizu Univ. and NAOJ), Ken MIURA, Hirokuni MONZEN, Kenji KAWARAI, Yasuhide ISHIHARA, Yasushi YAMAGUCHI and Hiroshi YANAKA (Fujitsu Ltd.)Contact Address: [email protected]

User’s ownservice

User’s ownservice

Security mngmt Security mngmt Resource mngmt Resource mngmt

MVC

MVC

MVC

JVOPortalJVO

Portal

Astronomical CatalogQuery Service

Astronomical CatalogQuery Service

   Globus Toolkit

Catalog DB

ServiceRegistryServiceRegistry

Researcher

Browser for JVOBrowser for JVO

Viewerfor JVOViewerfor JVO Data Archive

ServiceData Archive

Service

Data manage DB

DataVirtual Observationexecution service

Virtual Observationexecution service

Data Analysisservice

Data Analysisservice

ServiceRegistryServiceRegistry

Other VO servicesOther VO services

Other Catalogservices

Other Catalogservices

   Globus Toolkit

JVO GRID EnvironmentOther GRID Environment

UDDI server (FreeSoft)

WebBrowser

WebブラウザCommands callable

from GT2

GlobusToolkit V2

Data managementData management

skycat

Security mngmt Security mngmt Resource mngmt Resource mngmt Data managementData management

Super SINET is an ultrahigh-speed network intended to develop and promote Japanese academic researches by strengthening collaboration among leading academic research institutes. The National Institute of Informatics has been operating the network since January 4, 2002. The Internet backbone connects research institutes at 10 Gbps and the leading research facilities in the research institutes are directly connected at 1 Gbps.  

Ultrahigh-speed network and JVO

JVO@NAO

ALMA @ Chile

Radio Telescope @ Nobeyama

Subaru Telescope @ Hawaii

JVO @ NAOJ

Subaru 0.3m~20m ~20TB/yr

Nobeyama 10GHz~230GHz ~1TB/yr

ALMA (plan) 30GHz~950GHz ~PB/yr

Properties of the astronomical data base utilized by JVO

Registry

=

Inter-national

VO

Schematic diagram of JVO system

Distributed computing system

Distributed data base system Users

10Gbps Super SINET, linked with GRID technology

GRID

JVO @ NAOJ

- JVO consists of a distributed computing system (DCS) which is deployed over the GRID technology and a registry which provides information required for DCS to query the distributed DB system.- All the computers of the DCS have an equivalent function and any of them can takes place of another machine, which is important for robustness of JVO system.- Selection of a machine for servicing the JVO users is automatically performed by GRID system based on the system load average.- JVO has inter-operability with the other VOs.

The JVO Query Language

JVOQL has an ability to query image data without referring to catalogs. This ability is useful for multi-color or multi-epoch analyses. The above JVOQL example shows how to obtain R-band

select s.a, t.a, ...from SUBARU.R s, 2MASS.K t, ...where (s.AREA() OVERLAP t.AREA()) as a

• Federate with more data Data of SUBARU open use/Nobeyama Radio Observatory• Interoperability with other VOs

Toward International VO• CPU intensive image analysis tools

Deconvolution, image subtraction, ...Run on PC cluster via GRID

• Data mining / visualization toolsManage huge amount of data

Future Plan

First of all, researchers provide the JVO with simple instructions how they plan to use their own ''Virtual Observation''. The JVO portal interprets them and generates a work flow through consulting the UDDI servers, where available JVO services are registered. Based on the work flow, built-in or user-defined services are called. The GRID framework is used for dynamical assignment of distributed resources according to their availabilities. Execution results of the work flow are transferred through GridFTP and presented to the researchers with the skycat, etc.

Three-Tiered Design of the JVO Prototype

The JVO prototype is now under development. The design of the JVO prototype is shown as a schematic diagram. We adopted to use the Globus Toolkit V2 for our prototype. However we also take into account the Web service concept which will be included in the Globus Toolkit V3.

The JVO, the distributed data base systems of Subaru and Nobeyama observatories, and astronomers in the research institutes are linked over

create view myEROtable asselect s.Bmag, s.Rmag, t.Hmag, t.Kmag, ..., sr.BOX(POINT(s.ra,s.dec),w,h) as Rimage, tk.BOX(POINT(s.ra,s.dec),w,h) as Kimage, ...from SUBARU s, 2MASS t, ..., SUBARU.R sr, 2MASS.K tk, ...where XMATCH(s,b,...) < 3 arcsec and (s.Rmag-t.Kmag) > 6 mag and BOX(POINT(ra0,dec0), w0, h0) and ...

Specify search area with the same syntax as cutout image specification.

Create view with the user specified name in JVO system.

Select attributes from each catalog server. Column names can be expressed in UCD.

Select the catalog server.

Select the image data server.

Cross-match distributed catalogs.

Query condition based on distributed catalog.

Select cutout images from each image data server.Image area can be specified by BOX or CIRCLE operand.

The JVO Query Language (JVOQL) is used in JVO as a language to specify a variety of user queries. The JVOQL has been designed to keep upward-compatibility with the standard relational database language, Structured Query   Language (SQL), to enable in handling image data and cross-matching among distributed databases.   The interpreter of JVOQL communicates with the registry of available databases and issues query sequences to distributed databases.

SUBARU.R s 2MASS.K t

s.AREA() t.AREA()

AREA table

cutout request

OVERLAP

s ta1a2a3

Par

titio

n to

smal

l seg

men

t

http://jvo.nao.ac.jphttp://jvo.nao.ac.jp

the GRID technology through the 10Gbps Super SINET (http://www.sinet.ad.jp/english/).

images taken by SUBARU and K-band images by 2MASS in an area where both SUBARU and 2MASS observed. The operand “OVERLAP” returns overlapped area of the two data. Similarly the operand “X.AREA()” returns the observed area of server X.