Embed Size (px)
Citation preview
Development of Distributed MetBroker toward Information Grid
Jedsada Phengsuwan,
Sornthep Vannarat, Piyawut Srichaikul
Computer Technology Research and Development Division (R-DC)
National Electronics and Computer Technology Center (NECTEC), Thailand
Agenda
Objective
Distributed MetBroker
Discovery Service
Progress of Distributed MetBroker
Summary
Information Grid
Objective
Collaborative work between NECTEC, HAII (Thailand) and NARC (Japan)
Extend NARC’s Centralize MetBroker to distributed System
Based on Web Services and Grid Technology
Consist of 2 main components
MetBroker
Discovery Service
Applies for other project (Multiple Broker, Info. Grid)
Distributed MetBrokers Scenario
MetBroker
data
Discovery Service
discovery result
DS
DS
DS
DS
DS
Discovery Service
Discover MetBroker
analyze user’s data request
return suitable MetBroker
Smart Discovery Service
Registry
MetBroker registry services
Monitor MetBroker
status (running, shutdown)
What are information required by DS?
Metadata
Database name, Region, station
type of data (wind, rain, humidity)
System Resource Information (Server Information)
CPU (Speed, cache size)
Memory (used, free and total of memory and virtual machine memory)
OS
Network (server response’s time)
Amount of User
Discovery Service
The best MetBroker
Used for Multiple Broker project
SiMB = i
MB x iRsrc x (Wi
region + Wiusers + Wi
net + WiCPU + …)
n
Sbest = Max (S1MB, S2
MB, …, SNMB)
J.G. Wang (NARC)
Progress of Distributed MetBroker project
Recently
Add Ozone Object Database to MetBroker
MetBroker Web Services
New Progress
Discovery Service System resource information Service
Technologies related
Open Grid ServicesArchitecture
OGSA
Web ServicesTechnology
Grid Services
OGSI
grid Technology
GT 3.2
Open Grid ServiceInfrastructure
Impl
emen
tsSpecifies
defines
Integrates
Service Data
Set of structured data to any services
State information
Service Metadata
Server 3
Server 1
Server 2
SDE: MathSpeed: 2Cost : 0Type : PC
SDE: MathSpeed: 6Cost : 5$Type : Cluster
SDE: MathSpeed: 10Cost : 10$Type : Mainframe
Client
Which Server is good for me?
Service Data for Discovery Service
Used to provide System Resource Information
DS
BrokerSystemInfo SDE- CPU - OS- Memory- Network- Number of User
DS2BrokerStatus SDE-BrokerStatus-DSStatus-LastCall-LastResponse
Design
Grid environment
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
MetBroker DSServices
grid service
DS
Services
grid service
MetBroker
MetBroker
DS
Services
grid service
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
DS remoteinterface
MetBroker
System ResourceEngine
System Info.
Grid environment
Grid Service Container
DiscoveryServiceFactory
How does it work?
ds-instanceServices
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
updater
DS2BrokerTimerTask
Connectionstarter
Sta
rt ta
sk
RMI
SOAP
Create grid service
instance
update
update
Summary
MetBroker can provide server’ system resource
CPU, Memory, OS Information
other information : network, amount of user
use RMI to access these information
Share information to grid environment
we can get information from SDE
using SOAP protocol to connect and get information
Monitor MetBroker status
ALIVE, NOT_RESPONSE
Information Grid
Objective
build frame work and infrastructure for integrating public information sources to support a problem solving environment
Homogeneous information sources
Other products like IBM’s DB2II, Avaki
Components
Marker Directory
Information Broker
Discovery Service
Marker Description Language IB IB
IBIB
DS
DS
Data
Data
Data
Data
Data
Data
Data
Data
Data
Application process
MD
Person
Information Grid
Implements
Marker Directory
Information Broker
Discovery Service
Application
Standard
Information Grid Framework
Marker Definition Language
Technologies related
Grid
globus 4.0
grid services
Web Services
Semantic web
Resource Description frame work (RDF)
Ontology
Distributed MetBrokers
Thank you
