DoSon Grid Computing School, 2007DoSon Grid Computing School, 2007 11

Current State of Grid Current State of Grid Computing Researches and Computing Researches and

Applications in VietnamApplications in Vietnam

Vu Duc ThiVu Duc Thi11, Nguyen Thanh Thuy, Nguyen Thanh Thuy22, Tran Van , Tran Van LangLang33

11Institute of Information TechnologyInstitute of Information Technology22Hanoi University of TechnologyHanoi University of Technology

33Institute of Information Technology HCMCInstitute of Information Technology HCMCOn behalf of the members of the VNGrid ProjectOn behalf of the members of the VNGrid Project

22

OutlineOutline

• Researches on grid computing in VietnamResearches on grid computing in Vietnam– Centers for High Performance ComputingCenters for High Performance Computing– HPC/GC Research activitiesHPC/GC Research activities

• Towards a grid infrastructure for VietnamTowards a grid infrastructure for Vietnam– VNGrid projectVNGrid project– The aimsThe aims– Planed activitiesPlaned activities

• Initial results: Initial results: – data grid for meteorology data grid for meteorology – data grid for bioinformaticsdata grid for bioinformatics

• ConclusionConclusion

33

Grid computing in VietnamGrid computing in Vietnam• Initial step Initial step

– since a few last yearssince a few last years– several HPC centers in Hanoi and several HPC centers in Hanoi and

HCM CityHCM City Hanoi University of Technology, Hanoi University of Technology,

19991999 Institute of Information Technology, Institute of Information Technology,

HCM City, 1996 research, 2000 HCM City, 1996 research, 2000 systemsystem

Vietnam National University, Hanoi, Vietnam National University, Hanoi, 20052005

Vietnamese Institute of Vietnamese Institute of Mathematics, 2004Mathematics, 2004

HCM City University of Technology, HCM City University of Technology, 20032003

Le Quy Don University of Le Quy Don University of Technology, 2001Technology, 2001

Centers for HPC

44

MilestonesMilestones

2001 2002 2003 2004 2005 2006

First center for HPC at HUT

300 GFlops

computing center at VNU (max)

Other HPC centers are

founded

First national conference on HPC and grid computing in

HCM city

BK Grid Group

atHUT

BioGrid Group at

IOIT-HCM

TEIN2-VN Project

(Trans-Eurasia Information Network)

VNGrid Project

University of TechnologyUniversity of Technology

55

Encountered IssuesEncountered Issues

• Not yet HPC centers of Tera Flops Not yet HPC centers of Tera Flops

• Not yet a common networking Not yet a common networking infrastructure to connect HPC centers infrastructure to connect HPC centers

• High performance Computing and High performance Computing and Grid computing rest in academic Grid computing rest in academic researches.researches.

• Not yet HPC/GC large scale Not yet HPC/GC large scale applications.applications.

66

Activities doneActivities done

• Building grid portalsBuilding grid portals– BKGrid (HUT)BKGrid (HUT)– Grid iPortal (VNU-HCM)Grid iPortal (VNU-HCM)

• Experimenting with applications onExperimenting with applications on– Meteorology (HUT, VNU-Hanoi)Meteorology (HUT, VNU-Hanoi)– Bioinformatics (IOIT-HCM)Bioinformatics (IOIT-HCM)– Geology (Vietnamese Institute of Mathematics)Geology (Vietnamese Institute of Mathematics)

• Participating in international gridsParticipating in international grids– Pragma (IOIT-HCM 2006, HUT soon)Pragma (IOIT-HCM 2006, HUT soon)– APGrid (Vietnamese Institute of Mathematics)APGrid (Vietnamese Institute of Mathematics)

• Participating in international HPC/GC workshops, conf.Participating in international HPC/GC workshops, conf. - APAN- APAN - PRAGMA- PRAGMA

77

VNGrid ProjectVNGrid Project

• Financed by Ministry of Science and Technology of Vietnam

• A two year project, to be finished in 2009• 5 partners in the project

– IOIT in Hanoi– IOIT in HCM City– HUT– VNU in Hanoi– Le Quy Don University of Technology

88

The aims of VNGrid (1)The aims of VNGrid (1)

• Building a cyber-infrastructure to Building a cyber-infrastructure to connect five partners in VN-Gridconnect five partners in VN-Grid

• Deploying advanced grid Deploying advanced grid technologies to improve the technologies to improve the performanceperformance– Resource monitoring and discoveringResource monitoring and discovering– Scheduling and brokeringScheduling and brokering

hard to reach the objective!hard to reach the objective!

99

The aims of VNGrid (2)The aims of VNGrid (2)

• Experimenting grid-based applications Experimenting grid-based applications onon– Bioinformatics,– Meteorology,– Virtual Reality,– Cryptography.

•Being connected to other grid systems in the region and over the world

1010

Planned activitiesPlanned activities

• Selecting the common technology solution for the whole VNGrid– suitable for the infrastructure in Vietnam– Via TEIN2

• Establishing necessary security policy

• Developing and deploying some grid applications

• Building a VNGrid Portal

• Connecting VNGrid to PRAGMA and some others

1111

Attended resultsAttended results

• Establishing VNGrid initial infrastructure for Establishing VNGrid initial infrastructure for Grid RD and application community in Grid RD and application community in VietnamVietnam

• Assembling separated HPC centers in VietnamAssembling separated HPC centers in Vietnam• Reinforcing researches on grid computing in Reinforcing researches on grid computing in

VietnamVietnam• Towards applying GC in industrial domainsTowards applying GC in industrial domains• Opening a new opportunity for collaboration Opening a new opportunity for collaboration

with partners outside Vietnam: HPC, storage with partners outside Vietnam: HPC, storage and content resources!!!and content resources!!!

1212

Apllication 1: BioinformaticsApllication 1: Bioinformatics

• Deploying grid technologies for Gene Mapping (IOIT-HCM)– Use Haplotype Pattern Mining (HPM), and

Density Based Spatial Clustering of Application with Noise (DBSCAN) to specify the locations of genetic diseases

• Performing Blast and gene prediction in Grid computing environment using iGridPortal (HCM City College of Natural Sciences)

1313

Apllication 2: Meteorological Apllication 2: Meteorological ForecastForecast

• Using agent Using agent technologies to technologies to deploy grid deploy grid servicesservices– An agent has An agent has

responsible for responsible for calling calling appropriate appropriate services services following user following user requirementsrequirements

Globus ToolkitGRAM MDS 3 Grid FTP

ClusterPBS

ClusterPBS

BKGrid Portal

SecurityService Information

ServiceWeka

Resource Broker Agent

HPC Service

Fedora Core 1

1414

Application 2: BKGrid and Application 2: BKGrid and Meteorological Forecast (cont)Meteorological Forecast (cont)

•Applying the HPC and Grid Computing for climate forecast (HUT, VNU-Hanoi)– Deploying the MM5 model

•Exploiting resources on APGrid to run a model for climate forecast (Vietnamese Vietnamese Institute of MathematicsInstitute of Mathematics)– Deploying the HRM model

1515

Intial results: data grid for Intial results: data grid for meteorology at HUTmeteorology at HUT

• Weather forecasting plays an important Weather forecasting plays an important role in the society role in the society – for agriculture, commerce, catastrophe for agriculture, commerce, catastrophe

preventing, etc. preventing, etc.

• There are different institutions in Vietnam There are different institutions in Vietnam working on the meteorology problems but working on the meteorology problems but the cooperation is not easy forthe cooperation is not easy for– sharing local observation datasharing local observation data– sharing hardware and software resources on sharing hardware and software resources on

computing weather forecast datacomputing weather forecast data

1616

A data grid portal for A data grid portal for meteorologymeteorology• Building a data grid for sharing Building a data grid for sharing

meteorological datasets is a suitable meteorological datasets is a suitable solution in Vietnam for:solution in Vietnam for:– Exploiting resources from different HPC centersExploiting resources from different HPC centers– Providing a central and easy access point to all Providing a central and easy access point to all

meteorological data via a grid portalmeteorological data via a grid portal– Offering a reliable mean for storing and sharing Offering a reliable mean for storing and sharing

meteorological data for research purposemeteorological data for research purpose– Public access to climate forecast websitePublic access to climate forecast website

1717

System architectureSystem architecture

Locally meteo-data

Global meteo-data

GrADS server

Administrator

Users

Data Grid

Http

`

``

`

`

Grid portal(gridsphere based)

`

``

`

`

`

``

`

`

MM5 Modeling System

HRM Modeling System

WRF Modeling System

User

Group

1818

Weather forecast modelingWeather forecast modeling• Model used for Model used for

weather weather forecasting: forecasting: MM5.MM5.

• It can be run on It can be run on a cluster for the a cluster for the high high performanceperformance

1919

Deployment of MM5 modelDeployment of MM5 model

• MM5 model already deployed MM5 model already deployed automatically in a cluster with 3 automatically in a cluster with 3 datasets each daydatasets each day– Downloading periodically global Downloading periodically global

meteorology data from the AVN sitemeteorology data from the AVN site– Combining with local observation data Combining with local observation data

on modelingon modeling– Configuring easily the modeling process Configuring easily the modeling process

via a configuration filevia a configuration file– Fault tolerance implemented to make Fault tolerance implemented to make

the service more reliablethe service more reliable

2020

Data grid servicesData grid services

• Data grid as a virtual container for Data grid as a virtual container for storing data and easy access laterstoring data and easy access later

• Basic services provided: Basic services provided: – Replicating data in several nodesReplicating data in several nodes– Searching data based on metadataSearching data based on metadata– Transferring data between nodesTransferring data between nodes

2121

PrototypePrototype

2222

ConclusionConclusion

• Grid Computing brings chances to Grid Computing brings chances to developing countries as Vietnam. We need:developing countries as Vietnam. We need:– Computing Resources and HPCComputing Resources and HPC– Storage Resources and Data in applications, Storage Resources and Data in applications, – QoS networking service.QoS networking service.– Grid toolsGrid tools– CollaborationCollaboration

Shortage of resources and only initial steps done, Shortage of resources and only initial steps done, more co-operations needed!more co-operations needed!

2323

ConclusionConclusion

• We would like to join grid computing We would like to join grid computing communities in communities in – APANAPAN– TEINTEIN- EGEE GRidEGEE GRid- PRAGMAPRAGMA

• It is important to have more and It is important to have more and more Grid-based applications!more Grid-based applications!

DoSon Grid Computing School, 2007DoSon Grid Computing School, 2007 2424

Thank you very much Thank you very much for your attention!for your attention!