INFSO-RI-508833 Enabling Grids for E-sciencE InterExpo Center, 8.11.2006, Sofia Participation of Bulgaria in the European Grid Infrastructure

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

•InterExpo Center, 8.11.2006, Sofia

Participation of Bulgaria in the European Grid Infrastructure

Aneta Karaivanova, Emanouil Atanasov, Todor Gurov, Institute for Parallel processing, Bulgarian Academy of Science

InterExpo center, 8.11.2006 2


INFSO-RI-508833

Content

• What is Grid• Aims of the EGEE project• Building a production Grid for e-Science• Grid application within the EGEE and SEE-GRID

projects• Vision for the future



INFSO-RI-508833

What is Grid?

“Coordinated sharing of resources and problem-solving in dynamic, multi-institutional and virtual organizations” (I.Foster)– The resources are controlled by their owners– The Grid infrastructure give access to users from partner institutions

Virtual organization (VО):– People from different organizations, working on a common problem– Sharing of computing and storage resources– Allows collaborative work in the domains of:

e-Science, e-Health e-Government, e-Business

Grid is a new generation of Internet



INFSO-RI-508833

Evolution of Grid

Historical perspective• Local computation

– All computational resources are stocked at one place– People travel in order to get access to resources

• Computations from remote access– The resources are accessible over distance– All significant resources are centralized

• Distributed computations– The resources are geographically distributed– Specialized protocols for access, mainly for data transfer– Grid computations– The resources and the services are geographically distributed– Standard protocols– Transfer of computations and data

• Web services and Grid – Grid Services– The industry adopts and standardizes Grid technologies



INFSO-RI-508833

GRID vision

• From on side:– The researchers are conducting their research activities,

collaborating with colleagues and sharing data, no matter of their geographical location

• From the other side:– Scientific and medical experiments give big quantities of

data

• Grid: – Unites data, computing centres and software



INFSO-RI-508833

Advantages of Grid

• Using resources usually has peak loading• The use of the computing capacities augments while

uniting the computing centres in Grid • Standard protocols• Use of open-source software • Facilitates the international and interdisciplinary

collaboration



INFSO-RI-508833

Example: LHC in CERN



INFSO-RI-508833

Grid services - scheme



INFSO-RI-508833

Example of Grid site: BG01-IPP

UI

- PKI X.509 certificate keys- JDL files

Terminals

enterGrid

enterGrid

enterGrid

enterGrid

UI WN

WN

WN

WN

WN

WNRB/II

CESE

BDII



INFSO-RI-508833

SEE-GRIDA Grid infrastructure for SE-Europe

Components of the e-infrastructure in Europe

GÉANT .

INFRASTRUCTURE

GRID .

INFRASTRUCTURE

eIn

fras

tru

ctu

re

EGEE

production quality grid, 20000 CPUs, ~5PB storage, training, 27 countries, 71 partners

GÉANTPan-European Research Network, IPv6 enabled

DEISA

grid of 6 supercomputers networked at 1 Gbps, focus on global filing systems,>40 Tflop/s, several user communities .



INFSO-RI-508833


• EGEE is the biggest project of the EC, aiming at integration of national, regional and thematic Grids and creation of an unified Grid infrastructure with a transparent access, supporting applications in divers domain of science, medicine, etc.

• Currently the project is in its second phase and preparing for the third

• 91 partners from 32 countries



INFSO-RI-508833

Aims of the EGEE project

• EGEE will provide researchers from academia and industry with continuous 24х7 access to key computational resources, independently from their geographical location

• The infrastructure will support distributed research communities, having common computing needs in the Grid computations



INFSO-RI-508833

Scientific domains using EGEE

• EGEE provides production Grid services – 200 Grid sites– > 20000 CPU– > 5 Petabytes (1015) storage – > 3000 users

Pilot New



INFSO-RI-508833

EGEE Applications

• Scientific domains– High Energy Physics– Biomedicine– Earth Sciences – Astrophysics– Computational Chemistry – Fusion– Geophysics– Finance, Multimedia– …

• Connection with business– Forge links with the full spectrum of interested business partners



INFSO-RI-508833

Cooperation with other ЕС projects

Di l i gentA DIgital Library Infrastructureon Grid ENabled Technology



INFSO-RI-508833

Middleware structure

• Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware

• Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory

• Foundation Grid Middleware will be deployed on the EGEE infrastructure– Must be complete and robust– Should allow interoperation

with other major grid infrastructures

– Should not assume the use of Higher-Level Grid Services

Foundation Grid Middleware

Security model and infrastructure

Computing (CE) and Storage Elements (SE)

Accounting

Information and Monitoring

Higher-Level Grid Services

Workload Management

Replica Management

Visualization

Workflow

Grid Economies

...

Applications



INFSO-RI-508833

The EGEE infrastructure in action

sites

CPU

0

5000

10000

15000

20000

25000

Jan-05

Feb-05

Mar-05

Apr-05

May-05

Jun-05

Jul-05

Aug-05

Sep-05

Oct-05

Nov-05

Dec-05

Jan-06

Feb-06

Mar-06

M onth

No

. J

ob

s/d

ay

0

5000

10000

15000

20000

25000

Jan-05

Feb-05

Mar-05

Apr-05

May-05

Jun-05

Jul-05

Aug-05

Sep-05

Oct-05

Nov-05

Dec-05

Jan-06

Feb-06

Mar-06

M onth

No

. J

ob

s/d

ay

Jobs/dayJobs/day

Resources in EGEE ~200 clusters; 25k CPU loading from 20K jobs/day massive transfers FTS > 1.5 GB/s

Resources in EGEE ~200 clusters; 25k CPU loading from 20K jobs/day massive transfers FTS > 1.5 GB/s



INFSO-RI-508833

EGEE: > 180 sites, 40 countries > 24,000 processors, ~ 5 PB storage

EGEE Grid Sites : Q1 2006



INFSO-RI-508833

A global e-Infrastructure

EGEE infrastructure~ 200 sites in 39 countries~ 20 000 CPUs> 5 PB storage> 20 000 concurrent jobs

per day> 60 Virtual Organisations

EUIndiaGrid

EUMedGrid

SEE-GRID

EELA

BalticGrid

EUChinaGridOSGNAREGI



INFSO-RI-508833

The Bulgarian Grid Initiative

• BgGrid Consortium. Aims:– Exchange of resources and expertise in the Grid

technologies– Development of Grid applications

• Members of the BgGrid:– Founders: Institute for Parallel Processing of Information

and the Institute of nuclear research and nuclear energy- Bulgarian Academy of Sciences

– Members: Institute of Mathematics and Informatics – BAS, Institute of Mechanics – BAS, Institute of electro-chemistry, Institute of Astronomy – BAS, American University in Bulgaria, University of Plovdiv (FMI), University of Sofia (FMI), University of Mining and Geology



INFSO-RI-508833

Bulgarian Grid resources

• 5 Grid clusters in EGEE

•The biggest is located in the Institute for Parallel Processing on Information, and is equipped with Myrinet cards for parallel MPI application with requirements for low latency

• BG04-ACAD (80 CPU)•BG01-IPP (21 CPU)

CPU Storage Tape

March 06 43 1TB -

Nov 06 145 5TB 10TB



INFSO-RI-508833

Central (core) servers in Bulgaria

•For the aims of the regional SEE-GRID project, the IPP supports the following greatly important core servers :

•R-GMA (distributed data base, accounting)

•FTS (guarantied data transfer)

•AMGA (catalogue with metadata information about the files)

•For the needs of the Bulgarian users, IPP supports :

•BDII (supports momentary information about the resources)

•WMS (distributes the tasks among the clusters)

•MyProxy (maintain certificates)

•P-GRADE portal

•All Bulgarian clusters support: WN, CE, SE, MON



INFSO-RI-508833

Scientific domains, maintained on the Bulgarian sites

•High energy Physics•Bioinformatics and Biomedicine •Ecology•Meteorology•Astronomy



INFSO-RI-508833

BG application in SEE VO - SALUTE

• SALUTE (Stochastic ALgorithms for Ultra-fast Transport in sEmiconductors) is a Grid application developed for solving computationally intensive problems in quantum transport. It consists of a bunch of Monte Carlo algorithms for solving quantum kinetic equations which describe the considered model.

• The quantum kinetic model: a femtosecond relaxation process of optically excited carriers in one-band semiconductors or quantum wires. The electron-phonon interaction is switched on after a laser pulse creates an initial electron distribution. Two cases are considered – with and without applied electric field.

• Using SALUTE innovative results for different materials can be obtained. Here we present the first version of SALUTE (the results are for GaAs).



INFSO-RI-508833

Wigner Function

•800 x 260 points

•t=175 fs



INFSO-RI-508833

Energy relaxation process:collisional broadening

Accumulation

From 10 fs up to 250 fs



INFSO-RI-508833

BG application in ESR VO – air pollution prediction

Transition from HPC to Grid computing



INFSO-RI-508833

How to learn Grid technologies

• Obtaining Grid certificates

•Training

• Joining appropriate virtual organization

• Installation of the necessary software

• Tests

• Possibility to install Grid cluster for test purposes



INFSO-RI-508833

Perspectives of the BG Grids

• The built Grid sites are open for users and applications for the entire Bulgarian academic community

• It is possible to present the capacities of the Grid for training and for users from the industry

• The Grid creates a good environment for development of various applications

• The base for development of the Bulgarian e-infrastructure is created, embracing not only e-Science, but e-Health, e-Government, e-Business.



INFSO-RI-508833

BG Grid contact information

For contact: • Kiril Boyanov,

Director of IPPI- BAS [email protected]

• Emanouil Atanasov, EGEE 2 team leader

[email protected]

• Todor Gurov, SEE-GRID2 team leader

[email protected]

• Aneta Karaivanova,

BGGC contact person

[email protected]

•http://www.grid.bas.bg/

Documents

INFSO-RI-508833 Enabling Grids for E-sciencE InterExpo Center, 8.11.2006, Sofia Participation of Bulgaria in the European Grid Infrastructure