INFSO-RI-508833 Enabling Grids for E-sciencE Bulgarian Involvement in the European Grid Infrastructure Aneta Karaivanova, Emanouil Atanassov,

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

Bulgarian Involvement in the European Grid Infrastructure

Aneta Karaivanova, Emanouil Atanassov, Todor Gurov Institute for Parallel Processing

Bulgarian Academy of Sciences

NSFB Information day, 15.07.2005 2


INFSO-RI-508833

Overview

• Evolvement of Grids• What is Grid?• Goals of the EGEE project• Structure of EGEE operations• Bulgarian involvement in EGEE activities• Current status of regional operations• Mission of the SEE-GRID project



INFSO-RI-508833

Historical perspective

• Local Computing– All computing resources at single site.– People move to resources to work.

• Remote Computing– Resources accessible from distance.– All significant resources still centralized.

• Distributed Computing– Resources geographically distributed.– Specialized access; largely data transfers.

• Grid Computing– Resources and services geographically distributed.– Standard interfaces; transfers of computations and data.



INFSO-RI-508833

What is the Grid?

• The Grid - next generation of Internet computing. • The Grid was first properly explained by Ian Foster and

Carl Kesselman in their book The Grid: Blueprint for a New Computing Infrastructure (1998). Their vision: providing distributed resources for transparent public use, based on standartized interface. Their idea: people could access computational power, content, and other computer services in an easy way, just like using electricity by plugging a device into a wall socket.

• It was a dream. Where are we now?



INFSO-RI-508833


• EGEE is the biggest EU project that aims to integrate current national, regional and thematic Grids, in order to create a seamless Grid infrastructure for the support of scientific research.

• 2 + 2 years project• 70 partners from 27 participating countries• Integrate over 100 sites into a common infrastructure• Offer 5 Petabytes (1015) storage • 3000 users from at least 5 disciplines



INFSO-RI-508833

EGEE Partner federations

All work in EGEE will be carried out by the 70 partners grouped in 12 federations.

The Bulgarian EGEE partner is the IPP-BAS.



INFSO-RI-508833

Goals of the EGEE project

Within a four year programme:

• Build, deploy and operate a consistent, robust and secure grid available to scientists 24 hours-a-day, 7 days-a-week.

• Improve and maintain the middleware in order to deliver a reliable service to users

• Attract new users from science and industry and ensure training and support for them



INFSO-RI-508833

EGEE research communities

• Over the duration of the project the Grid Services will be expanded and taken to new communities.

Pilot New



INFSO-RI-508833

Activities of EGEE

• Network Activities– NA1: Project Management– NA2: Dissemination and Outreach– NA3: User Training and Induction– NA4: Application Identification and Support– NA5: Policy and International Cooperation

• Service Activities– SA1: Grid Support, Operation and Management– SA2: Network Resource Provision

• Joint Research Activities– JRA1: Middleware Reengineering + Integration– JRA2: Quality Assurance– JRA3: Security– JRA4: Network Services Development

Emphasis in EGEE is on operating a productiongrid and supporting the end-users



INFSO-RI-508833

Bulgaria: Starting position

• BgGrid Consortium (main purposes: Sharing of resources and expertise in Grid; Development of Grid-enabled algorithms) Founders: Institute for Parallel Processing (former CLPP-BAS) and

Institute for Nuclear Research and Nuclear Energy (INRNE-BAS) – (Agreement signed in September 2002)

Joined by (Agreements signed in January 2004): Institute of Mathematics and Informatics (IMI), Bulg. Academy of

Sciences Institute of Mechanics (IM), Bulgarian Academy of Sciences Faculty of Mathematics and Informatics (FMI), Plovdiv University Computer Science Department (CSD), American University in Bulg.

(AUBG) Department of Information Technologies at the Faculty of

Mathematics and Informatics (DIT-FMI), Sofia University. Institute of Electrochemistry and Energy Systems (IEES), BAS.

New members (Agreements signed in 2005) ): Institute of Astronomy (IA), BAS Space Research Institute (SRI), BAS



INFSO-RI-508833

Keys for our success

• Close collaboration between all members of the BG EGEE team Weekly work planning & regular discussions IPP participates in SA1 and NA2 but the team members work on

both activities

• Scientific reputation of the team IPP-BAS has leading expertise in various science areas

2000-2004 Center of Excellence

2005-2008 Center of Competence Team members are invited lecturers at the important international

conferences held in Bulgaria



INFSO-RI-508833

BG NA2 activities

• Providing updated information:Upkeep www.grid.bas.bgMedia coverage (articles in BG newspapers and in

the Inf. Bulletin of BAS, radio interview, etc.)PR materials

• Invited visits and seminar presentations for BgGrid Consortium members

• Regular discussions with representatives of the BgGrid Consortium

• Invited presentations at 8 international conferences held in Bulgaria

• Seminar on Bulgarian Involvement in EU Grid Initiatives and Grid technologies application in education, scientific research and health, June 3, 2005



INFSO-RI-508833

Dedicated EGEE events

• 1st EGEE and SEE-GRID Workshop in Bulgaria: “EU Grid projects: mission, current status, perspectives”, October 30-31, 2004, Borovetc. Purpose: to disseminate the ideas and to spread

technical information for the EU projects EGEE and SEE-GRID

57 participants: project team members representatives of the BG Grid consortium

(directors/vice-directors and system administrators), interested parties (possible new members of BG Grid), BAS officials, journalists, etc



INFSO-RI-508833

EGEE events in Bulgaria

• EGEE Dissemination seminar dedicated to EGEE applications, June 29, Sofia: Audience: users which will benefit most from using the Grid (55

participants from BAS institutes and universities) Lecturers from Forschungszentrum Karlsruhe (FZK) and

National eScience Center (NeSC), Edinburgh, UK

• EGEE NA2 meeting, June 29-30, Sofia, Bulgaria : Bulgaria was chosen to host the meeting because of the

excellent results achieved in the first project year Representatives from all EGEE NA2 partners participated in the

meeting Bulgarian experience in EGEE dissemination



INFSO-RI-508833

Localised EGEE Websites



INFSO-RI-508833

Structure of EGEE operations

• Operations Management Centre (OMC):– At CERN – coordination etc

• Core Infrastructure Centres (CIC)– Manage daily grid operations –

oversight, troubleshooting– Run essential infrastructure services– Provide 2nd level support to ROCs– UK/I, Fr, It, CERN, + Russia (M12)– Taipei also run a CIC

• Regional Operations Centres (ROC)– Act as front-line support for user and

operations issues– Provide local knowledge and

adaptations– One in each region – many distributed

• User Support Centre (GGUS)– In FZK – manage PTS – provide single

point of contact (service desk)– Not foreseen as such in TA, but need is

clear



INFSO-RI-508833

The Regional Operations Centres

• Certification and Deployment• Operational support• User support• Security• Accounting



INFSO-RI-508833

Operations monitoring maps

• In EGEE/LCG:

• > 150 sites, 34 countries

• > 12,000 cpu

• ~5 PB storage

• In EGEE/LCG:

• > 150 sites, 34 countries

• > 12,000 cpu

• ~5 PB storage



INFSO-RI-508833

Participants from SEE federation



INFSO-RI-508833

Example grid site - BG01-IPP

UI

- PKI X.509 certificate keys- JDL files

Terminals

enterGrid

enterGrid

enterGrid

enterGrid

UI WN

WN

WN

WN

WN

WNRB/II

CESE

BDII



INFSO-RI-508833

SEE ROC activities

• Introduce new RCs (one new RC under construction at Sofia University).

• Pro-active monitoring of grid services at RC• React and solve problems, reported by users or CIC• Validate new middleware releases• Provide feedback to middleware developers through

the pre-production service• Interfaces: Savannah at CERN, GGUS at FZK• Deployment of new VOs at RC level



INFSO-RI-508833

BG Grid infrastructure

BG01-IPP BG02_IM BG-INRNE BG04-ACAD

alice 123 0 0 104

atlas 13 23 0 4

biomed 981 366 0 376

cms 231 0 0 131

magic 631 0 0 0

dteam 108 23 10 33

esr 29 0 0 0

lhcb 3557 0 0 2277

•Sites – 4 (3 EGEE, 1 SEE-GRID)

•CPUs – 40

•VOs supported – HEP, BioMed, ESR, magic, regional

•The table shows the total summed CPU time



INFSO-RI-508833

User support

New experimental

users

New production users/apps

EGAAP

Join existing VO with your

application

Qualify as new VO

Join SEE-VO

Experienced production

users

Join existing VO as a member

Play on GILDA: RO, GR

Help with app development Help with EGAAP application

Our ROC core servicesOur ROC core servicesUser support per country

User support per country

User support per country



INFSO-RI-508833

VOs supported at the first BG EGEE site – BG01-IPP

• BG01-IPP was the first SEE site to support:– biomed VO – since Nov 2004– ESR – since Jan 2005– magic – since Mar 2005.

• High Energy Physics support - Alice, Atlas, LHCb, CMS software deployed at the site.– LHCB production jobs since October 2004.– CMS production jobs running at this moment:



INFSO-RI-508833

BG application in SEE VO - SALUTE

The Problem: ultra-fast semiconductor carrier transport

femtosecond relaxation of hot electrons by phonon emission in presence of electric field.

Barker-Ferry equation and Monte Carlo approach• Application in nanotechnologies: innovative results for

GaAs:

collision broadening and memory effects of quantum kinetic model;

Intra-collision field effect: quantum scattering - retarding and accelerating field.

• “NP-hard” problem concerning the evolution time• Parallel and Grid implementation



INFSO-RI-508833

Wigner function

800 x 260 points

150 fs



INFSO-RI-508833

Energy relaxation process:collisional broadening

Accumulation

From 10 fs up 250 fs



INFSO-RI-508833


Accumulation




INFSO-RI-508833


Accumulation




INFSO-RI-508833

BG application in ESR VO – air pollution prediction

• Under development by Tzvetan Ostromsky from IPP• Transition from HPC to Grid computing



INFSO-RI-508833

Selection of Monitoring tools

GIIS Monitor GIIS Monitor graphs Sites Functional Tests

GOC Data BaseScheduled Downtimes Live Job Monitor

GridIce – VO view GridIce – fabric view Certificate Lifetime Monitor

Note: Those thumbnails are links and are clickable.



INFSO-RI-508833

Summary

• All activities are up-and-running• All milestones and deliverables for

the first reporting period have been met/produced

• The project has already met the targets set for the first 2 year phase

• One of these 5 languages is Bulgarian

TargetCurrent status

EndYear 2

EndYear 4

Number of Users ~ 500 ≥ 3000 ≥ 5000

Respectability (peer reviewed)

23% ≥ 15% ≥ 50%

Breadth (disciplines)

6 ≥ 5 ≥ 5

Multinational (countries)

34≥ 15 ≥ 15

Multilingual (languages)

5 ≥ 4 ≥ 8



INFSO-RI-508833

Results

• Two new members of BgGRID Consortium Institute of Astronomy (IA), BAS Space Research Institute (SRI), BAS

• Specific agreements with two Institutions to install Grid sites and support regional and EGEE applications Institute of Mechanics – BG02-IM – production site running since

January 2005. Faculty of Physics, Sofia University – agreement recently signed,

work in progress

• BG EGEE sites Four EGEE production sites One Grid site (under construction)

• Our EGEE applications: SALUTE (Stochastic ALgorithms for Ultra-fast Transport in

sEmiconductors) – SEE VO Env_Mod – Air pollution modelling applications – ESR VO.



INFSO-RI-508833

Integrate SEE NGIs in the Pan-EU and worldwide Grid initiativesEstablish a seamless and

interoperable pilot-Grid infrastructure that will expand and support the ERA.

Allow smaller, less-resourced sites to access computing power that would otherwise be unaffordable.

Ease the digital divide and release the scientific & productive talents of the region

MissionSEE-GRID mission



INFSO-RI-508833

SEE-GRID Contractors

• GRNET (Co-ord.) Greece• CERN Switzerland• SZTAKI

Hungary • IPP-BAS

Bulgaria• ICI

Romania• TUBITAK Turkey• INIMA

Albania• BIHARNET

Bosnia-Herzegovina• UKIM

FYROM• UOB Serbia-

Montenegro• RBI Croatia



INFSO-RI-508833

SEE-GRID current snapshot

• LCG-2 clusters installed in all sites. – 9 SEE-GRID sites – ( with >80 CPUs) in

participating countries in the first project year;

• Regional SEEGRID VO is supported with 3 Grid apps:– Volumetric Image Visualization

Environment (VIVE);– Search Engine for South Eastern Europe

(SE4SEE); – Stochastic ALgorithms for Ultra-fast

Transport in sEmiconductors (SALUTE). • EGEE VOs supported -

– HEP, biomed.• Significant human capital & tech expertise

– emphasis on software development– extend the objective to build additional

Grid applications of regional interest

GRIDICE monitoring and P-GRADE portal



INFSO-RI-508833

Contact information

Contact persons: • Emanouil Atanassov,

SA1 Activity Leader (BG)

[email protected]

• Aneta Karaivanova,

NA2 Activity Leader (BG),

[email protected]

• Todor Gurov, Alternate SEE-GRID

manager [email protected]

• Ivan Dimov, EGEE Project leader for BG

[email protected]

•http://www.grid.bas.bg/ http://www.egee-see.org

Documents

INFSO-RI-508833 Enabling Grids for E-sciencE Bulgarian Involvement in the European Grid Infrastructure Aneta Karaivanova, Emanouil Atanassov,