www.eu-eela.org

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

GILDA t-InfrastructureClaudio Cherubino

INFN - Catania

Tutorial on grid, visualization and high performance calculation

Mexico City, 23-26 October,2007

2

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

• Grid INFN Laboratory for Dissemination Activities

• Demonstrate/disseminate grid computing

• Adopted by several Grid projects worldwide

• It runs the latest production (stable) version of LCG grid middleware but it is also adopting gLite in order to make the transition to the new middleware smoother and easier

• It is free

Getting started

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

The GILDA Project – web portal

https://gilda.ct.infn.it

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

Why t-Infrastructure?

• Avoid disruption of production systems of Grid projects

• Prepare participants for future middleware releases

• Easy entry point for new users/communities

• Provide guaranteed response for tutorials

5

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

GILDA Test-bed

~ 20 sites in 4 continents

6

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

All gLite services on GILDA

MIDDLEWARE VERSION: gLite 3.0.0

7

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Sponsors (https://gilda.ct.infn.it/sponsors.html)

8

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Training Strategy (1)

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

Before trying GILDA…

• First Steps:

1

2

3 4

1. Ask for a GILDA personal certificate2. Load the certificate in your browser3. Accept Use Policy4. Subscribe to the GILDA Virtual Organisation

10

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Certification Authority(https://gilda.ct.infn.it/CA)

11

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Training Strategy (2)

12

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA VOMS(https://voms.ct.infn.it:8443/voms/gilda/)

13

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Training Strategy (3)

Site Managers Beginners

ApplicationDevelopers

14

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Tutorial: Beginners

BeginnersUSER INTERFACE

PLUG AND PLAY

USER INTERFACE

VIRTUAL MACHINE

USER INTERFACE

REAL (gLite-tutor)

GENIUS

WEB PORTAL

https://glite-tutor.ct.infn.it

[glite-tutor] /home/giorgio > voms-proxy-init --voms gildaCannot find file or dir: /home/giorgio/.glite/vomsesYour identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Emidio Giorgio/Email=emidio.giorgio@ct.infn.itEnter GRID pass phrase:Your proxy is valid until Mon Jan 30 23:35:51 2006Creating temporary proxy.................................DoneContacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/Email=emidio.giorgio@ct.infn.it] "gilda"Creating proxy ...................................... DoneYour proxy is valid until Mon Jan 30 23:35:51 2006

15

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Tutorial: Site Managers

Site Managers

HOST

CERTS

GILDA TESTBED

( SERVICES AND

SITES )

GILDA VIRTUAL

SERVICES MACHINES

GILDA MONITORING

SYSTEMS

HOST

CERTSHOST

CERTS

16

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Tutorial: Application DevelopersApplication

Developers

GILDA

DEMONSTRATOR

https://glite-demo.ct.infn.it GILDA USE CASES

HOW TO USE CLI/API/WEB

SERVICES in gLite

GILDA TEAM SUPPORT FOR

APPLICATION INTEGRATION

(GENIUS ALSO) Demonstrative Applications

17

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Some of the Applications ported on GILDA

• 8 Virtual Organizations supported: – Biomedicine (Biomed)– Earth Science Academy (ESR)– Earth Science Industry (CGG)– Astroparticle Physics (MAGIC)– Computational Chemistry (GEMS)– Grid Search Engines (GRACE)– Astrophysics (PLANCK)– Computation Archaeology (ARCHAEOGRID)

• Development of complete interfaces with GENIUS for 3 Biomed Applications: GATE, hadronTherapy, and Friction/Arlecore

• Development of complete interfaces with GENIUS for 4 Generic Applications: EGEODE (CGG), MAGIC, GEMS, and CODESA-3D (ESR) (successfull demos of EGEODE and GEMS at EGEE review)

• Development of complete interfaces with GENIUS for 16 demonstrative applications available on the GILDA Grid Demonstrator (https://grid-demo.ct.infn.it)

• Development of complete interface with CLI for NEMO

18

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Training Material(https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome)

19

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The GILDA Support System

http://gilda-support.ct.infn.it

20

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Ticket Creation (1/2)

21

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Ticket Creation (2/2)

22

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Standard tutorial layout

Local site

User Interface

Resource Broker

BDII

Students’Room

ssh

Worker nodes

Worker nodes

CE

LFC

SE

VOMS

GILDA t-Infrastructure

UserDesktop

VirtualUI

VirtualUI

VirtualUI

28

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Stats

• Used in more than 180 tutorials• 7693 certificates issued• > 3 TB of videos and Virtual Grid

services downloaded• Web portal: 768.880 hits in 2006

29

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Stats

30

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Non EU countries benefited by GILDA courses

Basic / user tutorial

Advanced / sysadmin

Application Porting

31

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Non EU countries benefited by GILDA courses

Basic / user tutorial

Advanced / sysadmin

4 71

Application Porting

32

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

The Future of Grids

• Increasing the number of infrastructure users by increasing awareness– Dissemination and outreach– Training and education– Grids offer new opportunities for collaborative work

• Increasing the number of applications by improving application support and middleware functionality– Increase stability, scalability, and usability

Major efforts needed particularly on VO management, security infrastructure, data management, and job management

– High level grid middleware extensions

• Increasing the grid infrastructure– Increase manageability of Grid services – Reducing the cost of operation– Ensuring interoperability between infrastructures

• Protecting user investments– Better involvement of industry – Move towards a sustainable grid infrastructure

33

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Summary and conclusions

• GILDA is a virtual laboratory for dissemination of grid computing:

– It is a “de facto” standard t-Infrastructure adopted both by EGEE and many EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, EUINDIAGRID, ICEAGE, etc.)

– It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE Infrastructure

– GILDA runs latest production version of the gLite middleware to make the transition from the t-Infrastructure to the e-Infrastructure easy and transparent

34

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Links

• GILDA home page– https://gilda.ct.infn.it

• GILDA Certification Authority– https://gilda.ct.infn.it/CA/

• GILDA Virtual Organization– https://voms.ct.infn.it:8443/voms/gilda/

• GILDA Support System– http://gilda-support.ct.infn.it

• GILDA Form for Bookings– http://gilda-support.ct.infn.it

• GILDA Repository of Training Material– https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome

• GILDA Virtual Services– https://gilda.ct.infn.it/VirtualServices.html

35

E-infrastructure shared between Europe and Latin America

Tutorial on grid, visualization and high performance calculationFP6−2004−Infrastructures−6-SSA-026409

Questions …