www.eu-eela.eu

E-science grid facility forEurope and Latin America

Introduction to Grid computing and e-infrastructures

Leandro N. Ciuffo <leandro.ciuffo@ct.infn.it>

INFN – Catania (Italy)

EELA-2 Application Support Manager

Grid User Tutorial

Kampala, 11.11.2009

www.eu-eela.eu 2

Computationally intensive research

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu 3

Computationally intensive research

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu 4

• The biggest experiment on Earth• LHC tunnel: 27 km circumference, 100m underground• 15 Petabytes of data per year (41TB per day)

• The biggest experiment on Earth• LHC tunnel: 27 km circumference, 100m underground• 15 Petabytes of data per year (41TB per day)

Kampala - Uganda, Grid User Tutorial, 11.11.2009

The Large Hadron Collider

www.eu-eela.eu 5

The power Grid paradigm

Electric Power Grid

System

coal wind

hydroelectric nuclear

Users can access electrical power coming from different (and heterogeneous) sources

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu 6

The computing Grid approach

Computing Grid

System

Users can access storage and computing resources coming from different (and heterogeneous) sources

The resources shared within the Grid can be physical objects

(CPUs, storage devices) or logical resources (computing queues, distributed file systems)

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu Fourth EELA Workshop, Bogota, 05.03.2007 7

The Grid Metaphor

GRID

MIDDLEWARE

Visualising

Workstation

Mobile Access

Supercomputer, PC-Cluster

Storage, Data from Sensors and instruments

www.eu-eela.eu 8

e-Science

Virtual Organisations

Applications

Data

Instruments

e-Infrastructure

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu 9

Summarizing…

• Grid computing involves connecting geographically remote computers into a single network to create a virtual supercomputer by combining the computational power of all computers on grid.

• Heterogeneous resources, usually owned by diverse organizations

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu

EGEE numbers:

The EGEE Grid

>260 sites54 countries~150,000 CPUs>28 PetaBytes~14,000 users~200 VOs~330,000 jobs/day

www.eu-eela.eu 11

The 1st Layer: The Global Network

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu 12

The 2nd Layer: The Global Grid

EELA/

EELA-2

OSG

TeraGrid

NAREGIEUMedGrid

BalticGrid

SEE-Grid

EUIndiaGrid

EUAsiaGrid

EUChinaGrid

DEISA

EGEE

SAGrid

Kampala - Uganda, Grid User Tutorial, 11.11.2009

www.eu-eela.eu 13Kampala - Uganda, Grid User Tutorial, 11.11.2009

The South African National Grid

• A national project coordinated by Meraka Institute, in concert with Universities and National Laboratories, along the lines of EGEE, to provide an integrated collaborative, high-performance computing platform to the nation's researchers

• Currently :– 7 sites providing computing resources (storage, CPU), 5 in negotiation. – 2 sites provide core services (information index, workload management,

medatada, file catalogue)• Project entails

– Training and dissemination (collaboration with GILDA/INFN, EPIKH project)– Certificate Authority for accreditation to EUGridPMA under development

• Interoperability is paramount to international collaboration. Close coordination with IGI (Italian National Grid) and INFN– Middleware is 100% compatible with EGEE/EGI,

close coordination in deployment/upgrade, etc.

www.eu-eela.eu 14Kampala - Uganda, Grid User Tutorial, 11.11.2009

The South African National Grid

• Web presence:– Main website http://sagrid.ac.za

– Support system : http://ops.sagrid.ac.za

– Documentation, collaboration : http://wiki.sagrid.ac.za, http://docs.sagrid.ac.za

– Events : http://indico.sagrid.ac.za

• Any questions to SAGrid Coordinator:Bruce Becker BBecker@csir.co.za

www.eu-eela.eu 15

Who do you trust?

Kampala - Uganda, Grid User Tutorial, 11.11.2009

http://www.igtf.net

Grids need to know who you are

www.eu-eela.eu 16

Open Grid Forum

Kampala - Uganda, Grid User Tutorial, 11.11.2009

http://www.ogf.org

www.eu-eela.eu

Software layer which fills the gap between users applications and distributed resources

Middleware

www.eu-eela.eu 18Kampala - Uganda, Grid User Tutorial, 11.11.2009

Grid Middleware

• Globus Toolkithttp://www.globus.org/toolkit/

• UNICOREhttp://www.unicore.eu/

• Condorhttp://www.cs.wisc.edu/condor/

• ARChttp://www.nordugrid.org/middleware/

• OurGridhttp://www.ourgrid.org

• OGSA-DAI http://www.ogsadai.org.uk

• gLitehttp://glite.web.cern.ch/glite/

(…)

www.eu-eela.eu 19Kampala - Uganda, Grid User Tutorial, 11.11.2009

Component layers

Network

Operating system

Core middleware services

Community services / APIs developed by users

User’s applications

www.eu-eela.eu 20Kampala - Uganda, Grid User Tutorial, 11.11.2009

To learn more

• GridCafe: The place for everybody to learn about gridhttp://www.gridcafe.org/

• What is the Grid? http://access.ncsa.uiuc.edu/witg/

• iSGTW: What is a grid? A crash course in grid computinghttp://www.isgtw.org/?pid=1000550

• Gridipediahttp://www.gridipedia.eu/aboutgrid.html

• GILDA Wikihttps://grid.ct.infn.it/twiki/bin/view/GILDA

• EELA-2 - self-traininghttp://applications.eu-eela.eu/self_training.php?l=50