Grid and SCIEnce

Semeniouk Igor

LLR, Ecole Polytechnique

Atelier de projet I3 SCIEnce

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

2

Why Grid

Early Grid pioneers found that

• too hard to keep track of authentication data (ID/password) across institutions

• too hard to monitor system and application status across institutions

• too easy to leave "dangling" resources lying around, reducing system robustness

• too many ways to submit jobs• too many ways to store, access, and

ultimately manage distributed data.

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

3

Grid Architecture in a Nutshell

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

4

Middleware and GRIDS

• Middleware– Globus Toolkit, Xgrid, Sun Grid, …– CORBA, Condor, RPC, …– User Identification

• Certificate, password, Kerberos, …

• GRIDs– LCG, EGEE, NorthGrid, …

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

5

Globus Toolkit GT-4• Certificates for User and

Services• Tools for job submission• Web Services• Data moving and data

location• Service discovery• Monitoring• VO Support• Resource Broker• Data replication

UI

CA

CE

IS

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

6

Globus Toolkit

UI

CA

CE

SIwn

wn

wn

SE

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

7

Distributed Programming Frameworks

• NetSolve/GridSolve - NetSolve/GridSolve is an RPC-based library for executing solver code on Grid resources.

• Ninf-G - Ninf-G allows existing programming libraries to be used in a distributed fashion on a Grid using the RPC framework.

• MPICH-G2 - MPICH-G2 is a Grid-enabled implementation of the popular MPI (Message Passing Interface) framework

• Condor-G, DAGman - Condor-G and DAGman can be used to execute complex workflows (consisting of multiple independent or related jobs) using Grid compute resources via GRAM or Condor.

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

8

Globus Evolution

• Globus Toolkits • Web Services• WS-Resources Framework ( Grid via Web )

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

9

LCG and gLite software

UI

wnwnwn

SE

wnwnwn

SE

wnwnwn

SE

UI

RB

BDII

MON

FTS

VOMS

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

10

EGEE Monitoring

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

11

EGEE and LCG componentsVirtual

Organization

VO Support

VO Software Installation

User’s Role

VO Services VO Specific Grid Services

Monitoring

Application Information

LCG & gLite Application Information

Resource Broker

Monitoring

Data replication

VO Support

Globus Toolkit Security,

Job Submission

I/O Handling

Information Services

Monitoring and accounting

WEB Services

Local Farm LSF,PBS,CONDOR

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

12

SCIE GRA1Symbolic Computing on the Grid

• JRA1.1– Access to Symbolic Grid

Services

– Service Discovery

• JRA1.2– Access/Provide Grid Services

– Security polices

• JRA1.3– UI for SymGrid

– Orchestration of Grid Components

• JRA1.4– Adaptive scheduler– Dynamic resources

negotiator

• JRA1.5– Compilation use cases– Templates for common

tasks

• JRA1.6– Symbolic Grid Applications

• JRA1.7 – Evaluation

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

13

SCIE and EGEE

• JRA1.1– Access to Symbolic Grid Services - Web Services– Service Discovery - gLite Services discovery, Information Index

• JRA1.2– Access/Provide Grid Services - WS-Resources Framework– Security polices - Globus Security Framefork

• JRA1.3– UI for SymGrid - WSRF– Orchestration of Grid Components - MPICH-G, CONDOR-G

• JRA1.4– Adaptive scheduler - RB– Dynamic resources negotiator - CONDOR-G

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

14

Infrastructure EGEE / VO

• EGEE (Avril 2004)– Financé par l’UE (32M€) – Deux ans

• EGEE-II (Avril 2006)– Proposé à l’UE (~30M€)– Transition en cours– Deux ans.

JRA: Recherche commune

SA: ServicesSA1: Exploitation, support et management de la grilleSA2: Approvisionnement ressources réseauSA3: Intégration du middleware, Test et Certification

NA: Application RéseauNA1: ManagementNA2: DisséminationNA3: FormationNA4: Applications et supportNA5: Politique et coopération internationale

JRA1: Ingénierie logicielleJRA2: QualitéJRA3: Sécurité JRA4: Développement réseau

Aspect of Organisation in avarege

10 Jan 2007 Atelier de projet I3 SCIEnce Semeniouk Igor, LLR

15

Projet EGEE Perspectives

EGO: European Grid Organization ?