20
GRID GRID - - RTC RTC GRID Regional Training, GRID Regional Training, Cluj Cluj - - Napoca Napoca 17 17 - - 18, April, 2008 18, April, 2008 An An EGEE EGEE - - II II training event training event

GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

GRIDGRID--RTC RTC GRID Regional Training, GRID Regional Training,

ClujCluj--NapocaNapoca 1717--18, April, 200818, April, 2008

An An EGEEEGEE--IIII training eventtraining event

Page 2: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

In loc de In loc de introducereintroducere ……. . GRID computing, EGEE, EGIGRID computing, EGEE, EGI

ParadigmaParadigma ““Parallel computingParallel computing””OriginileOriginile GRIDGRIDEGEE EGEE –– prezentprezent sisi viitorviitorProiecteProiecte GRIDGRIDInitiative GRID Initiative GRID romanestiromanesti

Page 3: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ParadigmaParadigma ““Parallel computingParallel computing””executiaexecutia paralelaparalela -- crestereacresterea performantelorperformantelor de de calculcalcul pestepeste limitelelimiteleimpuseimpuse de de tehnologietehnologieLimiteLimite de de frecventafrecventa, , putereputere consumata/disipataconsumata/disipata, , limitelimite dededede integrareintegrareForme/niveleForme/nivele de de paralelizareparalelizare::

•• La La nivelnivel de date: SIMD, UAL multiplede date: SIMD, UAL multiple•• La La nivelnivel de de instructiuniinstructiuni: : ArhitecturiArhitecturi Pipeline, Pipeline, ArhArh. . SuperscalareSuperscalare•• La La nivelnivel de fire de de fire de executieexecutie: : HyperthreadingHyperthreading, Multi, Multi--corecore•• La La nivelnivel de taskde task--uriuri, job, job--uriuri: :

ArhitecturiArhitecturi paraleleparalele clasiceclasice: : directiadirectia HPC (High Performance computing)HPC (High Performance computing)ArhitecturiArhitecturi distribuitedistribuite: : retele+PCretele+PC--uriuri, Internet, InternetArhitecturiArhitecturi GRIDGRID

ParadigmaParadigma ““GridGrid””SeparareaSepararea furnizorilorfurnizorilor sisi a a consumatorilorconsumatorilor de de servicii/resurseservicii/resurse –– similar cu similar cu reteleleretelele electriceelectrice, , reteleleretelele telefonicetelefonice, TV, TV--cablucablu, etc., etc.ServiciileServiciile sisi resurseleresursele infoinfo--comunicationalecomunicationale –– multmult maimai complexecomplexe, , maimai greugreude de administratadministrat ca un ca un sigursigur ““produsprodus””

Page 4: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

OriginileOriginile GRIDGRID

HPC - High Performance Computing

Internet, WEB

Sisteme distribuite, SOA GRID Computing

Resurse distribuite

Servicii de calitate side inalta performanta

Standarde deschise

“Dependable, consistent, pervasive and inexpensive access to high-performance computing capabilities”

Kesselman - GridAnatomy

Page 5: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

EGEE EGEE Enabling Grid EEnabling Grid E--sciencEsciencE

InfrastructuraInfrastructura distribuitadistribuita de de calculcalcul siside de stocarestocare pusapusa in in slujbaslujba stiinteistiinteiSuportSuport pentrupentru ExperimenteExperimente stiintificestiintificede de anverguraanvergura::

FizicaFizica nuclearanucleara –– fizicafizica particulelorparticulelor(CERN)(CERN)BiochimieBiochimie, , farmaceuticafarmaceuticaStiinteleStiintele pamantuluipamantului: : geofizicageofizica, , mediumediu,,AeronauticaAeronautica: : simularesimulare

OrganizatiiOrganizatii virtualevirtuale ––colective/laboratoarecolective/laboratoare internationaleinternationalede de cercetarecercetareIn In perspectivaperspectiva -- SuportSuport de de inaltainalta

performantaperformanta pentrupentru companiicompaniifurnizoarefurnizoare de de serviciiservicii informaticeinformatice(????)(????)

Page 6: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

EGEE EGEE sisi CERNCERN

Page 7: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

EGEE in EGEE in cifrecifre

Sursa: Bob Jones, Direcor EGEE, EGEE 2008, Budapesta

Page 8: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ActivitatiActivitati in in cadrulcadrul EGEE II EGEE II

Page 9: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ActivitatiActivitati in EGEEin EGEE

Networking Activities (NA)Networking Activities (NA) –– managementulmanagementulsisi coordonareacoordonarea tuturortuturor aspecteloraspectelor de de comunicarecomunicare in in cadrulcadrul proiectuluiproiectului

Specific Service Activities (SA)Specific Service Activities (SA) ––activitatiactivitati de de suportsuport, , operareoperare sisi management a management a infrastructuriiinfrastructurii Grid, Grid, furnizareafurnizarea de de resurseresurse GridGrid

Research Activities (JRA)Research Activities (JRA) -- activitatiactivitati de de cercetarecercetare--dezvoltaredezvoltare in in domeniuldomeniul GridGrid

Page 10: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

De la FPDe la FP--6 la FP 76 la FP 7 De la EGEE II la EGEE IIIDe la EGEE II la EGEE III

2003 2004 2005 2006 2007 2008 2009 2010 2011GEANT GEANT2 GEANT?

FP5 FP6FP7

EGEE II EGEE III

Obiective EGEE III:

1. Extinderea si optimizarea infrastructurii existente

-Includerea mai multor resurse

-Suport pentru mai multe comunitati de utilizatori

-Mai usor de utilizat

-Noi standarde

2. De la un model bazat pe proiect la o infrastructura federativa de initiative grid nationale autosustenabil

EGEE

Page 11: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

EGEE IIIEGEE III

Sursa: Prezentare Bob Jones, director proiect EGEE II-III,

Conferinta EGEE 2007, Budapesta

Page 12: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ComunitateComunitate de de cercetarecercetare virtualavirtuala sisi globalaglobala

Laborator virtual

Spatiu de lucru virtual

ComunitateComunitate virtualavirtuala

Laborator virtual

Spatiu de lucru virtual

ComunitateComunitate virtualavirtuala

……

Infrastructura Grid

Infrastructura de comunicatie

Infrastructura de Date stiintifice

(Biblioteca digitala virtuala)

Page 13: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ProiecteProiecte EGEE EGEE –– Grid Grid FizicaFizica energiilorenergiilor inalteinalte: ALICE, LHC, ATLAS, : ALICE, LHC, ATLAS, LHCbLHCbAplicatiiAplicatii biomedicalebiomedicale: :

GATE GATE (a radiotherapy planning and medical tomography application); (a radiotherapy planning and medical tomography application); GPS@ GPS@ (Grid protein Sequence @(Grid protein Sequence @nalysisnalysis): ):

CDSS CDSS (Clinical Decision Support System) (Clinical Decision Support System)

Drug Discovery Drug Discovery

SPLATCHE SPLATCHE (genome evolution modeling)(genome evolution modeling)

BiblioteciBiblioteci digitaledigitaleGRACE GRACE ((GRidGRid enabled enabled seArchseArch and Categorization Engine) and Categorization Engine) DILLIGENTDILLIGENT –– modelareamodelarea bibliotecilorbibliotecilor digitaledigitale pepe GridGrid

AstrofizicaAstrofizicaESA ESA Planck Planck –– cartografiereacartografierea microundelormicroundelor ceresticeresti

StiinteleStiintele pamantuluipamantuluiEGEODEEGEODE -- Expanding Expanding GEOsciencesGEOsciences on Demandon Demand

AplicatiiAplicatii financiarefinanciareEgridEgrid

Page 14: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

EGI EGI –– European Grid InitiativeEuropean Grid InitiativeProiectProiect FP7, FP7, pepe 2 2 aniani (a (a inceputinceput in in septsept. 2007). 2007)ObiectivObiectiv: :

construireaconstruirea uneiunei infrastructuriinfrastructuri Grid federative, Grid federative, sustenabilesustenabile, , InfrastructuraInfrastructura deschisadeschisa pentrupentru o o plajaplaja largalarga de de domeniidomenii stiintificestiintificesisi utilizatoriutilizatoriInfrastructuraInfrastructura sasa depaseascadepaseasca limitelelimitele unorunor proiecteproiecte nationalenationalesi/sausi/sau europeneeuropeneEforturiEforturi de de standardizarestandardizare

EGI = EGI = federatiefederatie de NGI de NGI ––uriuri (National Grid Initiative)(National Grid Initiative)In Romania: Romanian Grid Initiative, In Romania: Romanian Grid Initiative, coordonatcoordonat de de MinisterulMinisterul educatieieducatiei sisi cercetariicercetarii

Page 15: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

Initiative Grid Initiative Grid romanestiromanestiConsortiiConsortii

RoGRIDRoGRID –– 20022002•• LocatiiLocatii:: BucurestiBucuresti, , TimisoaraTimisoara, , IasiIasi, , ClujCluj,,•• InstitutiiInstitutii:: ICI, ICI, PolitehnicaPolitehnica BucurestiBucuresti, IFIN, INCAS, Univ. , IFIN, INCAS, Univ.

BucurestiBucuresti, Univ. , Univ. TehnicaTehnica din din ClujCluj, Univ. de Vest , Univ. de Vest TimisoaraTimisoaraRomanian Tire2 Romanian Tire2 –– 2007 2007 –– IFIN, ICIIFIN, ICIRomanian GRID Initiative Romanian GRID Initiative –– 20072007

ParticipariParticipari in in proiecteproiecte europeneeuropene::EGEE II EGEE II sisi IIIIIISEESEE--Grid Grid ????

Page 16: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

CERN: Large Hadron CERN: Large Hadron ColliderCollider(LHC)(LHC)Raw Data: 1 Petabyte/secFiltered 100Mbyte/sec = 1 Petabyte/year = 1 Million CD ROMs

Tire1

Tire2

Tire0

Tire4

Tire3

Sursa: Prezentare CERN-LHC)

Page 17: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ConcluziiConcluziiGrid Grid –– ““emerging technologyemerging technology””AvantajeAvantaje::

InfrastructuraInfrastructura performantaperformanta de de calculcalcul la la indemanaindemana oricaruioricaruicercetatorcercetatorSuportSuport unicunic pentrupentru proiecteproiecte de de anverguraanverguraServiciiServicii de de calculcalcul sisi de de comunicatiecomunicatie de de calitatecalitate garantatagarantataAccesAcces controlatcontrolat sisi securizatsecurizat la la resurseresurse distribuitedistribuitePromoveazaPromoveaza cooperareacooperarea globalaglobala prinprin organizatiiorganizatii virtualevirtuale

DezavantajeDezavantaje (in forma (in forma actualaactuala):):OrientatOrientat preaprea multmult sprespre domeniuldomeniul stiintificstiintificLipsaLipsa interactivitatiiinteractivitatiiLipsaLipsa uneiunei documentaridocumentari adecvateadecvateInstabilitateInstabilitate datoritadatorita ciclurilorciclurilor preaprea scurtescurte de de dezvoltaredezvoltare sisiinstalareinstalare a a unorunor noinoi versiuniversiuni de de infrastructurainfrastructura

Page 18: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

GRID Regional Training, GRID Regional Training, ClujCluj--NapocaNapoca

Program: Program: http://http://users.utcluj.ro/~sebestyen/gridtraining/gridTraining.htmlusers.utcluj.ro/~sebestyen/gridtraining/gridTraining.html

SectiuniSectiuni::InstruireInstruire pepe tehnologiitehnologii Grid Grid PrezentareaPrezentarea unorunor realizarirealizari in in cadrulcadrul unorunorproiecteproiecte GridGridExperimenteExperimente de tip de tip ““handshands--onon”” pepe GRIDGRID

Page 19: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ProgramProgram17.04.200817.04.20089:00 9:00 –– Opening; overview on EGEE project (present and future) Opening; overview on EGEE project (present and future) –– Gheorghe Gheorghe Sebestyen (UTCN), Doina Banciu (ICI) Sebestyen (UTCN), Doina Banciu (ICI) 9:15 9:15 –– Basic GRID concepts Basic GRID concepts –– Anca Hangan (UTCN)Anca Hangan (UTCN)10:00 10:00 –– BreakBreak10:15 10:15 –– GRID Technologies I (Condor, OGSAGRID Technologies I (Condor, OGSA--DAI) DAI) –– Anca Hangan (UTCN)Anca Hangan (UTCN)11:00 11:00 –– Coffee BreakCoffee Break11:15 11:15 –– GRID Technologies II (GRID Technologies II (GlobusGlobus, , gLitegLite) ) –– Anca Hangan (UTCN)Anca Hangan (UTCN)12:00 12:00 –– Discussions, questions Discussions, questions 12:30 12:30 –– Lunch breakLunch break

15:00 15:00 –– Developing applications on GRID Developing applications on GRID –– Tunde Balint (UTCN)Tunde Balint (UTCN)15:45 15:45 –– BreakBreak16:00 16:00 –– GRID resources for TIER 2 and EGEE GRID resources for TIER 2 and EGEE -- Banciu Banciu Doina(ICIDoina(ICI), Bildea ), Bildea Ana(ICIAna(ICI) , Cristian Ciortan (Bucharest University)) , Cristian Ciortan (Bucharest University)16:30 16:30 –– Geographical and environmental data processing over GRID Geographical and environmental data processing over GRID ––Dorian Gorgan (UTCN)Dorian Gorgan (UTCN)17:00 17:00 -- Coffee breakCoffee break17:15 17:15 –– Cryptography and GRID Cryptography and GRID –– Rodica Potolea and Alin Suciu (UTCN)Rodica Potolea and Alin Suciu (UTCN)17:45 17:45 -- Digital Content Management on Digital Content Management on GRIDsGRIDs –– Gheorghe Sebestyen Gheorghe Sebestyen (UTCN) (UTCN) 18:15 18:15 -- Discussions, questionsDiscussions, questions

Page 20: GRID-RTC GRID Regional Training, Cluj-Napoca 17-18, April ...users.utcluj.ro/~sebestyen/gridtraining/GRID-RTC_training.pdf · z ESA Planck – cartografierea microundelor ceresti

ProgramProgram9:00 9:00 –– HandsHands--on Laboratory practice on Laboratory practice –– Anca Hangan and Anca Hangan and Tunde Balint (UTCN)Tunde Balint (UTCN)10:45 10:45 –– BreakBreak11:00 11:00 –– GRID administration and deployment GRID administration and deployment –– Emil Emil CebucCebuc and and MagherusanMagherusan (UTCN)(UTCN)11:45 11:45 –– Coffee break Coffee break 12:00 12:00 –– Round table Round table –– Perspectives on GRID computing Perspectives on GRID computing