חזון הגריד בארץ ובעולםמצגת עבור יום עיון גריד-תעשיה

פרופ' דוד הורןיו"ר הגריד האקדמי הישראלי

אוניברסיטת תל-אביב

29/4/07

Enabling Grids for E-sciencE

What is Grid Computing?

• The grid vision is of “Virtual computing” (+ information services to locate computation, storage resources)

– Compare: The web: “virtual documents” (+ search engine to locate them)

• MOTIVATION: collaboration through sharing resources (and expertise) to expand horizons of – Research – Commerce – engineering, … – Public service – health,

environment,…

Grids: a foundation for e-Research

sensor nets

Shared data archives

computers

software

colleagues

instruments

Grid

e-Science methodologies will rapidly transform science, engineering, medicine and business

driven by exponential growth (×1000/decade) enabling a whole-system approach

Diagram derived fromIan Foster’s slide

Enabling Grids for E-sciencE

GRID

MIDDLEWARE

Visualising

Workstation

Mobile Access

Supercomputer, PC-Cluster

Data-storage, Sensors, Experiments

Internet, networks

The Grid Metaphor

Enabling Grids for E-sciencE

From a single PC to a Grid

Farm of PCs

Examples:

Seti@home

Africa@home

Example:

EGEE

Enterprise grid:Mutualization of resources in a company

Volunteer computing: CPU cycles made available by PC owners

Grid infrastructure: Internet + disk and storage resources + services for information management ( data collection, transfer and analysis)

Enabling Grids for E-sciencE

Typical grid

• Grid middleware runs on each shared resource to provide– Data services– Computation services– Single sign-on

• Virtual Organisation:

People in different organisations seeking to cooperate and share resources across their organisational boundaries

• Virtual organisations negotiate with sites to agree access to resources

INTERNET

Enabling Grids for E-sciencE

What Are Grids Used For?

High-performance computing

Collaborative data-sharing

Collaborative design

Drug discovery

Financial modeling

Data center automation

High-energy physics

Life sciences

E-Business

E-Science

Source: Hiro Kishimoto GGF17 Keynote May 2006

Data: A “Killer App” for the Grid

Over the next decade, data will come from everywhereScientific instrumentsExperimentsSensors and sensor netsNew devices (personal digital devices, computer-enabled clothing, cars, …)

And be used by everyoneScientistsConsumersEducatorsGeneral public

Cyberspace environment will need to support unprecedented diversity, globalization, integration, scale, and use

Data from sensors

Data from simulations

Data from

instruments

Data from analysis

Data Challenge- the next huge machine in particle physics (LHC @ 2007)

50 CD-ROM

= 35 GB

6 cm

Storage Data:12-14 Petabytes/year

Concorde(15 Km)

Balloon(30 Km)

CD stack with1 year LHC data!(~ 20 Km)

Mt. Blanc(4.8 Km)

שימוש רפואי – ממוגרפיה.דוגמא לתחרות אירופה-ארה"ב

, הדגיש שאירופה מובילה על פני ארה"ב 10.11.2003מאמר בניו-יורק טיימס, בהשקעותיה בנושאי הגריד. התמונה מתייחסת למאגר נתונים לאומי של תמונות

ממוגרפיה דיגיטליות שנתמך על ידי בריטניה.

NERC (£15M)7%

CLRC (£10M)5%

ESRC (£13.6M)6%

PPARC (£57.6M)27%

BBSRC (£18M)8%

MRC (£21.1M)10%

EPSRC (£77.7M)37%

UK e-Science Budget (2001-2006)

Source: Science Budget 2003/4 – 2005/6, DTI(OST)

Total: £213M

Enabling Grids for E-sciencE

EGEE is the largest existing grid

More info

• Project leader : CERN

• 91 leading institutes

• 32 countries

• >60 VOs from 9 domains

Israel Academic Grid participates in EGEE through TAU

Enabling Grids for E-sciencE

Snapshot of EGEE

IL in Geant

IL connection upgraded on January 2006 to 1.24 Gb/s

Are we on the wrong side of the digital divide?

1 10 100 1000 10000 100000

Sweden (SUNET)

Netherlands SURFnet)

United Kingdom

Germany (DFN)

Belgium (BELNET)

Portugal (FCCN)

Poland (PIONIER)

Spain (RedIRIS)

France (RENATER)

Czech Republic (CESNET)

Greece (GRNET)

Switzerland (SWITCH)

Finland (FUNET)

Italy (GARR)

Hungary (HUNGARNET)

Austria (ACOnet)

Iceland (RHnet)

Slovakia (SANET)

Ireland (HEAnet)

Denmark (UNI.C)

Norway (UNINETT)

Slovenia (ARNES)

Romania (RoEduNet)

Latvia (LANET-2)

Moldova

Lithuania (LITNET)

Luxembourg (RESTENA)

Estonia (EENET)

Algeria (CERIST)

Georgia (GRENA)

Israel (IUCC)

Russian Federation (RBNet)

Turkey (ULAKBIM)

Morocco

Croatia (CARNet)

Bulgaria (IST)

Iran (IRANET)

Ukraine (URAN)

Serbia/Montenegro AMREJ)

Kyrgyzstan (KRENA)

Jordan (NITC)

Albania (ANA)

Uzbekistan UzSciNet

Core Capacity (in Mb/s)

Current Core Capacity

Expected Increase in Two Years

Digital Divide Illustrated by Network Infrastructures: TERENA Core Capacity Digital Divide Illustrated by NetworkInfrastructures: TERENA Core Capacity

Core capacity goes up in Leaps: 1 to 2 to N X 10 Gbps;1-2.5 to 10 Gbps;0.6-1 to 2.5 Gbps

Current

SE Europe, Medit., FSU, Mid East:

Slower Progress With Older Technologies (10-622 Mbps).

Digital Divide Will Not Be Closed

Source: www.terena.nl

1 M

10G 20G

10M

100M

1G

By ~2007

N X

10G

Lam

bd

as

EGEE sites in Israeli universities

Organized within the Israel Academic Grid

iag.iucc.ac.il

הגריד האקדמי הישראלי מוגדר כיום כפרויקט במחב"אועדת היגוי – נציג רשמי מכל אוניברסיטה יישום – גריד המבוסס על קשר בין אשכולות

מחשבים באוניברסיטאות שונות. צמתים קיימים באוניברסיטאות ת"א ובן-גוריון, במכון

וייצמן, בטכניון ובאוניברסיטה הפתוחה. : שת"פ בינלאומיEGEE במסגרת התכנית

SEEהשישית. ישראל חברה בו במסגרת המנוהלת ע"י יוון.

2007מהלכים באירופה בשנת

קיימים תהליכי התארגנות של ארגוני הגרידEGI לגריד כלל אירופי NGIהלאומיים

התארגנות זו נתמכת ע"י הקהילייה האירופית כתשתית FP 7כחלק מתכנית המסגרת

מחשובית במקביל צפויה להימשך פעילות EGEE עד מרץ

2010

Slide courtesy of Kyriakos Baxevanidis, EC

Broad scale test-beds

Production quality

facilities

Sustainable

e-Infrastructures

(utility model)

Sustainable grid/data-based e-Infrastructures

(utility model)

Towards sustainable grid-empowered e-Infrastructures

Is there an NGI in your Country?Part

A

Yes: 25

No: 5

What Form does your NGI have?

A funded national project: 12

An entity appointed by an

official authority: 9

A memorandum of

understanding: 5

An informal group that meets

frequently: 4

Part

A

Aus Cro CzR Fr DE Gr

Lit NL Nor Pt Swe UK

Bel Est Fin DE Gr

Isr Pol Rus Ukr

Bul Gr Ser Tk Ukr

Est Fr Nor Ukr

NGI Operational Information:

Application Areas

High Energy Physics: 15Physics of Natural Phenomena,

Marine Science

Bioinformatics: 13Energy

Chemistry: 12Computational Mechanics

Earth Sciences: 9Virtual laboratory – Support for

labour equipmentApp Independent / All Apps: 8Engineering

Astronomy, Cosmology, Astrophysics, Space Res.: 6Materials

)Bio(medicine, Health SciencesNanotechnology

FusionRobotics

Graphic Modeling; Modeling, Simulation & OptimisationKnowledge Representation

Optimisation of Traffic RoutingWeb Search Engine

GeophysicsHumanities

Part

C

2007התפתחויות צפויות בישראל במהלך

על מנתIAGהגדלת לענות על צרכי האקדמיה•

) אשר יכלול או יחליף ISRAGRIDהקמת גריד לאומי ( על מנתIAGאת

לענות גם על צרכי התעשייה•

וביחד בתכנית EGIלהתכונן להתפתחות הגריד האירופי •

המסגרת השביעית

Enabling Grids for E-sciencE

Take home message

• Ask not what “the Grid” can do for you

• BUT

• With whom do you collaborate?

• What resources / services can you provide?

• What resources would empower your research?

People

Data

Computation