4
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . < < . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > . . . . . . . . . . . . . . . . . > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > . . . . . . . . . . . . . . . . . . . . . > > > . . . . . . . . . . . . . . . . > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > > > . . . . . . > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . > > > > . . . . . . . . . . . . . . . . . > . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 0 1 0 1 . 0 0 1 1 0 1 1 0 1 0 0 0 1 0 1 1 1 0 1 0 1 0 0 1 0 0 1 0 . . 1 0 0 1 1 0 0 1 1 0 0 1 0 1 1 1 0 0 1 0 1 10101 1 101010101 101010 0 101101011010001 0 0 1 01 10101 11 1 0 10 1 0 0 1010 1101010001 011 101010100 0 1 0 1 1 0 1 1 1 0 1 0 1 0 0 0 1 0 0 0 1 1 1 1 1 1 0 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 1 0 1 0 0 1 1 0 1 1 1 0 1 0 1 1 1 1 0 1 1 1 0 1 1 1 0 1 0 1 0 1 1 0 0 1 1 0 0 1 1 0 0 1 1 0 1 1 1 1 0 1 1 0 0 1 0 1 1 1 0 1 0 1 01 0 1101 0 10001 01 1 1 0 1 0 1 0 1 0 1 1 1 1 0 0 1 0 0 1 1 1 0 0 0 1 0 1 1 1 1 1 1 0 1 1 0 1 1 1 1 0 0 1 1 0 0 1 1 0 0 1 0 1 0 1 1 0 1 0 1 0 0 0 1 0 1 0 1 1 1 0 0 1 0 1 0 0 1 0 1 1 0 1 1 0 0 1 1 1 1 0 1 0 1 0 1 0 1 1 0 1 0 1 0 1 0 1 0 1 1 0 1 0 1 1 0 1 0 0 0 0 1 0 0 0 0 1 1 0 1 1 0 1 1 0 1 0 1 0 0 1 1 1 1 0 0 1 0 1 0 0 1 0 1 1 0 0 0 1 0 1 0 1 0 011 1010101001010101010 0101 10101 1 101010101 101 001 011 1010101001010101010 0101 10101 1 101010101 1010101010110101 0 . . 1 1 0 1 0 . . 1 1 1 0 0 1 0 1 0 0 0 0 0 0 1 1 0 0 1 1 1 1 1 1 0 0 1 0 1 0 1 0 0 1 0 1 0 0 1 1 . . 0 1 0 1 0 0 0 1 . . 0 1 1 0 1 0 1 1 1 1 0 1 0 1 0 1 0 1 1 0 1 0 1 0 1 0 1 0 1 010 1101010001 011 1010101001010101010 0101 10101 1 101010101 101 0 10101 01010 1101010001 011 1010101001010101010 0101 10101 1 101010101 101010101011 0 1 0 1 0 0 . . 1 . . 1 0 1 0 0 1 1 0 0 . 0 0 1 0 0 1 1 1 1 0 1 0 1 0 1 0 0 1 0 1 0 0 1 0 1 0 1 0 0 . . 1 . . 0 1 1 0 1 0 1 1 1 0 1 . . 0 1 0 1 0 1 1 0 1 0 01010 1101010001 011 1010101001010101010 0101 10101 1 0 1 1 0 0 1 1 0 0 1 1 0 0 0 0 1 1 0 0 1 1 0 0 1 0 1 1 1 1 0 1 1 0 0 1 1 0 1 1 0 0 1 0 0 0 1 1 0 1 1 0 0 1 0 1 0 1 0 0 1 0 1 1 0 1 0 1 1 1 0 1 0 1 0 1 0 1 0 1 0 1 1 0 1 0 1 . . 0 0 0 1 0 1 1 . . . 1 0 0 1 0 1 0 1 0 0 1 0 1 0 1 1 0 1 0 1 1 1 0 1 1 0 0 0 1 0 0 0 1 1 1 0 1 0 1 1 0 0 1 0 1 0 0 1 1 1 1 1 1 0 0 1 0 1 0 0 1 0 1 0 1010 11 0 1010001 011 101 0 1 1 1 0 0 1 1 0 1 0 1 0 1 0 1 1 0 0 0 1 0 0 1 1 1 1 0 1 0 0 1 1 1 1 1 0 1 0 1 0 0 1 1 1 1 1 1 00 1 1 0 0 1 1 101010100101 0 1 1 1 1 1 1 1 0 0 1 1 1 1 1 0 0 0 1 0 1 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 1 0 1 1 0 1 1 0 1 0 0 0 1 0 1 Powerful global computing networks are set to enable a new, collective approach to doing science. Physics will lead the way VISIONS 11 BRIEFING PAPERS FOR POLICY MAKERS E-science

E-science - Institute of Physics › publications › iop › archive › file_52170.pdf · pervasive research methodology – ‘e-science’. Idle computers The idea of distributed

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: E-science - Institute of Physics › publications › iop › archive › file_52170.pdf · pervasive research methodology – ‘e-science’. Idle computers The idea of distributed

. . .. . .

. .. .. . .

. . . .. . . . . . . . . . . . . . . . . . . . . . .

>................................<<.....................

......

... .

.. .. .

. .. .

. . .. .... ....

.... ........ ........

. . . . . . . . . . . . . . . . . . . . . . . .

> . . . . .............>....................

. . . . .

. . . . .. .. .. . ...........>.

.. . . . . . . . . . . . . . . . . . .>>> .................>.................

.

. . ... . .

. . .. .

. . . .. . . . .

. . . . .. .>>> . . . . . .

>.......................

. .. .

.... ..... .

. .. .

. .

. .. ........ .... .......

.... .... ..............

.. . .. . .

.. . .. .

. . . .. . . . .

. .. . . .>>>> . . . . . . . . . . .......>

.................................

.. .. .

. .. .

. .. .

. .. .

. .. .. . .

. . ... ..

0101 .00

11011010001

011

101010010010 .0 .

100110011001

01

1100

0 101

0011

010 1

0001

0011

1010

1010

0101

0101

010

0101

1010

11

1010

1010

110

1010

0101101011010001

00101

10101

11

101010

01010

1101010001

011

101010100

010110

11101010001

0001111

1100101010010101011010

01101

110101

11101

1101110101

0110

0111001

10001101

111011001011101

01010

1101010001

011

101

01010

1111001001110001

011

111101101111001100110010

1 0 11010

100010 1

011100101

0 0101 1011

00111 101

010101

101010

101011

010110

1000

010000

1101101

101010

0111100

1 010010

110001

01010

011101

010100

101010

1010 010

1 10101

1 101010

101101

001

011

1010101001010101010

0101

10101

1101010101

101010101

0110101

0.0.11010 .0 .11100101000000111001111110010101001010011 .1 .

01010001.1.

011010111101010101101010101

01010 1101 0 10001 011 1010101001010101010 0101 10101 1 101010101 101010101

01010 1101 0 10001 011 1010101001010101010 0101 10101 1 101010101 101010101011010100.0. 1.1. 101 00 1100.001 00111 101010100

10100101010 0

.

0

.

1.1. 01 10101 1 101

.

1

.

010101 1010

01010

110101

0001 011

101010

100101

010101

0 0101 101

011

01100001111 0000 11010010 0

0101101 0000 1111

0000 10100 1111

1111 0101 1

1 0000 1111 0

101 1010 0101

000 0000 1111 0

101 1010 01

0101

001

0110

101

110

1010

1

01010

110101.1.

0001

011.1. .

1001010100101011 0101

110110

0010

0011101011001

0100111111001

0100101

0 1 010

110101

0001 011

10101

1100110

1010

10

101

000100111

10100

111

11010

10011 11 1

1101101011101001000

1

0

1 1010111

1010101001010

11111 111 110 00101101110 101 0000 11 0101 000 0000000000 11 11

10

0

0

00

0

0 10111

01

101000101

Powerfu l g loba l comput ing

networks are set to enable

a new, co l lect ive approach

to do ing sc ience. Phys ics

wi l l lead the way

VISIONS11B R I E F I N G P A P E R S F O R

P O L I C Y M A K E R S

E - s c i e n c e

Page 2: E-science - Institute of Physics › publications › iop › archive › file_52170.pdf · pervasive research methodology – ‘e-science’. Idle computers The idea of distributed

t is extraordinary how muchthe Internet has changed our

lives in just a few years. We nowall talk to each other, find outinformation, shop and bankthrough the informal, globalnetwork of computers, using asystem of software called theWorld Wide Web. Yet the Webwas first purely a physicist’s tool – developed at CERN, the European particle physicslaboratory in Geneva, to allow its research teams based across different countries tocommunicate and share data.

Now, physicists and computerscientists are driving the nextevolutionary stage in Internet

technology, which is to broadenthe capability of computernetworks to provide delocalised,large-scale resources for storing,accessing and processing data,and to make them available togroups of people with commongoals. Computer services willbecome a utility like electricity,supplied via a ‘Grid’ that you cansimply plug into without beingconcerned about their location.

The first beneficiaries will belarge collaborations of scientists

and engineers working onproblems that involve hugeamounts of data. Indeed, one of the first large-scale examplesof the Grid in action will be in high-energy physics. The LargeHadron Collider, being built atCERN to investigate the ultimatephysics of the Universe, willgenerate billions of megabytesof data to be made available for analysis to thousands ofphysicists working in teamsaround the world. Nosupercomputer could managethis amount of data on its own.The LHC Grid will therefore bespread over an internationalnetwork of sites in a four-tiersystem.

Other scientific areas dealingwith deluges of data, will alsobenefit from this distributedcomputing approach. Theseinclude astronomy, Earthobservation, engineering and the biosciences (in particularexploiting the information from

the Human Genomeproject). In fact, the Gridmakes possible a powerful andpervasive research methodology– ‘e-science’.

Idle computers

The idea of distributedcomputing is quite old. Even 20years ago, people realised thatindividual computers could beharnessed like a team of horsesto provide more processingpower. Today, the fastestsupercomputers are collectionsof microprocessors, and manylaboratories string togetherclusters of PCs – each morepowerful than a supercomputerwas 10 years ago – intocomputer ‘farms’.

However, there is no reasonwhy the PCs should be in onelocation or even in one country.This was realised in 1985 byMiron Livny at the University of

T H A N K S G O T O T O N Y H E Y O F S O U T H A M P T O N U N I V E R S I T Y / E P S R C / D T I , A N D A L S O T O G E R R Y

Developing newaircraft will be done by'virtual' organisationssupported by the Grid

I

T h e b i r t h o f e - s c i e n c e

CE

RN

BA

E S

yste

ms

The Grid will play a major role in analysing particle

collisions from theLarge Hadron Collider

Page 3: E-science - Institute of Physics › publications › iop › archive › file_52170.pdf · pervasive research methodology – ‘e-science’. Idle computers The idea of distributed

Wisconsin, who pointed out thatmost PCs are often idle andproposed pooling their spareprocessing capacity usingInternet software. The first well-known application was for theSETI (search for extraterrestrialintelligence) project. Home-computer users could downloada screen-saver, SETI@home,which sifted through theplethora of radio signals receivedfrom space by the Arecibotelescope in Puerto Rico. Other‘@homes’ soon followedenabling various medicalprojects such as cancer andAIDS research.

This was just the beginning. In 1995 Ian Foster at ArgonneNational Laboratory and CarlKesselman of the University ofSouthern California took theconcept in a new direction. They realised that researchcommunities, which arebecoming increasinglyinternational and multi-disciplinary, could link all theircomputers so as to share data,applications, instruments andother resources in a coordinatedand controlled way to create asingle virtual laboratory. Theconcept of the Grid was born.

Foster envisages that to solveparticular problems, groups ofpeople would come together to form ‘virtual organisations’supported by the Gridinfrastructure. These could beparticle physicists working witha new collider, a companyconsortium designing a new jet,or a crisis-management teamdealing with an environmentalproblem.

Creating a large-scalecomputing infrastructure, ofcourse, requires not only theright hardware – sets ofcomputer clusters and high-speed connections – but alsostandard protocols and services

to knit the system together –‘middleware’. The system has to be secure and interfaceflexibly with different operatingplatforms. It has to recognisewho is allowed access, whatkinds of programs or data arebeing requested and how toallocate the computer resources.A set of Grid technologies isslowly emerging, the first beingprovided by the Globus Toolkitdeveloped by teams headed byFoster and Kesselman. However,other research groups are also working on providingmiddleware components.

Grids ‘R’ Us

Scientists, especially physicists,have been quick to recognisethe potential of this new way ofworking. Grid projects abound.For example, in the US there is the Grid Physics Network(GriPhyN), the NASA InformationPower Grid, the Department ofEnergy Science Grid, the ParticlePhysics Data Grid and theNational Science Foundation’sTera Grid, among others.Europeans have been equallyactive and are working on arange of initiatives including theCERN DataGrid, an EU-fundedEurogrid and the VirtualObservatory (see Box).

The UK Government has also recognised the potential of e-science, allocating £120Mover 3 years for various Gridapplications in all areas ofscience and engineering, forupgrading hardware and fordeveloping generic middleware.Theoretical physicist andcomputer scientist, Tony Hey,leads the initiative. A nationalnetwork of Grid centres is beingset up. Many of the projects willinvolve collaboration withindustry as well as interfacingwith international Grid projects.IT companies such as IBM,

Microsoft and Sun are alsogearing up to participate increating the infrastructure.

The ultimate aim will beeventually to provide anintelligent global computing and data resource, that, like the present Internet, can beexploited by science, commerceand individuals according to their needs.

G I L M O R E O F T H E C A M B R I D G E I N S T I T U T E O F A S T R O N O M Y F O R T H E I R H E L P W I T H T H I S P A P E R

T H E V I R T U A L O B S E R VAT O R Y

Astronomy offers an ideal testbed for

e-science. Astronomers realised that ongoing

and new sky surveys cataloguing stars and

galaxies at all wavelengths were creating vast

data sets. The idea of a Virtual Observatory

has emerged as a way of coordinating the

data from the different archives so they could

be easily accessed. This approach will change

the way astronomers work. They will be able

to explore a wide range of observations,

across wavelengths for example, in a way that

will lead to new astrophysical insights.

Furthermore, researchers in developing

countries, and students, will benefit as they

are given direct access to resources

otherwise unavailable to them. The

sociological impact of the Grid approach to

doing science will be enormous.

The VISTA telescopesurveys will

generate largeamounts of data

Page 4: E-science - Institute of Physics › publications › iop › archive › file_52170.pdf · pervasive research methodology – ‘e-science’. Idle computers The idea of distributed

.

..........

......

......

....

. .. .

. . .

. . .. . . . .

. << . . . . . . . . .

. . . . .. .. . . . . . . .. ... .......... .. . . . . .. .. .. .. . . .>>>> ..

...................................................

........

....

. ..

. . <<. .

. . . .. . . . .

... ...

. . . . .. . . . . . . . . . . . . . . . . . . . . << . . . . . . . . .. . . ...........>>

........................................>>>

.....

.... .

. .. .

. . . . .. . .

. .. . .. .... .... .... .... .... .... .... ....

. . . . . . . . .

.....................

...<<

...

......

....

... .

. .. . .

. . . .. . . . . . . . . . . . . . . . . . . . . .

1010110100 0010.0.101010010.0. .0.001001

10001111100000001010 110 10100 11010100.0. .0. 101001010010 000000000000000000000111111111111

1010101

101010101

010100110101000

1 011010101 10101. .1. 01001101.1. .1.1010 0010100000011110000010111001011111

1110

0100000000010

1110101100001

011

1

000000010100 11010100

01010

1101 0 1

0001 0

0 10101101010001

01110 .0 .

101010010101 .1 ..1.

01010001001

1

10101010100.0. .0. 101

101011

101101101

0.0. .0. 110011000101101000

110100111111110010 10111011000001 011 01000

01. 00.0. 111

1101010010000110

010100

110101000001

011

10101010010100101010

0101

101

.

1

.011

1

.

1

..1. 01100101000111

1

1 0101

101010100 00 101

1111

101011010001

>

1

> 0> 0>

1000001

0 001

0011

11010

10010

01

00001

011

101100110100101011011010

0101

10110001

1110

.

0

. 101

.

1

..

1

. 01011001

1101010100101010101001

Edit

or:

Nin

a H

all,

Des

ign

: Pe

te H

od

kin

son

Inst

itu

te o

f P

hys

ics

Visions is a ser ies of papers which

highl ight exci t ing new areas of research

in physics, and their theoret ical and

technological impl icat ions.

AV A I L A B L E V I S I O N PA P E R S :

H i g h i n t e n s i t y l a s e r sQ u a n t u m i n f o r m a t i o nE x o t i c n u c l e a r b e a m sP h y s i c s a n d f i n a n c eS p i n t r o n i c sT h e L a r g e H a d r o n C o l l i d e rPa r t i c l e a c c e l e r a t o r s – t h e n e x t f r o n t i e rF l a t s c r e e n d i s p l a y sS u p e r c o n d u c t i v i t yG r a v i t y w a v e s

F O R T H C O M I N G V I S I O N PA P E R S :

P h o t o n i c sT e l e s c o p e sT e c h n o l o g i c a l p l a s m a sF r e e e l e c t r o n l a s e r s

A B O U T T H E I N S T I T U T E O F P H Y S I C S

The Inst i tute of Physics is an internat ional

learned society and professional body for

physic ists . The Inst i tute has more than 37,0 0 0

individual members.

F O R F U R T H E R I N F O R M AT I O N C O N TA C T :

Department of Higher Educat ion and Research

The Inst i tute of Physics

76 Port land Place, London W1B 1NT, UK

e-mai l : v is [email protected]

Inst i tute website: http: / /www.iop.org/

To f ind out more about Grid projects and

technologies, start off at the Nat ional e-Science

Centre which has l inks to a range of s i tes:

www.nesc.ac.uk/ggrid/ index.html

For more on virtual observator ies start at

The Virtual Observatory Forum:

www.voforum.org/

Nee

lon

Cra

wfo

rd/G

emin

i Ob

serv

ato

ry