1AIP Workshop “Hands-On Globus!”8. 11.2006

AgendaAgenda

I. I. What is a grid?What is a grid?

II. II. Globus structureGlobus structure

III. III. Use cases & Hands on!Use cases & Hands on!

IV. IV. AstroGrid @ AIP: Status and PlansAstroGrid @ AIP: Status and Plans

Hands-On-Globus Overview

2AIP Workshop “Hands-On Globus!”8. 11.2006

Introduction I:What is a Grid?

6AIP Workshop “Hands-On Globus!”8. 11.2006

Old and new networks

7AIP Workshop “Hands-On Globus!”8. 11.2006

Next step: Resource sharing:information processing power out of the socket

$ submit_jobsubmitting job…requisitioning 7.3 Exaflops…

job successful.$ publish_paper

compiling & publishing…review process…2006.nature.447.pp1103-17 OK.

8AIP Workshop “Hands-On Globus!”8. 11.2006

What Resources can be shared?

Efficient use of: CPU-Power storage space special hardware (sensors, telescopes, robots) installed applications and licenses

Advantages: load balancing, scaling redundancy increased reliability uniformuniform protocol interface for arbitrary resources

9AIP Workshop “Hands-On Globus!”8. 11.2006

Again: What is a Grid?

A buzz word? A grid distributes, manages and coordiates resource sharing

and collaboration without centralised control. A grid uses standardised, open, general-purpose protocols

and interfaces. It can be (very) inhomogenious It includes security mechanisms, even though being spread

out over multiple diverse „domains“. It is used for professional work It is more than the sum of ist parts and non-trivial.

A grid is computers plus the internet plusplus some more things

a.k.a.“meta computing“, „distributed [parallel] computing“

10AIP Workshop “Hands-On Globus!”8. 11.2006

A grid or not a grid?

Operating Systems + the internet??- client-server architecture, no automated network-wide components

Botnets (for spamming or DOS-Attacks)?- centrally organised

Peer-to-peer networks?- function limited to data sharing

Cluster?- too homogenius, specialised and centralised. Localised, different operating and security systems

(but a good thing anyway) SETI project or BOINC (500.000 CPUs!)?

- limited function, no cooperation. A low-end grid?

11AIP Workshop “Hands-On Globus!”8. 11.2006

Where are we on the Hype Curve?

Gardner Group (US IT consulting company)August 2005

Peak of inflated expectationsPeak of inflated expectationsPeak of inflated expectationsPeak of inflated expectations

Trough of disillusionmentTrough of disillusionmentTrough of disillusionmentTrough of disillusionment

12AIP Workshop “Hands-On Globus!”8. 11.2006

MiddlewareMiddleware – can you see it?

• Grid middlewaremiddleware is a set of programs: demons, shell scripts, servers, java servlets, etc.

• Middleware software is focused to perform specific tasks within the grid

• The middleware extends the operating system to allow:

dedicated servers to perform automated management tasks

a machine to become part of the grid and share resources

a user to access and use the grid.

or: that‘s all very nice, but the devil is in the details

13AIP Workshop “Hands-On Globus!”8. 11.2006

Introduction II:

Globus

Components

14AIP Workshop “Hands-On Globus!”8. 11.2006

Globus history

1998: Globus V1.0; currently V4.03. Work in progress… Communities: Globus Alliance, Open Grid Forum de-facto standard in science, core elements are stable written mostly in C, web service layers Java and Python uses XML for web service documents open source

„Globus is the plumbing standard of the grid, a set of blocks and tools“.

Remember that grid resources are not very homogenious.

16AIP Workshop “Hands-On Globus!”8. 11.2006

Main Globus Elements

Resource Hardware: Resource Hardware: computers, storage, sensorsprovide: operating system, network accessallow: program execution, local user management

Globus Toolkit MiddlewareGlobus Toolkit MiddlewareGlobus Toolkit MiddlewareGlobus Toolkit Middleware

DataManagement

DataManagement

ExecutionManagement

ExecutionManagement

StatusInformation Service

StatusInformation Service

SecurityInfrastructure

SecurityInfrastructure

JobMonitoring

JobMonitoring

JobManagement

JobManagement

UserUser GlobusGlobus

18AIP Workshop “Hands-On Globus!”8. 11.2006

The Globus Toolkit: Component Overview

About a dozen core commands for command line Many services are available in different versions:

as command line service and additionally as web (augmented) service.

Some are just „grid-improved“ versions of unix a commands

They often use „batch“ scripts (RLS, XML), models exist Lots of acronyms… see handout!

22AIP Workshop “Hands-On Globus!”8. 11.2006

[Cern grid flash]

Does all that work together(at least in theory)?