12
- 1 - Grid Grid Programming Programming Environment Environment (GPE) (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

Embed Size (px)

Citation preview

Page 1: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 1 -

GridGridProgrammingProgrammingEnvironment Environment (GPE)(GPE)

Ralf RateringIntelParallel and Distributed Solutions Division (PDSD)

Page 2: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 2 -

OGSA enabled Server Components

Web Services

WS Resource Framework WSRF

Open Grid Service Architecture OGSA

Applications

Grid Programming Language

Bringing applications to the Grid...

Visual Grid SDK

GridBeansClient

Framework

The next step:The next step:Grid Programming Environment Grid Programming Environment (GPE)(GPE)

GPE

High Level Grid API

Java reference implementation

Language independent definition

Page 3: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 3 -

Use Case: Expert UserUse Case: Expert User

Application Grid ServiceGridGrid

User Keystore

Grid Client

Run multiple applications in complex workflows

Get all information from the Grid

Application GS

Broker GS

Information GS

Application GS

Database GS

WSRF

Fully-fledged Java Application

Page 4: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 4 -

GridGrid

Use Case: Application UserUse Case: Application User

Application Grid Service

User Certificate

Application Client

WSRF

Only one application Get only application specific

information Run lightweight client on mobile

devices

Lightweight Java Application

Page 5: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 5 -

GridGrid

Use Case: Unaware UserUse Case: Unaware User

What is a "Grid"? Service provider offers a service on

the web

Server

Server Certificate

Service Provider

User

Web Browser UserDB

Authenticate using server certificate

Request/Response

JSP

Application Grid Service

WSRF

Presentation oriented

user interface

Register

Page 6: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 6 -

GridGridWeb Client

Application Client

Grid Client

The Grid DeveloperThe Grid DeveloperGrid SDK

GridBean = Grid Service + Client Plug-in

Wrap existing applications Write new Grid applications Plug-in for Eclipse

Application GS

Broker GS

Database GS

Information GS

Application GS

Deploy

WSRFG

-AP

IApplication

Plug-in

Deploy

Page 7: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 7 -

Grid Service BackendsGrid Service Backends

GPE will provide Grid services to wrap different server types

Application GS

UNICORE GS

Globus GS

DRMAA GS

Globus Job Manager

UNICORE Network Job Supervisor

Condor

WS

RF

Sun Grid Engine

Nat

ive

Pro

toco

ls

Page 8: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 8 -

GPE: The big picture…GPE: The big picture…

Application Client

GridBean

User Certificate

Mobile Device

Web Client

Web Browser

JSP

User Workstation

Expert Client

PluginsPluginsGridBeans

Keystore

Service Provider

Application Portal

Service Certificate

GridBean

GridGridApplication GS

Broker GS

Information GS

Application GS

Database GS

WS

RF

Developer Workstation

Grid SDK

Deploy Plug-Ins

Deploy GS

DRMAA

UNICORE

GlobusG-A

PI

Page 9: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 9 -

GPE Step 1:GPE Step 1:Writing a UNICORE handler for Globus Writing a UNICORE handler for Globus CoGCoG

AJO Builder Components and SecurityContext added

Functionality: Task Execution and File Transfers

UNICORE

GT2

SSH

GT3

GlobusCoG

Page 10: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 10 -

GPE Step 2:GPE Step 2:Integrating UNICORE with KarajanIntegrating UNICORE with Karajan

Karajan-XML job description Workflow managed in Karajan

Engine– Treat UNICORE jobs as Karajan tasks!

UNICORE

Karajan Engine

KarajanXML Job

DescriptionGT2/3/4

SSH

GlobusCoG

Page 11: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 11 -

GPE Current Status:GPE Current Status:Proof of concept implementation Proof of concept implementation

UNICORE

ApplicationClient

GT2/3/4

SSH

ExpertClient

GridBean

GridBean

mySQLDatabase

GlobusCoG

Job Management Web Service

Karajan Engine

SpoolDirectory

KarajanXML Job

Description

Database keeps track of jobs and files

Files are spooled at web serviceService and two clients

implemented

Page 12: - 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)

- 12 -

Some Problems…Some Problems…

Karajan is too simple– no resource descriptions, etc.

Extend Karajan to match our requirements– Close cooperation with Globus CoG team

– Cooperate with GGF SAGA-WG (JSDL-WG?)

UNICORE security model too strict Use Globus style proxy certificates