The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th

The PROGRESSGrid Service Provider

Maciej BogdańskiPortals & Portlets 2003

Edinburgh, July 14th-17th

Portals & Portlets 2003 2

The PROGRESS project

• Duration: December 2001 – May 2003 (R&D)• Budget: ~4,0 MEuro• Project Partners

– SUN Microsystems Poland– PSNC IBCh Poznań– Cyfronet AMM, Kraków– Łódź Technical University

• Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland


PROGRESS (2)

• Cluster of 80 processors

• Networked Storage of 1,3 TB

• Software: ORACLE, HPC Cluster Tools, Sun ONE, Sun Grid Engine


PROGRESS architecture


PORTAL

HPCRESOURCES

GRIDMANAGEMENT

SYSTEM

GRID SERVICEPROVIDER

4-tier new4-tier newgrid-portal environmentgrid-portal environment

Grid-Portal Environment

PORTAL

HPCRESOURCES

GRIDMANAGEMENT

SYSTEM

3-tier classical3-tier classicalgrid-portal grid-portal

environmentenvironment


Grid Service Provider (1)Features

• Use of grid resources most comfortable to end users.

• Easy building of numerous portals and other user interfaces. Users can switch between various interfaces and use the same GSP services.

• Various thematic scientific web portals sharing

the same grid resources.

• Possibility to provide all GSP clients (user interfaces) with computing resources belonging to two or more different grids.


Grid Service Provider (2)

• Necessary services to provide:– Job Submission Service

• managing the creation of user jobs, submission to the grid and execution monitoring (typically through reverse reporting, performed by the Grid Management System about events connected with job execution)

– Application Management Service• storing information about applications available for

running in the grid• assisting application developers in adding new

applications to the application factory– Provider Management Service

• keeping up-to-date information on the services available within the provider


GSP within PROGRESS

Co

nte

nt P

rovid

er

We

bse

rvice

Se

ssion

Be

an

En

tity Be

an

s


Job Submission Service (1)

• Creating computational jobs, submitting them to the grid for execution and viewing the results

• Job description is prepared using the XRSL language and is transferred to the Grid Resource Broker for the execution of the job

• Grid Resource Broker reverse reports on grid events connected with the job

• „Workflowed” jobs: sequences and parallels


Job Submission Service (2)

• Web Services interface– Create, modify, delete and submit computing

jobs (single and "workflowed” task), copy jobs– Manage job tasks, including: setting

application parameters, adding references to input and output files, setting task resource requirements

– Monitoring job execution– Change task status (used by the Grid

Resource Broker)


Application Management Srv. (1)

• Application repository management• Application descriptor contains a reference to the

application executable: a reference to a file stored in the DMS or a path to a binary on grid computing server filesystems

• Also included in the application descriptor: available (required or optional) arguments, required environment variables and required input and output files

• PROGRESS applications may be unconfigured or configured: one executable -> multiple configured applications

• Virtual applications


Application Management Srv. (2)

• Web Services interface– Add and remove applications, modify

application definitions– Manage virtual applications


Provider Management Service

• Enables keeping up-to-date information on services available in the grid service provider

• Service descriptor contains information on the Web Service interface: URL at which the service is available, the service namespace reference (URN) and the service WSDL reference

• Services may have multiple instances: informational services

• Web Services interface– Add and delete services, modify their

descriptors– Add and delete instances of services


Informational Services

• Examples of instance enabled services

• Intended for use by web portals• PROGRESS example: short news

service• Other: document directory,

discussion forum (under development)


Short News Service

• Web Services interface– Add, modify, delete and read news– Add and delete own instances

(informational services are examples of multiple instance services)


XRSL Language

• Extended Resource Specification Language (XRSL) is an XML based language designed for description of computing jobs

• The XML documents describing grid computing jobs are passed to the Grid Resource Broker, which analyzes them and executes jobs in accordance with requirements included


Web Services Communication

HPC PortalGrid

Service Provider

DataManagement System

GridResource Broker

saveJob()getApplications()getTemplates()saveTaskOfJob()saveStdOfTask()submitJob()getUserJobs()getJobStatus()

listUserDirectory()addUserFile()

getUserFileLocation()

submitJob() changeTaskStatus()


Authentication & authorization

• Utilize the services available within the Sun One Portal Server 6.0 package: authentication techniques, user database, portlet access control, identity server

• Authorization system for the Grid Service Provider and the Data Management System: based on the RAD model

• Apply a Single Sign-On mechanism


Authorization scheme

Porta

l

GRID SERVICEPROVIDER

Identity serverRAD based

authorizationsystem

Logon

Authentication

Request

Method invocation

Token validation

Resource access

authorization


Other PROGRESS modules

• User interfaces– Web Portal: grid job management, application

management, provider management, short news reading and editing, DMS file system management

– Migrating Desktop: grid job management and DMS file system management

• Grid Resource Broker: enables the execution of PROGRESS grid jobs in the PROGRESS grid; uses the XRSL language for grid job descriptions

• Data Management System: storing the input and output files, metadata, multiple media data containers


Visualization of job results


PROGRESS HPC Portal


SC2002 Demo


PROGRESS future

• R&D finished within the project, test and deployment phase now

• With the Grid Service Provider:– numerous thematic scientific portals possible to deploy

(PROGRESS HPC Portal is a bioinformatic portal)– users may be provided with resources belonging to two

or more grids – the Grid Service Provider may be equipped with means of communicating with multiple grids

• PROGRESS HPC Portal contents: adding new applications, adding new visualization applets, bioinformatic society building


PROGRESS

http://progress.psnc.pl/

http://progress.psnc.pl/portal/

http://www.psnc.pl/

[email protected]

Documents

The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th