PEPC 2003, Geneva, 24-25.04.2003, PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Poland Cezary Mazurek

PEPC 2003,PEPC 2003,Geneva, 24-25.04.2003,Geneva, 24-25.04.2003,

PROGRESSPROGRESSComputing PortalComputing Portal

Poznań Supercomputing and Networking Center (PSNC)Poznań Supercomputing and Networking Center (PSNC) PolandPoland

Cezary MazurekCezary Mazurek


PSNC ActivityPSNC Activity

Operator of the Polish National Research and Education Network POL-34/622

Operator of the Poznań Metropolitan Area Network POZMAN

HPC Center Systems and Network Security Center R&D Center for New Generation

Networks, Grids and Portals


PIONIER National ProgrammePIONIER National Programme

GRID-enabled Applications

Co

mm

un

icatio

nA

pp

lication

Geo

grap

hical

info

rmatio

nap

plicatio

ns

En

viron

men

tM

anag

emen

tA

pp

lication

Distan

ce L

earnin

gA

pp

lication

Intern

et A

ccessA

ided

L

earnin

gA

pp

lication

Co

mp

utatio

na

lS

cience

Ap

plicatio

n

Advanced Network Services (Middleware)

Optical Network

Advanced Research Specialized Infrastructure


PIONIER NetworkPIONIER Network


PIONIER ProjectsPIONIER Projects

PROGRESSAccess environment to computational services performed by

cluster of SUNs iTV

System for providing an audio-visual stream over Polish Optical Internet enabling the interactive television

LDAP Deployment of LDAP Protocol in the National Research

and Education Network POL-34/622 VLAB

High Performance Computing and Visualisation for Virtual Laboratory Applications


PROGRESSPROGRESS

Duration: December 2001 – May 2003 Deployment: June 2003-December 2003 Project Partners

SUN Microsystems PolandPSNC IBCh PoznańCyfronet AMM, KrakówTechnical University Łódź

Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland


PROGRESSPROGRESS

Project is testbed oriented Three bioX applications will be enabled within

the grid-portal architectureTwo of them are already available

Distributed cluster of SF6800 is a pilot testbed installationDedicated channels through PIONIER network (1 Gb/s)

will come in the 3Q2003 Tools and services for grid processing and data

management in PROGRESS grid-portal framework


PROGRESS PROGRESS ArchitectureArchitecture


PROGRESS PROGRESS CommunicationCommunication

SGESGE

HTTP/HTTPSHTTP/HTTPS

DataManagement

GLOBUSGLOBUS

Po

rtal

GridBroker W

ebse

rvic

eFT

P

HTTP/HTTPS

Service Provider

Grid F

TP

Webservice


PROGRESSPROGRESS

Pilot installation Poznan-Krakow3 SUN Fire 6800

• Poznań: SUN Fire Link

2 Data ServersFront-end for portal access

Distributed processing in distributed framework


PROGRESS TestbedPROGRESS Testbed

PROGRESSGRID

PROGRESSGRID

Kraków

PIONIERPoznań

2xSF6800

SF6800

SFV880

SFV880

SF280R Łódź2xSE420


PROGRESS testbedPROGRESS testbed

POZNAŃ KRAKÓWFrontend

Computing

Datamanagement

Data storage

Portal Server

SGE EE

HPC Cluster Tools

Globus

Aplication Server

Certification Server

Oracle

SRS

Database

SRS

Database

Aplication Server

Certification Server

Oracle

SGE EE

HPC Cluster Tools

Globus


PROGRESS testbedPROGRESS testbed

Fibre Channel

1Gb/s Ethernet

SF 6800

SF V880

SF 280R

SB 1000 SE T3/T3+

Management

FastEthernet


PROGRESS – BioX ApplicationsPROGRESS – BioX Applications

DNA Assembly BranchBound1 DNA Assembly Heuristic2 DNA Assembly Heuristic3 Prediction of protein secondary structure - module A1 Prediction of protein secondary structure - module A2 Prediction of protein secondary structure - module B Prediction of protein secondary structure - module C Prediction of protein secondary structure - module D

Logical workflow applications:• LAD – learning: A1->B->C• LAD – testing: A2->D


PROGRESS PROGRESS ArchitectureArchitecture


PROGRESS HPC WindowPROGRESS HPC Window

GRID user interfaces are independent of the information processing layer bioX computational portalMigrating Desktop application

The PROGRESS HPC Portal is the user interface for the PROGRESS grid access environment


PROGRESSPROGRESS

4 – tier architecture for grid-portal environment


PROGRESS Service ProviderPROGRESS Service Provider


PROGRESSPROGRESS

Content P

rovider

Webservice

Session B

ean

Entity B

eans

SOAP

SOAP/XML

ComputingPortal

GRID Service Provider

Content ProviderData presentationUser interaction

Service ProviderRealization of

services functionsServices data storage

and access


PROGRESS PortalPROGRESS Portal

PROGRESS computational portal Accessing applications collected in the application factory Forming and running jobs Accessing data stored in the Data Management System Providing information services

The PROGRESS Portal is equipped with 5 portlets (content providers) interacting with the user on behalf of PROGRESS services. These portlets are: My jobs My data News Applications Management


PROGRESS Grid servicesPROGRESS Grid services

Job submission service creating, building, submitting, monitoring execution and analyzing results of

grid jobs (“My jobs” portlet) Application management service

adding and configuring applications in the GSP application factory (“Applications” portlet); “virtual application” management under development

Provider management service keeping up-to-date information on services available in the grid service

provider (“Management” portlet) Informational services

news service – reading short messages illustrated with web links (“News” portlet); multiple instances; other informational services under development – “Discussion”, “Links” portlets)

Data management uploading and downloading files, file system tree management (“My data”

portlet)


Web services communicationWeb services communication

HPC PortalGrid

Service Provider

DataManagement System

GridResource Broker

saveJob()getApplications()saveTaskOfJob()saveStdOfTask()submitJob()getUserJobs()getJobStatus()

listUserDirectory()addUserFile()

getUserFileLocation()

submitJob() changeJobStatus()


Authentication and access Authentication and access controlcontrol

Authentication: username+password, LDAP based user database

Authorization - 2 levels:portlet access control – performed by the portal

frameworkgrid services authorization – RAD based

authorization moduleSingle Sign-On – enabled by the identity

server


Authentication, authorization Authentication, authorization and SSO in PROGRESSand SSO in PROGRESS

Po

rtal Grid service

provider

Identification

serverRAD

Logon

Authentication

Request

Method invocation

Token validation

Authorization

of resource access


PROGRESS Grid brokerPROGRESS Grid broker

Grid Broker in Progress:Job submission, monitoring and controllingDifferent scheduling and resource

management strategiesFlexible job description language (XRSL)Heterogeneous and service based

environment


PROGRESS Grid BrokerPROGRESS Grid Broker


Grid brokerGrid broker

Resources

Resources & Resources & Services Services BrokerBroker

Globus

SGE

InformationSystem

(GIS)

ResourcesMonitoring

Portal+ request description XRSL

(XML/RSL)


PROGRESSPROGRESSData Management SystemData Management System

Provides seamless access to data and information for grid computing

Uses metadata repository for describing stored data

Stores data on various media such as files, tapes and databases


PROGRESS PROGRESS Data Management SystemData Management System

INTERNET

DBFile System

Data Broker

Data Storage

Mirror & Proxy

Data Storage Data Storage

MetadataManagement

SRS

UniTree

WS

GASSFTPGrid FTP(...)

Clients

PortalPortal

Grid brokerGrid broker

Migrating desktop

Migrating desktop


PROGRESS SecurityPROGRESS Security

Intrusion Detection System (IDS)Advanced security mechanisms that are destined to

detect, possibly in real time, unauthorized security attempts, security breaches and attacks.

One of the tasks realized in the PROGRESS project is VALKYRIE IDS for Solaris operating system.

VALKYRIE IDS:• is a host based system,

• passively monitors protected infrastructure,

• uses misuse detection approach for analysis,

• works continuously.


VALKYRIE IDSVALKYRIE IDS

Module for monitoring operating system events (kernel level module)

Expert system module for analyzing system events stream and for attack detection

GUI console for system operator


PROGRESS SecurityPROGRESS Security

Oracle

IPLANET

Solaris globus

grid engineSCM

Expert System Module

GUI

Portal protection

PCSS

Firewall System


PROGRESS Migrating DesktopPROGRESS Migrating Desktop

Alternative user interface to GRID resources;

Layout analogous to „windows based” operating systems GUI, like e.g. Windows, KDE, Gnome, etc. – can be more intuitive for some users;

Possibility of working with different grid projects (integrated also with CrossGRID project co-funded by EU);


Migrating Desktop FunctionalityMigrating Desktop Functionality

Graphic User Interface (GUI) management; User profile management; File transfer management; Job configuration and submition; Job execution monitoring; Handling links to local files and applications; Handling links to remote files;


Migrating Desktop – main windowMigrating Desktop – main window


PROGRESSPROGRESS

PROGRESS at Supercomputing 2002, Baltimore, USAPROGRESS at Supercomputing 2002, Baltimore, USA


PROGRESSPROGRESSPortalPortal


PROGRESS – job listPROGRESS – job list


PROGRESS – job menuPROGRESS – job menu


PROGRESS – job tasksPROGRESS – job tasks


PROGRESS – task requirementsPROGRESS – task requirements


PROGRESS – data managementPROGRESS – data management


PROGRESS – application PROGRESS – application factoryfactory


PROGRESS - newsPROGRESS - news


PROGRESSPROGRESS

ConclusionsThe PROGRESS project has provided

components and services for flexible grid-portal environment, which might be deployed in other projects and environments

PROGRESS team has been working on additional functionality for Solaris OS in the area of checkpointing and security


PROGRESS PROGRESS

Thank you !

http://progress.psnc.pl/http://progress.psnc.pl/portal

[email protected]

Documents

PEPC 2003, Geneva, 24-25.04.2003, PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Poland Cezary Mazurek