14
Scheduling Interactive Tasks in Scheduling Interactive Tasks in the Grid-based Systems the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking Conference 2005 June 6-9, 2005 Poznań, Poland

Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Embed Size (px)

Citation preview

Page 1: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Scheduling Interactive Tasks in Scheduling Interactive Tasks in the Grid-based Systemsthe Grid-based Systems

M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa,T. Rajtar, D. Kaliszan, M. Stroiński

TERENA Networking Conference 2005

June 6-9, 2005Poznań, Poland

Page 2: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Chosen aspects of interactive tasks scheduling

• Online user presence at the time of task execution

• Device operator presence in case of scientific experiments

• Resource availability (maintenance, etc.)

• Workload management and resource allocation

• Interactive connection to graphical user interface

• Tasks as elements of dynamic measurements scenarios

Page 3: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

• Remote access to complex and expensive laboratory research equipment

• User-customized Dynamic Measurement Scenarios

• Digital Science Library

• Data storage and management

• Educational potential

• Workgroup collaboration tools

Virtual Laboratory overview

The Virtual Laboratory is a distributed environment,providing its users with the following functionality:

Page 4: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

• definition of complex, multi-dimensional research experiment scenarios

• connection of experimental and computational jobs

• multiple conditions on jobs connections, determining the actual execution path

• description language for resources and connection dependencies

Dynamic Measurement Scenarios

Example of a simple measurement scenario

Preprocessing PostprocessingExperiment VisualisationData Results

Page 5: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Example of DMS diagram

Page 6: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Batch job scheduling

The Virtual Laboratory

Grid Environment

Data ManagementSystem

VLab

GridApplications

ScenariosManagement

Module

GRMS

Monitoring andDiscovery

Grid Gateway

Page 7: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Interactive tasks: Task submission

GRMS

VLabportal

SMM

Monitoring

GlobalScheduler

GridGateway

GAM

Accounting

1.

2.

3.

4.

5.

6a. 6b.

7.

7a.

1. Task is sent to SMM module

2. Task is added to the DB

3. Task sent to Global Scheduler

4. Grid authorization in GAM

5. Accounting verification

6b, 7. Task submitted to GRMS (via Gateway)

Page 8: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Interactive task: VNC session scheduling

1. GRMS checks with MDS for resources

2. GRMS verifies free slot for VNC session

3. GG is informed of status change (notification)

4. Task status updated in VLab DB

GRMS

Monitoring

GridGateway

1.2.

3.

4.

VNC Session DBMDS

Page 9: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Interactive tasks: Establishing a secure connection

1. GRMS launches scheduled task

GRMS

Monitoring GridGateway

1.

2.

3.4.

GridApplications

VNC Manager

PortalSVNC Viewer

VNC ManagerVNC Manager

VNC Manager

5.

2. GRMS sends notification to Gateway

3. VNC Manager sends task info

4. Gateway sends info to Vlab DB (Monitoring)

5. User launches SVNC viewer

Page 10: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Interactive tasks: Prolonging the VNC session

GRMS

Monitoring

GridGateway

1.2.

3.

4a.

5.VNC Session DB

Portal

GAM

Accounting

GlobalScheduler

6.

7.

8.

4b. 1. User request from portal

2. Verification with GAM

3. Accounting verification

4b,5. Request forwarded to GRMS

6. VNC session reservation

7,8. GRMS Answer forwarded and

updated in VLab DB

Page 11: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Interactive tasks: Ending the VNC session by the user

GRMS

Monitoring

GridGateway

1.

2.

3.

4.VNC Session DB

Portal

5.

6.

GridApplications

VNC ManagerVNC Manager

VNC ManagerVNC Manager

1,2. Request to end session forwarded to GRMS

3. End signal sent to VNC Manager

4. Update in the session DB

5,6. Task status updated in the VLab DB

Page 12: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

Interactive tasks: Ending the VNC session by the system

GRMS

Monitoring

GridGateway

1.2.

3.

4.

VNC Session DBGrid

Applications

VNC ManagerVNC Manager

VNC ManagerVNC Manager

1. GRMS sends end signal to VNC Manager

2. Update in the session DB

3,4. Task status updated in the VLab DB

Page 13: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

• Task submission

• VNC session scheduling

• Establishing secure connection

• Ending the VNC session

Summary

Invocation of user-interactive tasks can be divided intothe following main steps:

Scheduling of the interactive task creates new possibilities for a wide range of Grid-based systems.

Human factor as the main, non-deterministic elementinfluencing the whole process.

Page 14: Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking

http://vlab.psnc.pl/ e-mail:

Marcin Okoń: [email protected]

or: [email protected]