Upload
aubrey-temple
View
214
Download
0
Tags:
Embed Size (px)
Citation preview
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Scientific Workflows
Kepler andJava API 4 HPC/GRID
ITM meeting Juelich 2009
Michał OwsiakMarcin Płóciennik
PSNC
Accessing tutorial machines
Training room 2 (GRID and HPC from KEPLER)
Participants: itmb1045 ... itmb1069PCs: zam1045-zam1069
The password for all accounts is: itm@fzj09
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Agenda
- Main components: Director, Actor, Port, Relation- Workflow building area- Different workflow types- Actor related details- Concept of composite actor- Java API 4 HPC/GRID
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
How can I build workflow?
Kepler allows you to build workflows using standard elements:
- Workflow- Director- Actor- Port- Relation
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing workflow
- Workflow allows to compose data flow between elements
- Elements can be Dragged and Dropped into Workflow's area
- After workflow is ready it can be started two ways:
• directly from the GUI• from the command line
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing workflow
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing Actors and Directors
- Available elements can be accessed through the component's browser
- Elements can be Dragged and Dropped into Workflow's area
- You can search for elements if you don't know theexact name of the component
- You can add your own components into library
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing Actors and Directors
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing Supplementary
Components
- Components that bind all elements together are accessible from toolbar
- Ports, relations, can be Dragged and Dropped into Workflow's area
- You can easily Start/Stop workflow directly from the GUI using toolbar icons
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing Supplementary
Components
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Main components
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Directors
Directors are responsible for the orchestrationof the workflow.
Directors can provide various means of execution:
- CT Director (Continuous Time)
- DDF Director (Dynamic Data flow)
- SDF Director (Sequential Data flow)
- PN Director (Process Network) - parallel executions
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Actors
Actors perform actions basing on input ports and parameters
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Actors
- You can use already existing actors that are available within Kepler
- You can import actors from the other sources into Kepler
- You can develop your own actors and add them to the Kepler
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Concept of composite actor
- Composite actors allow to encapsulate workflows
- Composite actors can be copy-pasted between workflows
- Composite actors can be exported as components
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Concept of composite actor
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Java API 4 HPC/GRID
Developed within EUFORIA projecthttp://www.euforia-project.eu
- One of the goals of the project is to provide users with convenient way of accessing HPC/GRID infrastructures using Kepler orchestration tool
- Java API 4 HPC/GRID is based on vine:toolkit
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
What is Java API 4 HPC/GRID
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
What Java API 4 HPC/GRID provides
Java API 4 HPC/GRID provides:
- set of actors that extends Kepler with HPC access
- set of actors that extends Kepler with GRID access
- already existing workflows that can be modified
- set of composite actors for faster workflow building
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Thank you for your attention
http://scilla.man.poznan.pl/IMTLulich2009
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804
Accessing tutorial machines
Training room 2 (GRID and HPC from KEPLER)
Participants: itmb1045 ... itmb1069PCs: zam1045-zam1069
The password for all accounts is: itm@fzj09
EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804