Condor-G: An Update

Jaime FreyComputer Sciences DepartmentUniversity of Wisconsin-Madison

[email protected]://www.cs.wisc.edu/condor

Condor-G:An Update

www.cs.wisc.edu/condor

Outline

› What is Condor-G

› Past

› Present

› Future


What Is Condor-G

› Use Condor to run jobs on the Grid› Uses Globus Toolkit

GRAM (submit a remote job) GASS (transfer job’s files)

› Two components Globus Universe GlideIn


Globus Universe

› Run a job on a Grid resource

› Features Job management Fault tolerance Credential management

› Disadvantages No remote syscalls, checkpoint/migration, or

dynamic resource selection


How It Works

ScheddSchedd

LSFLSF

Condor-G Grid Resource


How It Works

ScheddSchedd

LSFLSF


600 Globusjobs


How It Works

ScheddSchedd

LSFLSF


GridManagerGridManager

600 Globusjobs


How It Works

ScheddSchedd JobManagerJobManager

LSFLSF



600 Globusjobs


How It Works


LSFLSF

User JobUser Job



600 Globusjobs


GlideIn

› Create your own personal Condor pool from temporarily-acquired Grid resources

› Brings the full power of Condor to the Grid

› Run a Condor startd on a Grid resource

› Startd reports back to your machine and runs Vanilla and Standard Universe jobs


How It Works

ScheddSchedd

LSFLSF

CollectorCollector

Condor-G

600 Condorjobs

Grid Resource


How It Works

ScheddSchedd

LSFLSF

CollectorCollector

600 Condorjobs

glide-ins



How It Works

ScheddSchedd

LSFLSF

CollectorCollector


600 Condorjobs

glide-ins



How It Works


LSFLSF

CollectorCollector


600 Condorjobs

glide-ins



How It Works


LSFLSF

StartdStartd

CollectorCollector


600 Condorjobs

glide-ins



How It Works


LSFLSF

StartdStartd

CollectorCollector


600 Condorjobs

glide-ins



How It Works


LSFLSF

User JobUser Job

StartdStartd

CollectorCollector

Grid Resource


600 Condorjobs

glide-ins

Condor-G


Globus Grid

PBS LSF

Condor

Condor-G


Globus Grid

PBS LSF

Condor

600 Condorjobs

Condor-G


Condor-G

Globus Grid

PBS LSF

Condor

600 Condorjobs


Condor-G

Globus Grid

PBS LSF

Condor glide-ins

600 Condorjobs


Condor-G

Globus Grid

PBS LSF

Condor glide-ins

600 Condorjobs


Condor-G

Globus Grid

PBS LSF

Condor glide-ins

600 Condorjobs


Condor-G

Globus Grid

PBS LSF

Condor glide-ins

600 Condorjobs


Past

› GridManager daemon Runs Grid jobs using GRAM protocol Stages executable and standard I/O using

GASS protocol

› Globus GRAM 1.5 We added fault-tolerance to the GRAM

protocol Changes included in Globus Toolkit 2.0

release


Present

› Updated Condor-G to Globus Toolkit 2.0

› Enhanced GridManager

› GAHP


Enhanced GridManager

› Put problem jobs on hold

› No more stuck jobs

› Increase concurrency with GAHP

› Almost ready


Single-Threaded Execution

GridManager Grid Resource

Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4




Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4


Multi-Threaded Execution


Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4


Multi-Threaded Execution


Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4


Globus Application Helper Protocol (GAHP)› Condor is non-threaded

› Want to use multi-threaded libraries Increased concurrency

› Put libraries in external helper process

› Simple interface over pipes/sockets


Multi-Threaded Execution with GAHP


Grid Resource

Grid Resource

Grid Resource

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4



GridManager

GAHP Client

Grid Resource

Grid Resource

Grid Resource

Grid Resource

GAHP Server

Job 1

Job 2

Job 3

Job 4


Future

› GRAM 1.6

› Condor-G on Windows

› Condor-G Grid service


Globus GRAM 1.6

› Working with Globus team to add additional features to GRAM protocol Credential refresh File staging Scheduler-specific options


Condor-G for Windows

› Condor Windows implementation available

› GRAM and GASS APIs No C implementation for Windows (yet) Java implementation (Java CoG)

› Condor-G Windows version possible by writing GAHP

server in Java


Condor-G Grid Service

› Reliable job submission service for higher-lever applications

› Open Grid Services Architecture (OGSA)

› SOAP, WSDL, WS-Inspection› Implement Grid service interface for

Condor-G (and Condor in general)


Thank You

› Condor-G demo on Wednesday 3351 CS

› Questions? Talk to me E-mail [email protected]

Documents

Condor-G: An Update