Condor and Distributed Computing

David Ríos

CSCI 6175Fall 2011

Why are we going to spend 25 minutes on Condor?

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

What is Condor?

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Who can benefit from Condor?

• Movie and Film Industry• Software Industry• Investment Brokerage Firms• Genome Research Firms• Engineering Firms• Electronics Design and Manufacturing• Anyone!

US Air Force

• March 2011• Cluster of 1,716

PS3s

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

High Throughput (Condor Strength)

Opportunistic Computing (Condor Strength)

Speed of Job Completion

Performance

Planning vs. Scheduling

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Flexibility

Let Communities Grow Naturally

Leave the owner in control, no matter what the cost

Plan Without Being Picky

Lend and Borrow

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Condor at Work

Basic Condor Pool

Condor Cluster Environment

Physical Condor Cluster

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Evolution of Condor

Condor-G

• The Globus Project• Interface for batch execution• GRAM protocol (Grid Resource Access

Management)

Archer

• Virtual Machine

• Condor is installed on VM

• Fast deployment

• Expertise not required

What we discussed today…

• Why Condor is important to you• What is Condor• Who can benefit from Condor• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor