19
Introduction to the Grid N1™ Grid Engine 6 Software

Introduction to the Grid

Embed Size (px)

DESCRIPTION

Introduction to the Grid. N1™ Grid Engine 6 Software. Overview. A brief explanation of grid computing Grid examples How grid works? (grid as bank) Grid jobs A description of each important components. What Is Grid Computing?. Collection of computing resources that perform tasks - PowerPoint PPT Presentation

Citation preview

Introduction to the GridIntroduction to the GridN1™ Grid Engine 6 SoftwareN1™ Grid Engine 6 Software

Overview

A brief explanation of grid computing

Grid examplesHow grid works? (grid as bank)Grid jobsA description of each important

components

What Is Grid Computing?

Collection of computing resources that perform tasks

A large system that provides a single point of access to powerful distributed resources

Define the goal in more detail

Grid ExamplesGrid Examples

Chess960@homeVast collection of Chess960 games

Africa@homeAllow your computer to contribute to

African humanitarian causes. QMC@Home

Developing and testing Quantum Monte Carlo (QMC) for use in quantum chemistry.

FightAIDS@HomeSimulation techniques to search for ways to

cure or prevent the spread of AIDS and HIV.

Chess960@homeVast collection of Chess960 games

Africa@homeAllow your computer to contribute to

African humanitarian causes. QMC@Home

Developing and testing Quantum Monte Carlo (QMC) for use in quantum chemistry.

FightAIDS@HomeSimulation techniques to search for ways to

cure or prevent the spread of AIDS and HIV.

Grid ExamplesGrid Examples

Grid ExamplesGrid Examples

Shrek 2DreamWorksOperation Systems: Red Hat Linux

7.2330 Hewlett Packard workstationsDual-Intel Xeon 2.4GHz processors,

nVidia Quadro 4 XGL graphics cards, 2GB Ram and dual monitors

Recalculated frames make more detailed

Shrek 2DreamWorksOperation Systems: Red Hat Linux

7.2330 Hewlett Packard workstationsDual-Intel Xeon 2.4GHz processors,

nVidia Quadro 4 XGL graphics cards, 2GB Ram and dual monitors

Recalculated frames make more detailed

What is “N1 Grid Engine 6” software?

Sun’s Resource management software

Accepts jobs submitted by usersUses resource management policies

to schedule jobs to be run on appropriate

Users can submit millions of jobs at a time without concern

Grid jobsGrid jobs

Batch jobsShell scriptsSequence of command-linecsh, tcsh, sh, or ksh

Batch jobsShell scriptsSequence of command-linecsh, tcsh, sh, or ksh

Input Output

Process Process Process

Grid jobsGrid jobs

Interactive jobsRequire direct input to influence the

job results.

Interactive jobsRequire direct input to influence the

job results.

Input Output

Process Process

Grid jobsGrid jobs

Parallel jobs Parallel jobs

Input Output

Process

Process

Process

How grid works?How grid works?

1. Accepts jobs from the outside world.

2. Puts jobs in a holding area 3. Sends to an execution device.4. Manages running jobs.5. Logs the record of job execution.

1. Accepts jobs from the outside world.

2. Puts jobs in a holding area 3. Sends to an execution device.4. Manages running jobs.5. Logs the record of job execution.

How grid works? (grid as bank)

How grid works? (grid as bank)

On entering the bank: customers declares their name, their

affiliations their service needs Record entering time. Bank would serve the following

customers: Customers whose needs match suitable

and immediately available resources Customers whose requirements have the

highest priority Customers who were waiting in the lobby

for the longest time

On entering the bank: customers declares their name, their

affiliations their service needs Record entering time. Bank would serve the following

customers: Customers whose needs match suitable

and immediately available resources Customers whose requirements have the

highest priority Customers who were waiting in the lobby

for the longest time

How grid works? (grid as bank)

How grid works? (grid as bank)

One least-loaded and most-suitable bank employee helps several customers.

Bank manager, define service policies: Provide preferential service to commercial

customers Make sure a certain customer group is

served well Customers get a timely response Prefer a certain customer on direct

demand of a bank executive

One least-loaded and most-suitable bank employee helps several customers.

Bank manager, define service policies: Provide preferential service to commercial

customers Make sure a certain customer group is

served well Customers get a timely response Prefer a certain customer on direct

demand of a bank executive

Jobs and QueuesJobs and Queues

Jobs correspond to bank customers.

Jobs wait in a computer holding area instead of a lobby. queues, which provide services for jobs, correspond to bank employees.

Jobs correspond to bank customers.

Jobs wait in a computer holding area instead of a lobby. queues, which provide services for jobs, correspond to bank employees.

3 classes of Grid

Usage PoliciesUsage Policies

Urgency Resource requirements, job’s deadline, job

waits. Functional

Job’s affiliation with a certain user group, project.

Share-based Usage of resources by all users.

Override Manual intervention by the cluster administrator

Combination 90% share-based and 10% functional

Urgency Resource requirements, job’s deadline, job

waits. Functional

Job’s affiliation with a certain user group, project.

Share-based Usage of resources by all users.

Override Manual intervention by the cluster administrator

Combination 90% share-based and 10% functional

Using Tickets to Administer Policies

Using Tickets to Administer Policies

Functional, share-based, and override policies are defined through tickets.

Tickets = Company’s stock.More stock = More important

Functional, share-based, and override policies are defined through tickets.

Tickets = Company’s stock.More stock = More important

Grid Engine System Components

Grid Engine System Components

Hosts Master host Execution hosts Administration hosts Submit hosts

Daemons sge_qmaster – the Master Daemon sge_schedd – the Scheduler Daemon sge_execd – the Execution Daemon

Queues

Hosts Master host Execution hosts Administration hosts Submit hosts

Daemons sge_qmaster – the Master Daemon sge_schedd – the Scheduler Daemon sge_execd – the Execution Daemon

Queues

Questions?Questions?

November 2006Pedram [email protected]

November 2006Pedram [email protected]