Migration of a computation cluster to Debian

Julien Cristau

julien.cristau@logilab.fr

November 25th, 2012

Mini-Debconf Paris 2012

Outline

Context

Hardware

Existing software

Solution

0/5

Context

Institut de Genetique et Microbiologie (IGM):

I joint lab, CNRS & Universite Paris Sud

I cluster part of the eBio platform, providing resources forscientists

Logilab:

I software services

I python specialist, Debian-based

I scientific computing / simulation

1/5

Hardware

Existing:

I 10 compute nodes

I 1 frontend

I 1 separate assembly node(lots of RAM and storage)

I 24-port 1Gb ethernetswitch

New:

I 2 hosts for virtualizationand storage

I 2 more storage bays

2/5

Existing software

I Based on RHEL5

I Sun Grid Engine (SGE) batch scheduler

I No shared storage

I No central management

3/5

Solution

SAS

SAS

SAS

WEBGalaxyGanglia/Munin

MasterCondor/OAR/SGE

StorageNFSZFS

Provision.DHCP/tFTP/PXE/FAISalt

SA

N

AD

MIN

CLUSTER

KVM hostPub

lic n

etw

ork

SAS

SAS

Compute Node

Compute Node

Compute Node

Compute Node

Compute Node*for BLAST assembly

4/5

Solution (2)

I One storage node using ZFS on Linux

I VM hosts for all services: provisioning, monitoring, frontend(submission host), databases, web server, . . .

I Nodes reinstalled with FAI(http://www.fai-project.org/)

I Configuration/deployment with Salt(http://www.saltstack.org/)

5/5