14
Grid-Ireland:The National Computational Grid for I Grid use in Ireland Infrastructur e and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway Architecture HEAnet & HEC Gateways EGEE/LCG2 Status Dissemination Network Topology Users & Use TestGrid Porting & Autobuild Heterogeneity & Benchmarks

Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Embed Size (px)

Citation preview

Page 1: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

Page 2: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

Infrastructure and

OpsCentre •Currently 6 sites and OpsCentre

• DIAS, NUIG, TCD, UCC, UCD, QUB

•More sites in 2005 (MiniGateWays)

•VOs: CosmoGrid, MarineGrid, TestGrid, Webcom-G, EGEE/LCG

•National Services and helpdesk at TCD

Page 3: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

MiniGateway Rollout

•Donated by DELL Ireland

•Dell 1750

•2GB Ram

•SCSI (2 x 160 GB)

•Extending Grid access to additional third level institutions

•Rollout started Jan’05

•Sites chosen by competitive survey

Page 4: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

MiniGateway Architecture

•Based on Xen Linux Kernel

•Six virtual machines on one physical computer

•Minimises (hardware) cost associated with joining the Grid

•Out performs UserMode-Linux by a factor of 10

Page 5: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

HEAnet & HEC Gateways

•Catch-all Gateway proposed to function as access point for Government institutions (GSI, Met Eireann, Marine Institute, ....)

•HEC Gateway to provide access to the recently announced High Performance Computing Centre - 1000+ CPUs.

•will connect to DIAS and NUIG CosmoGrid

clusters

Page 6: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

EGEE/LCG2 Status

csTCDie connected to LCG-2 since Oct’04

Page 7: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

EGEE/LCG2 direction

•This is not without it’s problems

•csTCDie on LCG2 and Grid-Ireland, no Multi VO

support in R-GMA, but expected later.

•Grid-Ireland has helped enhance software

•Routing Queue, Heterogeneity - Fedora, IRIX,

AIX

• Info-Provider problems, accounting(?)

•Transition to Quattor/SL3

•Still yet an unknown, test on TestGrid

Page 8: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

Users & Use

•Mostly MPI application developers

•MPI installed on sites using INFN Howto

•110 (x2) CPU goes live at UCD - Feb 7th

•2 GB RAM per processor

•Intel EM64T, 3.2 GHz CPU - RH EL 3.0

•Routing Queue connection to Grid-Ireland

Page 9: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

A J-band extinction map showing the Chameleon dark clouds extracted from our map created using the Grid-enabled program

- G Murphy, D Froebrich, J Walsh (2005).

A J-band extinction map showing the Chameleon dark clouds extracted from our map created using the Grid-enabled program

- G Murphy, D Froebrich, J Walsh (2005).

Users & Use

Page 10: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

Network Topology

TCDGrid-Ireland

Gateway (x3)

Grid-IrelandNational

Servers (x16)

SharedCluster

(16 CPUs)

SharedCluster

(16 CPUs)

SoloVOCluster

(16 CPUs)

Internet

TCD Router

Dept. Router

Firewall

Switch

RAID 1

RAID 2

RAID 3

TestGrid(x36)

CrossGridTestbed

(32 CPUs)

Firewall

csTCDie Site

Page 11: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

TestGrid

•Multifaceted Testbed

•Validating latest software release

•Testing experimental middleware

•Porting to non-reference platforms

• Implements multiple sites

•Replicates setup of some sites

•Special router - layer II filtering

Page 12: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

•LCG officially only supports RH7.3 and Scientific Linux

•Porting has involved many man-months

effort

•Ports for Fedora, IRIX, AIX

•Now working on Mac OSX

•Localised Autobuild system - rebuilds nightly

•Local software - SANTA-GPorting & Autobuild

Page 13: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & BenchmarksHeterogeneity & Benchmarks

•Grid is ideologically heterogeneous

•Means for reliably measuring Grid Performance

•Tests Grid resources at different levels - WN level, Cluster level, …

•Collaboration with University of Cyprus

•11separate tests

Page 14: Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway

Grid-Ireland:The National Computational Grid for Ireland

Grid use in IrelandInfrastructure

and OpsCentre

EGEE/LCG2direction

MiniGateway Rollout

MiniGateway Architecture

HEAnet & HEC Gateways

EGEE/LCG2Status

Dissemination

Network Topology

Users & Use

TestGrid

Porting & Autobuild

Heterogeneity & Benchmarks

Dissemination

•Workshop for grid sysadmins:

•September 20th

-22nd

•2-day introduction to LCG2

•1-day technical discussions

•First User’s course (Dec 9th & 10th)

•User Project provided template for writing Grid-enabled application (non MPI).

•Second User’s course (Jan 21st)

• focus on quick start introduction to Grid