NorduGrid Architecture and tools CHEP2003 – UCSD Anders Wäänänen waananen@nbi.dkwaananen@nbi.dk

NorduGrid Architecture and tools

CHEP2003 – UCSD

Anders Wäänänen waananen@nbi.dk

2Anders Wäänänen

NorduGrid Architecture

NorduGrid project

Launched in spring of 2001, with the aim of creating a Grid infrastructure in the Nordic countries.

Idea to have a Monarch architecture with a Nordic tier 1 center

Partners from Denmark, Norway, Sweden, and Finland

Initially meant to be the Nordic branch of the EU DataGrid (EDG) project

3 full-time researchers with few externally funded

3Anders Wäänänen

Motivations

NorduGrid was initially meant to be a pure deployment project

One goal was to have the ATLAS data challenge run by May 2002

Should be based on the the Globus Toolkit™

Available Grid middleware: The Globus Toolkit™

A toolbox – not a complete solution

European DataGrid software Not mature in the beginning of 2002 Architecture problems

4Anders Wäänänen

Architecture requirements

No single point of failure

Should be scalable

Resource owners should have full control over their resources

As few site requirements as possible: Local cluster installation details should not be dictated

Method, OS version, configuration, etc…

Compute nodes should not be required to be on the public network

Clusters need not be dedicated to the Grid

6Anders Wäänänen

NorduGrid components

Grid Manager – Mange Grid jobs in cluster Job control and data management

Information system Patched Globus MDS with improved schema

User interface Job submission and personal broker

Grid monitor Web based interface to information system

Globus replica catalog

7Anders Wäänänen

Grid manager features 1

Staging of executables and input/output data

Supported protocols: Local files, gridftp, ftp, http(s), Replica Catalog, Replica Location

Services

Data transfer control including retries

Caching of input data Cache size control Private (per UNIX user) and shared caches Data access control based on user’s credentials

Support for runtime environment (eg. Software installations)

Full job information available for auditing, accounting and debugging

8Anders Wäänänen

Grid manager features 2

Globus building blocks used GridFTP – fast, reliable and secure data access

GASS transfer – http(s) like data access protocol

Replica catalog

Replica Location Service (with EDG)

RSL – expandable Resource Specification Language

Limitations Data handling is currently only supported at job start and job

end when cluster nodes are on a private network

9Anders Wäänänen

Grid Manager architecture

CacheJob sessiondirectory

Link or copy

submission

stagein

stageout

NorduGridgridftp server

downloaderGrid

Manageruploader

File access

Job control

Job sessiondirectory

Computingnode

Frontend

10Anders Wäänänen

User interface

The NorduGrid user interface provides a set of commands for interacting with the grid

ngsub – for submitting jobs ngstat – for states of jobs and clusters ngcat – to see stdout/stderr of running jobs ngget – to retrieve the results from finished jobs ngkill – to kill running jobs ngclean – to delete finished jobs from the system ngcopy – to copy files to, from and between file servers and replica

catalogs ngremove – to delete files from file servers and RC’s

Information system

The nerve system of the Grid - information is a critical resource!

Complications: Large number of resource -> scalability

Heterogeneous resources -> characterization

Decentralized

Efficient access to dynamic data

Quality and reliability of information

Compromise between: Up to date data vs. load on the Grid

NorduGrid information system

Use Globus MDS

Improved schemas with natural representation of resources: Clusters (queues, jobs and users)

Storage elements

Replica Catalogs

Use efficient providers

Each resource runs a GRIS

GRIS’s are organized into a dynamic country based GIIS hierarchy.

Have enough information to do brokering

DIT of a cluster

cluster

jobs users

job-01 job-02 job-03 user-01 user-02queue

jobs users

job-04 job-05 user-02 user-03user-01

Cluster entry

DIT of a cluster

cluster

jobs users

Queue entry

DIT of a cluster

cluster

jobs users

Job entry

job status monitoring = information system query

Another job entry

- the job entry is generated on the execution cluster- when the job is completed and the results are retrieved the job disappears from the information system

DIT of a cluster

cluster

jobs users

Personalized information

user based information is essential on the Grid:

users are not really interested in the total number of cpus of a cluster, but how many of those are available for them!

number of queuing jobs are irrelevant if the submission gets immediately executed

instead of total disk space the user's quota is interesting

nordugrid-authuser objectclass freecpus

diskspace

queuelength

User entry

GIIS Hierarchy

Hierarchy of GRISes/GIISes

Grid Montior

Brokering & job submission

● Searches through the NorduGrid Testbed for available clusters

● Loops through all the clusters and selects those queues (possible targets) where:● The user is authorized to run

● Job requirements can be satisfied

● Selects a job destination from the matching targets – Randomly selects among the free resources (where user-

freecpus>0)

– In case there are no free matching resources some of the “load” attributes (i.e. user-queuelength) are taken into account

NorduGrid job submission

MDSGrid

Manager

GatekeeperGridFTP

Quick client installation/job run

As a normal user: retrieve nordugrid-standalone-0.3.17.rh72.i386.tgz

tar xfz nordugrid-standalone-0.3.17.rh72.i386.tgz

cd nordugrid-standalone-0.3.17

source ./setup.sh

Maybe get a certificate

grid-cert-request

install certificate per instructions

grid-proxy-init

ngsub '&(executable=/bin/echo)(arguments="Hello World")‘

Future development or integration

Better Authorization

Accounting

Optimize brokering

More intelligent data management and replication service

Handle network requests from running jobs on “private” networks

Grid portal interface – in testing

Move towards Grid services and improved community compatibility

Future

The committee of Nordic natural science ministers NOS-N has decided to fund a new common Nordic Grid Project based on the work done by the NorduGrid project. This project should work on a proposal/recommendation for a Nordic DataGrid facility.

Support for the toolkit in the future

This will be supported in each country by local Grid initiatives

Collaboration with the Nordic computing centers have already been initiated with the deployment of the toolkit on several large centers.

Use it for future ATLAS production in the Nordic countries

Move towards OGSA and better community compatibility

Resources

Documentation and source code are available for download

Main Web site: http://www.nordugrid.org/

Repository ftp://ftp.nordugrid.org/pub/nordugrid/

The NorduGrid core group

Александр Константинов

Balázs Kónya

Mattias Ellert

Оксана Смирнова

Jakob Langgaard Nielsen

Trond Myklebust

Anders Wäänänen

NorduGrid Architecture and tools CHEP2003 – UCSD Anders Wäänänen waananen@nbi.dkwaananen@nbi.dk

Documents

The Grid Monitor - NorduGrid · The Grid Monitor Usage and installation manual Oxana Smirnova Abstract The LDAP-based ARC Grid Monitor is a Web client tool for the ARC Information

AS2018 11 04 BayesTheorem - nbi.dk · Frequentist problems... One of the reasons for Bayesian statistics, is the following problem for frequentist! Imagine that you observe 5 events

TESTBED0 Sites and Resources - NorduGrid · Web viewTN CR7 06 01 Rev. B Project N FP5RTD IST-2000-25182 Date : 11/05/01 CS-SI CNRS/IN2P3 INFN TESTBED RELEASE 0 Site list and resources

Innovative services and tools for NorduGrid (NGIn) Nordunet 2008, 11.04.08 Jon Kerr Nilsen e-mail: j.k.nilsen@fys.uio.no University of Oslo, Department

Electromechanical properties of biomembranes and nerves · E-mail: theimbu@nbi.dk Abstract. Lipid membranes are insulators and capacitors, which can be charged by an external electric

Improvements of Common Open Grid Standards to Increase High … · 2010. 1. 31. · Grids such as EGEE, DEISA, and NorduGrid, we illustrate how common open Grid standards (i.e. JSDL

Oslo Nordic Data Workshop, 27 February 2019€¦ · ARC: a data-centric overview Oslo Nordic Data Workshop, 27 February 2019 Balázs Kónya, Lund University NorduGrid Technical Coordinator

The NorduGrid Toolkit: Overview and architecture

Next Generation of Grid Services for the NorduGrid

Software Scalability Issues in Large Clusters CHEP2003 – San Diego March 24-28, 2003 A. Chan, R. Hogue, C. Hollowell, O. Rind, T. Throwe, T. Wlodek RHIC

Building a computational cluster managed by ARC NorduGrid Alexey N. Makarov MakarovAlexey@gmail.com Saint-Petersburg State University, Department of Physics

The NorduGrid Toolkit: Overview and architecture The 4 th NorduGrid Workshop November 11 th 2002, Uppsala Anders Wäänänen

CMS Michele Gulmini, CHEP2003, San Diego USA, March 2003 1 Run Control and Monitor System for the CMS Experiment Michele Gulmini CERN/EP – INFN Legnaro

Dedicated to my Family - DiVA portal523474/... · 2012-05-21 · Presentation at NorduGrid Conference, Sundvolden, 2011. Extension of Chelonia Storage System to handle databases

Last update: 02/06/2015 23:05 LCG les robertson - cern-it 1 The LHC Computing Grid Project Preparing for LHC Data Analysis NorduGrid Workshop Stockholm,

System Administrator Guide - NorduGrid · System Administrator Guide F. Paganelli, Zs. Nagy, ... 5.3 Administration tools ... 6.14.2 Extensions to OGSA BES interface

The NorduGrid Project

The NorduGrid Project Oxana Smirnova Lund University November 3, 2003, Košice

Innovative services and tools for NorduGrid (NGIn) Nordunet 2008, 11.04.08 Jon Kerr Nilsen e-mail: j.k.nilsen[at]fys.uio.no University of Oslo, Department

Documentation of ARC1 Python API - NorduGrid