12
11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting 1 GRID Globus Installation Toolkit Zhen Xie On behalf of grid- release team INFN-Pisa

GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

Embed Size (px)

Citation preview

Page 1: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

1

GRID 

Globus Installation Toolkit

Zhen Xie

On behalf of grid-release team INFN-Pisa

Page 2: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

2

GRID Overview

• Goal

• Design and implementation

• Features and evaluation of the current release

• Features forseen for the next release

• Documentations

• Report from U.S. by F.Donno currently working with Globus repackaging taskforce

• Open questions for the community

Page 3: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

3

GRID Goal

Reduce time and manpower for installation and configuration of Globus

• Automize and Standardize the installation of the Globus Toolkit and related packages

• Automize the Globus setup procedure

• Collect and apply bug fixes that are not included in the current version of Globus

Page 4: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

4

GRID Design and implementation

• We distribute the precompiled Globus and related packages together with tools for automatic installation and configuration.

• The toolkit includes two major scripts written in bash: one for installation and the other for the system configuration.

• Modularized design makes standard and specific installation and configuration separate.

Page 5: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

5

GRID Features of the Current Release

INFNGRID1.2• Automatic installation and configuration of precompiled

Globus and related grid packages

• New Bug fixes provided by INFN&Globus team are included

• Support setup both with INFN CA and Globus CA

• Support INFN GIS architecture

• Support CONDOR,LSF and PBS as job scheduler

• Include installation instructions for special enviroments (configuration of client machines, shared install-directory)

Page 6: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

6

GRID 

=============================

(1) modify system files and reactivate the inetd daemon

(2) change owner to root of certain files for tighter security

(3) modify system wide login files

(4) start/restart Globus now

(5) configure gsi-wuftpd and restart the inetd daemon

(6) configure gdmp and start the gdmp_server

=============================

(q) Quit

(h) Help

=============================

=================================

(1) Copy INFNGRID tar files from /afs/infn.it/project/infngrid/1.2/Linux to download dir

(2) Decompress and untar INFNGRID distribution files in install dir

(3) Configure INFNGRID software

(4) Globus Setup

(5) Configure GRAM services

(6) Globus local deploy

(7) GIIS Configuration

(8) GDMP Installation

=================================

(q) Quit

(h) Help

=================================

Installation script menu System setup script menu

CMS specific

CMS specificINFN specific

Page 7: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

7

GRID Evaluation of the Current Release

• Tested at several INFN sites, CERN and FNAL, ITEP

• Tested on RH Linux 6.1, Sun Solaris 2.6

• Tested for the INFN setup (at INFN sites) and the standard setup (at other sites)

• Reduce complexity and manpower for installation and configuration (5min vs.~1h)

• Problem with machine with alias (we plan to solve it soon)

Page 8: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

8

GRID Documentations

• Contact address: [email protected]

• On-line manual: http://www.pi.infn.it/grid

• Download site: /afs/infn.it/project/infngrid (please read manual before downloading)

• URL: http://www.infn.it/grid/dist.html should be open to all users very soon Registration required for downloading.

Page 9: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

9

GRID Features forseen for the next release

INFNGRID1.3• Fixes for Globus jobmanager memory leaks • Fix to support the -publish-user option in the

globus_services.conf • Support for Solaris 7 • Full support for GDMP v1.1 with the latest patches • Distribution of various Globus flavored

compilations (Kerberos,AFS,MPICH) • Distribution of the INFN CA Certificate

Revocation List and grid-mapfile management tools

Page 10: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

10

GRID Report by F.Donno from U.S.(1)

• Globus is forseen to be divided into small packages each of which rebuildable by standard code management tools . (Project to be approved)

• A tool for automatic installation and service configuration is NOT forseen by Globus.

• The INFN Globus installation toolkit is important for providing configuration and service definition to the Globus repackaging project.

Page 11: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

11

GRID Report by F.Donno from U.S.(2)

• The INFN toolkit remains independent from the Globus project but could be accepted by Globus as an official tool of installation and autoconfiguration of Globus.

• If the Globus repackaging project will be approved, future release of INFNGRID will be built on the new structure of Globus.

• Well organised testbeds for the test of Globus and compilation of software on different platforms are welcome.

Page 12: GRID 11-12-00Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa

11-12-00 Zhen Xie , INFN-Pisa , on DataGrid WP6 meeting

12

GRID 

Open questions for the community

• Should a working frame be defined for the code development? Define common rules for build, for using compilers and libraries….

• Should we have a limitation of platforms for the EU testbeds?

• Token passing problems with jobmanager installed on AFS…

• Exchange patches with other institutes…