13
EGEE is funded by the European Union under contract IST-2003- 508833 Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided by the Grid

Elena Slabospitskaya IHEP NA3 manager for Russia

Embed Size (px)

DESCRIPTION

Elena Slabospitskaya IHEP NA3 manager for Russia. An inroduction to services provided by the Grid. EGEE is funded by the European Union under contract IST-2003-508833. Sources of the information. LCG-2 User Guide https://edms.cern.ch/file/454439//LCG-2-UserGuide.html LCG Releases - PowerPoint PPT Presentation

Citation preview

Page 1: Elena Slabospitskaya IHEP NA3 manager for Russia

EGEE is funded by the European Union under contract IST-2003-508833

Elena SlabospitskayaIHEP

NA3 manager for Russia

An inroduction to services provided

by the Grid

Page 2: Elena Slabospitskaya IHEP NA3 manager for Russia

LCG-2 User Guidehttps://edms.cern.ch/file/454439//LCG-2-UserGuide.html

LCG Releaseshttp://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=releasesLCG-2 Install Notes (for administrators)

LCG-2 Manual Installation Guide (for administrators)https://edms.cern.ch/file/434070//LCG2Install.htmlSite with EDG

Tutorialshttp://hep-proj-grid-tutorials.web.cern.ch/hep-proj-grid-tutorials/

Sources of the information

Page 3: Elena Slabospitskaya IHEP NA3 manager for Russia

- Generate a certificate request grid-cert-request -int- Modify the passphrase of your private key grid-change-pass-phrase- Check the content of your credentials grid-cert-info & grid-proxy- Log into the Grid: create proxy grid-proxy-init & edg-voms-proxy-init- Long-tem proxy( > 12hours) myproxy-init -s lcg14.sinp.msu.ru -d -v -n myproxy-info -s lcg14.sinp.msu.ru -d

Exercise: Credentials

Page 4: Elena Slabospitskaya IHEP NA3 manager for Russia

Exercise: Job Description

The language used to describe a job is Job Description Language (JDL) Mandatory ( test.jdl)Executable = "/bin/hostname";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"}; OptionalOutputSE -specifies the SE where the user wants to store output data.OutputData – automatically registeres data files in the GridEnvironment = {"CMS_PATH=$HOME/cms", "CMS_DB=$CMS_PATH/cmdb"};Arguments = "Hello Grid";

Page 5: Elena Slabospitskaya IHEP NA3 manager for Russia

CLIedg-job-list-match -vo <VO> test.jdledg-job-submit -vo <VO> test.jdl edg-job-status <edg_JobId> edg-job-get-logging-info <edg_JobId> edg-job-get-output <edg_JobId>edg-job-submit -vo <VO> interactive.jdledg-job-submit -vo <VO> perltest.jdl

GUI edg-wl-ui-jdleditor.sh edg-wl-ui-jobmonitor.sh edg-wl-ui-jobsubmitter.sh

Exercise: Job Submission

Page 6: Elena Slabospitskaya IHEP NA3 manager for Russia

Exercise: Data Management

edg-rm --vo <VO> printInfo

edg-rm –vo <VO> listReplicas <GUID>

edg-rm --vo <VO> copyAndRegisterFile file:<full path>/LCG-2-UserGuide.html -l lfn:LCG-2-UserGuide.html -d <CloseSE>

edg-rm --vo <VO> replicateFile <guid> -d <SE>

edg-rm --vo <VO> getTurl <SURL> <protocol>

globus-url-copy -vb file://`pwd`/LCG-2-UserGuide.html <TURL>

edg-rm --vo <VO> del <GUID> --all-available

edg-rm --vo dteam ls <SURL>

Page 7: Elena Slabospitskaya IHEP NA3 manager for Russia

Exercise: Put a file to Storage

copyAndRegisterFile

getTurl

globus-url-copy & copyFile <LFN> <local> & rfcp

CloseSE SRM

GUID

listReplicas & replicateFileSURL

TURL

MSS

edg-gridftp-exists, rm, ls

Page 8: Elena Slabospitskaya IHEP NA3 manager for Russia

Exercise: Information System

ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=local, o=grid"

The local GRISes running on Computing Elements and Storage Elements

In LDAP, a special attribute objectClass is defined for each directory entry

At each site, a site GIIS collects information about all resources

ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=LCGCERTTB2P, o=grid"

ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=local, o=grid" 'objectClass=SiteInfo' SiteName

Page 9: Elena Slabospitskaya IHEP NA3 manager for Russia

Appendix A. Test.jdl

Executable = "/bin/hostname";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"};

Page 10: Elena Slabospitskaya IHEP NA3 manager for Russia

Appendix B. interactive.jdl & interactive.sh

JobType = "Interactive" ;Executable = "interactive.sh" ;InputSandbox = {"interactive.sh"} ;

interactive.jdl

interactive.sh#!/bin/sh

echo "Welcome!"echo -n "Please tell me your name: "read nameecho "That is all, $name."echo "Bye bye."exit 0

Page 11: Elena Slabospitskaya IHEP NA3 manager for Russia

Executable = "perltest.pl";InputSandbox = {"perltest.pl"} ;Arguments = "Grid";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"};

#!/usr/bin/perl -s

if ($ARGV[0]) {$argument= $ARGV[0];}print "Your argument is $argument","\n";

perltest.jdl

perltest.pl

Appendix C. perltest.jdl & perltest.pl

Page 12: Elena Slabospitskaya IHEP NA3 manager for Russia

Requirements = other.GlueCEInfoLRMSType == "PBS" && other.GlueCEInfoTotalCPUs > 1;

Requirements = other.GlueCEUniqueID == "lxshare0286.cern.ch:2119/jobmanager-pbs-short";Requirements = Member("CMSIM-133",other.GlueHostApplicationSoftwareRunTimeEnvironment);Requirements = RegExp("cern.ch", other.GlueCEUniqueId);

Appendix Y. Useful examples

Requirements = anyMatch(other.storage.CloseSEs,target.GlueSAStateAvailableSpace > 204800);

InputData = {"lfn:doe/prod/kin_1", "guid:136b48a64-4a3d-87ud-3bk58gnn46m49f3"};DataAccessProtocol = {"rfio", "gsiftp"};

Page 13: Elena Slabospitskaya IHEP NA3 manager for Russia

Appendix Z. Possible Job States

SUBMITTED

WAITING

READY

SCHEDULED

RUNNING

DONE(ok)DONE(failed)

OUTPUTREADY

CLEARED

ABORTEDDONE(cancelled)