Upload
bertille-marley
View
28
Download
0
Embed Size (px)
DESCRIPTION
Elena Slabospitskaya IHEP NA3 manager for Russia. An inroduction to services provided by the Grid. EGEE is funded by the European Union under contract IST-2003-508833. Sources of the information. LCG-2 User Guide https://edms.cern.ch/file/454439//LCG-2-UserGuide.html LCG Releases - PowerPoint PPT Presentation
Citation preview
EGEE is funded by the European Union under contract IST-2003-508833
Elena SlabospitskayaIHEP
NA3 manager for Russia
An inroduction to services provided
by the Grid
LCG-2 User Guidehttps://edms.cern.ch/file/454439//LCG-2-UserGuide.html
LCG Releaseshttp://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=releasesLCG-2 Install Notes (for administrators)
LCG-2 Manual Installation Guide (for administrators)https://edms.cern.ch/file/434070//LCG2Install.htmlSite with EDG
Tutorialshttp://hep-proj-grid-tutorials.web.cern.ch/hep-proj-grid-tutorials/
Sources of the information
- Generate a certificate request grid-cert-request -int- Modify the passphrase of your private key grid-change-pass-phrase- Check the content of your credentials grid-cert-info & grid-proxy- Log into the Grid: create proxy grid-proxy-init & edg-voms-proxy-init- Long-tem proxy( > 12hours) myproxy-init -s lcg14.sinp.msu.ru -d -v -n myproxy-info -s lcg14.sinp.msu.ru -d
Exercise: Credentials
Exercise: Job Description
The language used to describe a job is Job Description Language (JDL) Mandatory ( test.jdl)Executable = "/bin/hostname";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"}; OptionalOutputSE -specifies the SE where the user wants to store output data.OutputData – automatically registeres data files in the GridEnvironment = {"CMS_PATH=$HOME/cms", "CMS_DB=$CMS_PATH/cmdb"};Arguments = "Hello Grid";
CLIedg-job-list-match -vo <VO> test.jdledg-job-submit -vo <VO> test.jdl edg-job-status <edg_JobId> edg-job-get-logging-info <edg_JobId> edg-job-get-output <edg_JobId>edg-job-submit -vo <VO> interactive.jdledg-job-submit -vo <VO> perltest.jdl
GUI edg-wl-ui-jdleditor.sh edg-wl-ui-jobmonitor.sh edg-wl-ui-jobsubmitter.sh
Exercise: Job Submission
Exercise: Data Management
edg-rm --vo <VO> printInfo
edg-rm –vo <VO> listReplicas <GUID>
edg-rm --vo <VO> copyAndRegisterFile file:<full path>/LCG-2-UserGuide.html -l lfn:LCG-2-UserGuide.html -d <CloseSE>
edg-rm --vo <VO> replicateFile <guid> -d <SE>
edg-rm --vo <VO> getTurl <SURL> <protocol>
globus-url-copy -vb file://`pwd`/LCG-2-UserGuide.html <TURL>
edg-rm --vo <VO> del <GUID> --all-available
edg-rm --vo dteam ls <SURL>
Exercise: Put a file to Storage
copyAndRegisterFile
getTurl
globus-url-copy & copyFile <LFN> <local> & rfcp
CloseSE SRM
GUID
listReplicas & replicateFileSURL
TURL
MSS
edg-gridftp-exists, rm, ls
Exercise: Information System
ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=local, o=grid"
The local GRISes running on Computing Elements and Storage Elements
In LDAP, a special attribute objectClass is defined for each directory entry
At each site, a site GIIS collects information about all resources
ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=LCGCERTTB2P, o=grid"
ldapsearch -x -h lxb0738.cern.ch -p 2135 -b "mds-vo-name=local, o=grid" 'objectClass=SiteInfo' SiteName
Appendix A. Test.jdl
Executable = "/bin/hostname";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"};
Appendix B. interactive.jdl & interactive.sh
JobType = "Interactive" ;Executable = "interactive.sh" ;InputSandbox = {"interactive.sh"} ;
interactive.jdl
interactive.sh#!/bin/sh
echo "Welcome!"echo -n "Please tell me your name: "read nameecho "That is all, $name."echo "Bye bye."exit 0
Executable = "perltest.pl";InputSandbox = {"perltest.pl"} ;Arguments = "Grid";StdOutput = "std.out";StdError = "std.err";OutputSandbox = {"std.out","std.err"};
#!/usr/bin/perl -s
if ($ARGV[0]) {$argument= $ARGV[0];}print "Your argument is $argument","\n";
perltest.jdl
perltest.pl
Appendix C. perltest.jdl & perltest.pl
Requirements = other.GlueCEInfoLRMSType == "PBS" && other.GlueCEInfoTotalCPUs > 1;
Requirements = other.GlueCEUniqueID == "lxshare0286.cern.ch:2119/jobmanager-pbs-short";Requirements = Member("CMSIM-133",other.GlueHostApplicationSoftwareRunTimeEnvironment);Requirements = RegExp("cern.ch", other.GlueCEUniqueId);
Appendix Y. Useful examples
Requirements = anyMatch(other.storage.CloseSEs,target.GlueSAStateAvailableSpace > 204800);
InputData = {"lfn:doe/prod/kin_1", "guid:136b48a64-4a3d-87ud-3bk58gnn46m49f3"};DataAccessProtocol = {"rfio", "gsiftp"};
Appendix Z. Possible Job States
SUBMITTED
WAITING
READY
SCHEDULED
RUNNING
DONE(ok)DONE(failed)
OUTPUTREADY
CLEARED
ABORTEDDONE(cancelled)