Hands-on on Information System Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7...

Para ver esta película, debedisponer de QuickTime™ y deun descompresor TIFF (LZW).

Hands-on on Information System

Antonio Juan Rubio MonteroCIEMAT

10th EELA Tutorial.Madrid, May 7th-11th,2007.

lcg-infosites

Exercise 1

Get CE information

$ lcg-infosites - -vo gilda ce

$ lcg-infosites --vo gilda ce****************************************************************

These are the related data for gilda: (in terms of queues and CPUs)

****************************************************************

#CPU Free Total Jobs Running Waiting ComputingElement

------------------------------------------------------------------------------------------

4 3 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long

4 3 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short

34 33 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-long

16 16 0 0 0 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long

1 1 0 0 0 grid006.cecalc.ula.ve:2119/jobmanager-lcgpbs-log

Exercise 2

Get SE information

$ lcg-infosites - -vo gilda se

$ lcg-infosites --vo gilda se

**************************************************************These are the related data for gilda: (in terms of SE)**************************************************************

Avail Space(Kb) Used Space(Kb) Type SEs--------------------------------------------------------------------------------------143547680 2472756 disk cn02.be.itu.edu.tr168727984 118549624 disk grid009.ct.infn.it13908644 2819288 disk grid003.cecalc.ula.ve108741124 2442872 disk gildase.oact.inaf.it28211488 2948292 disk testbed005.cnaf.infn.it349001680 33028 disk gilda-se-01.pd.infn.it31724384 2819596 disk cna03.cna.unicamp.br387834656 629136 disk grid-se.bio.dist.unige.it

Exercise 3

Get information about installed software

$ lcg-infosites - -vo gilda tag

$ lcg-infosites --vo gilda tag

*************************************************************************Information for gilda relative to their software tags included in each CE*************************************************************************

Name of the TAG: VO-gilda-GEANTName of the TAG: VO-gilda-GKS05Name of the CE:cn01.be.itu.edu.tr

Name of the TAG: VO-gilda-slc3_ia32_gcc323Name of the TAG: VO-gilda-CMKIN_5_1_1Name of the TAG: VO-gilda-GEANTName of the TAG: VO-gilda-GKS05Name of the CE:grid010.ct.infn.it

lcg-infosites options

lcg-info

We can use this command to list which CE and SE satisfies a set of given conditions. We can also show values of a set of given attributes.

Information is taken from BDII especified in LCG_GFAL_INFOSYS variable.

Request sintax is: attr1 op1 valueN, ... attrN opN valueN

lcg-info options

Exercise 5

Get supported attributed list

$ lcg-info --list-attrs

$ lcg-info --list-attrsAttribute name Glue object class Glue attribute name

MaxTime GlueCE GlueCEPolicyMaxWallClockTimeCEStatus GlueCE GlueCEStateStatusTotalJobs GlueCE GlueCEStateTotalJobsCEVOs GlueCE GlueCEAccessControlBaseRuleTotalCPUs GlueCE GlueCEInfoTotalCPUsFreeCPUs GlueCE GlueCEStateFreeCPUsCE GlueCE GlueCEUniqueIDWaitingJobs GlueCE GlueCEStateWaitingJobsRunningJobs GlueCE GlueCEStateRunningJobsCloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueIDCloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueIDSEVOs GlueSA GlueSAAccessControlBaseRuleUsedSpace GlueSA GlueSAStateUsedSpaceAvailableSpace GlueSA GlueSAStateAvailableSpaceType GlueSE GlueSETypeSE GlueSE GlueSEUniqueIDProtocol GlueSEAccessProtocol GlueSEAccessProtocolTypeArchType GlueSL GlueSLArchitectureTypeProcessor GlueSubCluster GlueHostProcessorModelOS GlueSubCluster GlueHostOperatingSystemNameCluster GlueSubCluster GlueSubClusterUniqueIDTag GlueSubCluster GlueHostApplicationSoftwareRunTimeEnvironmentMemory GlueSubCluster GlueHostMainMemoryRAMSize

Exercise 6

Show all CEs on BDII satisfiying some given

conditions

$ lcg-info --list-ce --query 'TotalCPUs>=30,OS=SL*' --attrs 'RunningJobs,FreeCPUs‘

- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-long - RunningJobs 0 - FreeCPUs 33

- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-short - RunningJobs 0 - FreeCPUs 33

- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinite - RunningJobs 1 - FreeCPUs 33

- CE: skurut1.cesnet.cz:2119/jobmanager-lcgpbs-long - RunningJobs 0 - FreeCPUs 26[..]

To start R-GMA command line type:>rgma

On begin this message appears.

R-GMA – Command line (1)

Command history is managed with “up” and

“down” keys.

For quick access to a command type it’s

first characters and press “CTRL-R”

Use TAB key to complete the command

input.

Command input

help Shows general help

help <command> Show specific help

exit or quitQuit RGMA command line.

Show tablesShow all table names of the schema. (Schema)

Describe <tablename>Show table structure information.

General commands

To obtain data use SQL SELECT clause: rgma> SELECT * FROM GlueService

SELECT behaviour is according to the request type. There are three request types of SELECT:

LATEST. Return most recents rows for each primary key.HISTORY. Return all historic rows for each primaty key.CONTINUOUS Return rows as soon are being inserter.

Querying data (1)

To change request type use SET QUERY :

rgma> SET QUERY LATEST or rgma> SET QUERY CONTINUOUS

To show current request type:

rgma> SHOW QUERY

Querying data (2)

1. Show all schema tables: rgma>show tables

2. Show information about GlueSite table: rgma>describe GlueSite

3. Make a query about GlueSite table:rgma>set query latestrgma>show query rgma>select Name,Latitude,Longitude from GlueSite

Exercises

Rows max age can be configured. To limit latest or history rows age use SET MAXAGE

rgma> SET MAXAGE 2 minutesrgma> SET MAXAGE 120

To show row max age:rgma> SHOW MAXAGE

To unable max age: rgma> SET MAXAGE none

Row max age

Another property of requests is “timeout” We can use timeout to prevent network failure

or other situations In continuous type, timeout means how long

the request will continue returning new rows.

Default timeout it’s 1 minute.

rgma>SET TIMEOUT 3 minutes or rgma>SET TIMEOUT 180

To show current timeout rgma>SHOW TIMEOUT

Timeout property

We can use SQL INSERT to add new data:

rgma>INSERT INTO userTable VALUES (’a’, ’b’, ’c’, ’d’)

Producer component inserts data on R-GMA. This component manages INSERT clause.

Data production and insertion (1)

To show the current producer type:

rgma>show producer

To set the producer type:

rgma>set producer latest

Data production and insertion (2)

1. Insert and select one row using a contiuous producer to support Continuous and historic querys.

rgma>set producer continuousrgma>insert into userTable values('cod','string',1.4,66)rgma>set query continuousrgma>set maxage 1 minutesrgma>set timeout 5 secondsrgma>select * from userTable

Exercise

To set the secondary producer for consume from userTable table:rgma>SECONDARYPRODUCER userTable

Secondary producer can be set for latest or history request.rgma>SET SECONDARYPRODUCER latest

To show current secondary producer type: rgma>SHOW SECONDARYPRODUCER

Secondary producer

Insert and select data using a secondary producer supporting latest querys.

rgma>set secondaryproducer latestrgma>secondaryproducer userTablergma>show producers of userTablergma>set producer continuousrgma>insert into userTable values ('cod','string',5.2,44) rgma>set query latestrgma>select * from userTable

Exercise

Edificio BroncePlaza Manuel Gómez Moreno s/n28020 Madrid. España

Tel.: 91 212 76 20 / 25Fax: 91 212 76 35www.red.es

Hands-on on Information System Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7...

Documents

FP62004Infrastructures6-SSA-026409 E-infrastructure shared between Europe and Latin America El Proyecto EELA Jesus Casado EELA Project

2 October 17 th, 2006. AACHEN. Double Chooz collaboration meeting. CIEMAT

Lustre in CETA-CIEMAT - EOFS · PDF fileLustre in CETA-CIEMAT ... Lustre in CETA-CIEMAT Implementation, configuration and integration Author: Alfonso Pardo Diaz Event: ... Scalable

CERN 50 th Anniversary A Photographic Timeline Miguel Angel Marquina (Editor) CIEMAT/CERN

EELA Project Overview

Applications in EELA

Accelerator activities at CIEMAT

1st EELA Grid School

04 EELA Manual Dosificador ORIGINAL

Siddhashila Eela - Projects at Punawale

Esther Montes Prado CIEMAT 10th EELA Tutorial Madrid, 8.5.2007

CIEMAT ALMERÍA MADRID SORIA NAVARRA (Mock·up) CIEMAT- El Bierzo CIEMAT- Extremadura Puerto Información Científica Barcelona Public Research Institution

Www.eu-eela.eu E-science grid facility for Europe and Latin America EELA, EELA-2 and then? Bernard M. Marechal (EELA-2 Project Coordinator) CETA-CIEMAT

EELA at an end EELA-2 before its onset

EELA CONFERENCE SUMMARY

Knowing the EELA

Grid applications in EELA

EELA, EELA-2 and then?

CIEMAT (Centro de Investigaciones Energéticas · 1 Enrique Soria Director Renewable Energy Division CIEMAT CIEMAT (Centro de Investigaciones Energéticas Medioambientales y Tecnológicas)

Manual S130 - Eela Audio