DORII review

Deployment and management of production infrastructure

SA2

Ioannis Liabotisiliaboti@grnet.gr

Greek Research and Technology Network - GRNET

October 21, 2009, Munich

Introduction to SA2

Objectives

Deliverables and Milestones

Activities and Schedule

SA2 Activities and Work performed

Action Points

Conclusions

Outline

2

SA2: Deployment and management of production infrastructure

Duration: 30M, from M1 to M30 PMs: Funded 66, Unfunded 26 Partners:

Introduction

Institute Effort in PMs Institute Effort in PMs

PSNC 5 CSIC 5

CNIT 22 ELETTRA 5

EUCENTRE 5 OGS 5

ECOHYDROS 5 GRNET 9

UC 5

3

To create, operate, support and manage of a production quality grid infrastructure integrating computational, storage and instrument resources

To describe an operational layer on top of existing Grid infrastructures, which will allow for easy integration of instruments and relevant applications with the Grid

To assemble a new testbed infrastructure by incorporating and exploiting existing expertise and experience in deploying, supporting and operating prototype instrumentation grids

To integrate scientific instrumentation and sensors and deploy them on the available infrastructure

To co-ordinate and manage the relationships with resource and network providers, through negotiation of service-level agreements, and to negotiate with wider grid communities

To keep a production level infrastructure to be able to support the daily work of selected DORII scientific communities

Objectives

4

DSA2.1 Analysis of technical and functional requirements (M5) - Done

DSA2.2 Description of the framework of the management infrastructure (M10) – Done MSA2.1 Infrastructure for applications and

instrumentation (First Version) (M10)– Done

DSA2.3 Deployment and test of selected applications on the infrastructure (M13) - Done MSA2.2 First Deployment of applications on the

infrastructure (M13) - Done

Deliverables and Milestones

5

Deliverables and Milestones

DSA2.3.a Deployment Deployment and test of selected applications on the infrastructure - Update (M18) - Done MSA 2.3 Infrastructure for applications and instrumentation

(Second Version) (M18) – Done

DSA2.4. Final description of the deployed management infrastructure (M24) – Do be done Define the final framework for a production

instrumentation infrastructure

TSA2.1: Analysis of Existing Resources (CNIT, GRNET) - Finished

TSA2.2: Definition of the framework of the support and management infrastructure (CNIT, GRNET) - Finished

TSA2.3: Implementation and management of testbeds (CNIT, GRNET, PSNC, CSIC, ELETTRA, EUCENTRE, OGS, ECOHYDROS, UC) - Ongoing

TSA2.4: Finalisation of the framework of the support and management infrastructure (CNIT, GRNET) - Ongoing

Overall schedule

7

Earthquake CommunityActuators - eucentre (ncss) - a set of actuators and

sensors of the building simulatorSeismic sensors - eucentre (eews) - a set of sensor

that will be distributed in a hot zone

Instrument Resources (1/3)

8

Environmental CommunityFLOATS, GLIDERS - ogs (ocom-moon) - 4 floats, 1

gliderCameras -UC (horus-bench) - 2 camerasWater Reservoir sensors – CSIC (echohydros) 3

sensors

Instrument Resources (2/3)

9

Experimental Science Community SAXS: Small Angle X-ray Scattering -ELETTRAXRD: X-Ray Diffraction - ELETTRA SYRMEP: SYnchrotron Radiation for MEdical Physics -

ELETTRA Demos: elettra (demo) - 3 robots, 1 robocam

Instrument Resources (3/3)

10

Infrastructure Status – Computational and Storage Resources

Support the vo.dorii.eu catch-all VO

Other DORII Related VOs supported in various sites in Italy and Spain Ihydra ienvmod gridats lights.infn.it

11

Core Services

vo.dorii.eu Members (at M13)

13

vo.dorii.eu Members (at M20)

Number of Users per application

vo.dorii.eu Usage – Number of Jobs

* MPI & parametric Jobs not accounted16

IE Accounting

Design for IE accounting• The total number of IE users (by time interval, by time) • The total number of hours in which an IE has been used (by time interval and/or by an

user) • How many actions have been executed on the IE (by time interval, by a user, by an action

type and by whichever mix of previous filters) • Instrument/sensor system administrator • Total number of IM users (by time interval, by time) • How many times a specific attribute/parameter has been read/wrote (by time interval

and/or by a user) • How many times a specific command has been executed (by time interval and/or by a

user) • How many times an IM has been locked (by time interval and/or by a user) • How many hours an IM has been locked (by time interval and/or by a user) • The total number of hours in which an IM has been used (by time interval and/or by a

user)

18

Resource Availability

Computational and Storage resources availability ~ 90% IE Resources availability:

Job success rate ~ 97%

19

Users Perspective Evaluatiom

Integration with Network Resource Provisioning

Collaborate closely with SA1 to identify network related problemsUse of HelpdeskUse of Network Monitoring tools Liaison with NRENs

21

Future Plans Long Term

Continue the infrastructure operations and provide services to DORII users Finalize the design of the management framework or the e-Infrastructure

Short TermDeploy Secondary VOMS ServerProvide IE accounting data on a periodic basisHelpDesk is not used Installation of OpenMPI in all HG sites (almost ready)

This task took a long time Register DORII VO to CIC portalPerform infrastructure evaluation?

22

Thank you!

Questions?

23