9
PUCOWO ETH Zurich 10 th June 2010 Mark Hewitt Shiv Kaushal

Experiences of P-Grade at the White Rose Grid e-Science Centre

Embed Size (px)

DESCRIPTION

Experiences of P-Grade at the White Rose Grid e-Science Centre. PUCOWO ETH Zurich 10 th June 2010. Mark Hewitt Shiv Kaushal. White Rose Grid. Collaboration between Universities of Leeds, Sheffield and York Each site has HPC resources, allows access to whole WRG - PowerPoint PPT Presentation

Citation preview

Page 1: Experiences of P-Grade at the White Rose Grid  e-Science Centre

PUCOWOETH Zurich

10th June 2010

Mark HewittShiv Kaushal

Page 2: Experiences of P-Grade at the White Rose Grid  e-Science Centre

Collaboration between Universities of Leeds, Sheffield and York

Each site has HPC resources, allows access to whole WRG

WRG e-Science Centre: Responsible for collaborative research and P-Grade deployment

Page 3: Experiences of P-Grade at the White Rose Grid  e-Science Centre

Some users prefer web based access than SSH

Ease of running jobs on remote sites One access point for all resources.

Page 4: Experiences of P-Grade at the White Rose Grid  e-Science Centre

Tested alternatives, NGS Portal, Enginframe, EASA

Needed a generic job submission system, not applications based.

Free! Well supported

Page 5: Experiences of P-Grade at the White Rose Grid  e-Science Centre

P-Grade installed in VM at York Install straight forward but did need support from developers

Cut down many features to make it easier for users / support.

Configured SGE job managers Extensive testing carried out INCA testing of all three sites

Page 6: Experiences of P-Grade at the White Rose Grid  e-Science Centre

Especially like the workflow editor It does what it says on the tin! Stable, run for many months at a time Not easy without detailed training Some bugs◦ Java integration issues meaning jobs marked as ‘incomplete’, and strict dependencies on Java versions

◦ Not possible to inspect a job without downloading a zip file

◦ Deletion of a workflow leaves the old name unusable◦ Incompatible with Ubuntu’s default Java

User interface could be made more ‘friendly’ Some steps are confusing e.g. “set for grid”

Page 7: Experiences of P-Grade at the White Rose Grid  e-Science Centre

SARoNGS◦ SARoNGS is a project supported by the UK National Grid Service

◦ Allows a user to create a short lived proxy based on their institutional login via Shibboleth.

Integrated with P-Grade◦ Simple to do. Add a button on certificate page, plus JSP code to populated the certificate download form

Page 8: Experiences of P-Grade at the White Rose Grid  e-Science Centre

Some difficulties installing 2.9◦ Install now separates Condor / Java etc◦ Condor not running stably ◦ Lack of time due go to production level

NGS WMS now reached maturity◦ Hope to have integration between WMS and P-Grade

SARoNGS to handle certificates and login

Page 9: Experiences of P-Grade at the White Rose Grid  e-Science Centre

Mark Hewitt◦ University of York ([email protected])

Shiv Kaushal◦ University of Leeds ([email protected])

Thanks to:◦ P-Grade team

Esp. Zoltan Farkas and Peter Kacsuk◦ Joanna Schmidt

WRG e-Science Centre Director◦ Aaron Turner

WRG York◦ Mike Griffiths

WRG Sheffield