View
214
Download
0
Category
Tags:
Preview:
Citation preview
Tony Doylea.doyle@physics.gla.ac.uk
“GridPP2 Specification Process” Grid Steering Committee Meeting, MRC, London, 18 February 2004
Tony Doyle - University of Glasgow
ContentsContents
• Context
• GridPP2 Posts Allocation
• Board Structure
• Deployment Board
• User Board
• Planning Status
Tony Doyle - University of Glasgow
3. Background…3. Background…A Year in the Life of GlobusA Year in the Life of Globus
Tony Doyle - University of Glasgow
2. Background… 2. Background… UK e-Science DevelopmentUK e-Science Development
1. The UK e-Science Production Grid will have significant overlap with the GridPP2 Production Grid – Mutual benefit to engagement– e.g. convergence talks organised prior to
Christmas– GT2-based approach
2. OMII developments will be based upon the Web Services Resource Framework– The OMII delivery timescales are in 2005 onwards– Incorporates e.g. OGSA-DAI – Limited overlap with our proposed programme
Tony Doyle - University of Glasgow
1. Background… 1. Background… LCG DevelopmentLCG Development
1. AliEn provided a pre-Grid implementation
2. ARDA provides a framework for PP application middleware – We can and should (and do)
participate here– Identify your development within
this structure
Tony Doyle - University of Glasgow
0. Background…0. Background…GridPP2 steps towards project spec. GridPP2 steps towards project spec.
0. PPARC Call (February 2003)1.GridPP2 Proposal (30/5/03)2. Feedback from Reviewers3. Responses from the PMB See http://www.gridpp.ac.uk/docs/gridpp2/
4. Projects Peer Review Panel (14-15/7/03)5. Grid Steering Committee (28-29/7/03)See http://www.gridpp.ac.uk/talks/GridPP_GSC_030728.ppt
6. Tender Document (11/11/03)See http://www.gridpp.ac.uk/cb/doc/GridPP2_Tender.doc7. Science Committee (17-18/11/03)8. PPARC (25/11/03)9. CB (4/12/03) 10.PRSC (16/1/04). PRSC summary11.PMB (26/1/04). Work area effort tables12. GridPP9 Collaboration Meeting (4-5/2/04)13. Grid Steering Committee Meeting (18/2/04)
2003 2004 2005 2006 2007 2008
Middleware Deployment Operations
ResourceProvider
UserCommunity
EDG
LCG
LCG
EGEE
EGEE
HEP/BIOMED/…
Prototype-1EDG 1.x
(GT2, Condor-G)
Prototype-2LCG-1 (EDG-2)
Prototype-3LCG-2 Releases
Production-1LCG-3
Production-2 Production-3
Migrate to OGSA/F. Follow GGF Standards
Tony Doyle - University of Glasgow
GridPP2 PostsGridPP2 Posts
• GridPP2 Approved - £15.9m plus a possible further £1m to LCG at CERN subject to strong case to Science Committee*– Essentially the so-called "Regained Programme"
• GridPP2 Tendering Process– Proforma-1s (Report on GridPP1 Work) received by 12
December• Assessed by PMB by 9 January• Currently feedback being sent to PIs by TD
– Proforma-2s (Specification of future work) available by 19 December
– Proforma-3s (Bids for posts) received by 9 January• Assessed by Peer Review Selection Committee (PRSC) on 16
January
*Planned for next PPARC committee meetings
Tony Doyle - University of Glasgow
PRSC Outcome and PRSC Outcome and Future TimelineFuture Timeline
• 33 Bids approved – subject to varying amounts of iteration on deliverables
• 4 Bids not yet approved– but should be - subject to successful renegotiation of
deliverables• 2 part bids to be re-tendered for one post (BaBar)• 7 bids rejected• 1 new post to be re-tendered for one post (Portal)• By 1 March
– DB to develop detailed Financial Plan (against which new PPARC grants can be signed off)
• After 1 March– iteration/discussion on Project Map deliverables
• Mid March to Mid April – JES Submission as soon as discussions complete
• Need to assess impact of ARDA, Metadata Group....
Tony Doyle - University of Glasgow
Patchwork Quilting Patchwork Quilting the GridPP2 HourGlassthe GridPP2 HourGlass
Tender Document Outcome
Tier-1 Tier-1
Applications Applications
Middle/Sec/NetMiddle/Sec/Net
Tier-2 Tier-2
+ 1 Portal+ 1 PhenoGrid
-0.5 BaBar
-1 LHC Deployment
+1 LHC Deployment-1 Network-0.5 Workload
-1 Data Management
+1 Data Management
III. Grid Middleware
e.g. Information Services
I. Experiment Layer
e.g. Portals
II. Application Middleware
e.g. Metadata
IV. Facilities and Fabrics
e.g. Storage Services
Tony Doyle - University of Glasgow
SysMan Experiments
Developers
Deployment
Board
User
Board
Dissemination
Team
Developer
Team
GridPP2 PMB GridPP2 PMB High Level ViewHigh Level View
Project Management
Board
(PMB)
Collaboration Board
(CB)
Production Grid Deployment
Board
(DB)
User Board
(UB)
Project Management
Board
(PMB)
Collaboration Board
(CB)
Production Grid Deployment
Board
(DB)
User Board
(UB)
“Opinion
Formers”
PMB
Tony Doyle - University of Glasgow
• The PMB is the central part of the management structure. • The Project Management Board meets approximately
weekly to:1. determine the detailed objectives of the project;
2. approve the allocation of resources to meet these objectives;
3. ensure timely progress is made towards meeting the objectives;
4. report on progress to the Oversight Committee;
5. inform the community of progress, formally via the Collaboration Board;
6. establish an identity for GridPP2 reflecting the set of GridPP deliverables;
7. ensure that GridPP2 is visible externally and is recognised
as a flagship project.
GridPP2 Project Management BoardGridPP2 Project Management Board Terms of Reference Terms of Reference
III. Grid Middleware
e.g. Information Services
I. Experiment Layer
e.g. Portals
II. Application Middleware
e.g. Metadata
IV. Facilities and Fabrics
e.g. Storage Services
PMB
UserBoard
DeploymentBoard
PMB
Tony Doyle - University of Glasgow
SysMan
GridPP2 Deployment Board GridPP2 Deployment Board Terms of ReferenceTerms of Reference
• The Deployment Board is the body at which technical developments and problems wider than a single Working Group or Tier Centre are discussed and solved.
• The Deployment Board meets approximately quarterly to:1. determine and execute the technical project plan necessary to implement the strategy of
the Project Management Board on the deployment of a production quality grid for Particle Physics;
2. report to the Project Management Board, through its chair, on progress towards this goal;
3. ensure that problems and ideas with implications beyond individual working groups are discussed and solved in the most efficient manner;
4. provide a forum in which all constituent parts of the project can exchange information on technical issues of mutual interest;
5. manage the deployment of GridPP2 hardware resources in the UK, ensuring they are efficiently and effectively used to deliver the Particle Physics Grid with the minimum of duplication;
6. deal with matters of coordination and liaison between UK Tier1 and Tier2 centres;
7. ensure that technical developments elsewhere, particularly at CERN, are efficiently integrated into the project.
Deployment
Board
Tony Doyle - University of Glasgow
User
Board
Experiments
• The User Board ensures that the requirements for the major Particle Physics experiments that will use the Grid are properly taken into account in the strategy of the PMB.
• The User Board meets approximately quarterly to:1. ensure that the GridPP2 project remains science driven and that the
project develops to meet the needs of the UK Particle Physics community;
2. keep an overview of both technical and experimental software developments, ensuring these developments are compatible;
3. facilitate close working relationships between the UK experimental collaborations to identify common areas for the development of Grid-enabled experimental software;
4. overview the major hardware purchases within GridPP2 to ensure compatibility with the needs of the experimental collaborations and between collaborations;
5. promote the use of the developing Grid structures for a wide variety of computing needs in the whole of the UK Particle Physics community.
GridPP2 User Board Terms of ReferenceGridPP2 User Board Terms of Reference
I. Experiment Layer
e.g. Portals
II. Application Middleware
e.g. Metadata
Tony Doyle - University of Glasgow
Deployment TeamDeployment Team
Grid Support Centre5 FTE
Core Grid Coordinator1 FTE
Security Officer
RAL
Data and Storage Management
Glasgow, Bristol, Edinburgh
VO Management and ServicesNorth (0.5 FTE)
Workload Management ServicesLondon
Network ManagementLondon (0.5 FTE)
MiddleWare Specialist Support6 FTE
2 Tier1 Deployment
4 Tier 2 UK Coordinators
LondonGrid,NorthGridScotGrid, SouthGrid
1 Tier2 CoordinatorIreland
Applications Expert
Deployment Team8 FTE Grid Operations Centre
Production Manager
EGEEGridPPJISCCore UK
Manager
Operations (2)
Technical Writer
Network Support
Helpdesk
Network Monitoring
Tony Doyle - University of Glasgow
In LCG In LCG ContextContext
Proposed Proposed StructureStructure
ARDA
Ex
pm
tsEG
EE LCG
Deployment Board
Tier1/Tier2,Testbeds,
Rollout
Servicespecification& provision
User Board
Requirements
ApplicationDevelopment
Userfeedback
Metadata
Workload
Network
Security
Info. Mon.
PMB
CB
Storage
Tony Doyle - University of Glasgow
ARDA
Expmts
EGEE
LCG
Dep
loym
ent
Bo
ard
Tie
r1/T
ier2
,T
estb
eds,
Ro
llou
t
Ser
vice
spec
ific
atio
n&
pro
visi
on
Use
r B
oar
d
Req
uir
emen
ts
Ap
plic
atio
nD
evel
op
men
t
Use
rfe
edb
ack
Met
adat
a
Wo
rklo
ad
Net
wo
rk
Sec
uri
ty
Info
. M
on
.
PM
B
Sto
rag
e
III. Grid Middleware
I. Experiment Layer
II. Application Middleware
IV. Facilities and Fabrics
UserBoard
DeploymentBoard
GridPP2 Project GridPP2 Project Managing the MiddlewareManaging the Middleware
Tony Doyle - University of Glasgow
coherent coherent deploymentdeployment and and useuse
GridPP Middleware Workshop 4/5th March
To review:1. achievements and lessons
learned from GridPP participation in DataGrid
2. Proforma-2 planning in light of LCG/EGEE
3. short-term plans between end of DataGrid and the start of GridPP2
4. Transition of the TB/DB In context of WSRF and ARDA
Ongoing discussions within EB
To review: 1. transition of the EB/UB2. possible role of
“applications manager”3. job scheduling and
priority grid time 4. metadata system5. generic portal6. widening the ARDA
computing model beyond LCG?
Tony Doyle - University of Glasgow
GridPP2 PlanningGridPP2 Planning
• We will specify management/technical roles in advance of GridPP2 to ensure we are successful in developing/deploying the Production Grid
• By the end of this GridPP2 specification process we will be able to:– Continue the work started in GridPP1 (by many people)– Define the GridPP2 Project Map tasks and metrics– Appoint additional people in recognised areas to contribute to
agreed tasks/roles– Contribute fully to EGEE/LCG– Start to go from Prototype to Production
• Anticipate new management/technical posts and holders are defined before GridPP10 meeting at CERN in June
Recommended