29
http://www.ngs.ac.uk http://www.nesc.ac.uk/ training The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science [email protected]

Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science [email protected]

Embed Size (px)

Citation preview

Page 1: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

http://www.ngs.ac.ukhttp://www.nesc.ac.uk/training

The Wider Context of the NGS

Mike MineterTraining Outreach and EducationEdinburgh e-Science

[email protected]

Page 2: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

3

Contents

• More of the projects and organisations that influence the NGS– EGEE

– OMII-UK

– OMII-Europe

– NextGRID

– ICEAGE

Page 3: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

4

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE – international e-infrastructure

• Build, deploy and operate a consistent, robust a large scale production grid service that

– Links with and build on national, regional and international initiatives

• Improve and maintain the middleware in order to deliver a reliable service to users

• Attract new users from research and industry and ensure training and support for them

Network infrastructure& Resource

centres

Op

era

tio

ns

, S

up

po

rt a

nd

tr

ain

ing

Collaboration

Pan-European Grid

Page 4: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

7

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE-II: Expertise & Resources

• More than 90 partners • 32 countries• 12 federations Major and national

Grid projects in Europe, USA, Asia

+ 27 countries through related projects:– BalticGrid– SEE-GRID– EUMedGrid– EUChinaGrid– EELA

Page 5: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

8

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE is running…

• … the largest multi-VO production grid in the world!

• What’s happening now?http://gridportal.hep.ph.ic.ac.uk/rtm/

• What resources are connected?http://goc.grid-support.ac.uk/gridsite/monitoring/

Page 6: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

9

Enabling Grids for E-sciencE

INFSO-RI-508833

NGS – Some Possible Futures

NGS

EGEE

Campus grids

GridPP

Interoperability

GridPP / NGSConvergence ?

UK & IrelandLCG VO’s

Note: EU-wide progress towards European and National Grid Infrastrustures…

Page 7: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

10

Enabling Grids for E-sciencE

INFSO-RI-508833

NGS- adopting VOMS, as used in EGEE grid

Virtual Organization Membership Service

Before VOMS

• User is authorised as a member of a single VO

• All VO members have same rights

• Gridmapfiles are updated by VO management software: map the user’s DN to a local account

• grid-proxy-init

VOMS

• User can be in multiple VOs– Potentially: aggregate rights

• VO can have groups– Different rights for each– Nested groups

• VO has roles– Assigned to specific purposes

E,g. system admin When assume this role

• Proxy certificate carries the additional attributes

• voms-proxy-init• VOMS establishes and

communicates VO credentials… how these are used is service-specific

Page 8: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

12

Enabling Grids for E-sciencE

INFSO-RI-508833

GILDA demonstrator and testbed(https://gilda.ct.infn.it)

Page 9: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

14

Enabling Grids for E-sciencE

INFSO-RI-508833

Related projects: infrastructure, education, application

Name Description

BalticGrid EGEE extension to Estonia, Latvia, Lithuania

EELA EGEE extension to Brazil, Chile, Cuba, Mexico, Argentina

EUChinaGRID EGEE extension to China

EUMedGRID EGEE extension to Malta, Algeria, Morocco, Egypt, Syria, Tunisia, Turkey

OMII-Europe interoperable, tested, certified middleware

ISSeG Site security

eIRGSP Policies

ETICS Repository, Testing

BELIEF Digital Library of Grid documentation, organisation of workshops, conferences

BIOINFOGRID Biomedical

Health-e-Child Biomedical – Integration of heterogeneous biomedical information for improved healthcare

ICEAGE International Collaboration to Extend and Advance Grid Education

Page 10: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

15

OMII-UK: Open Middleware Infrastructure Institute

Page 11: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

16

Mind the gap….

Research Pilot projects

Early adopters

Routine production

Researchers are not funded to provide production quality software for others to use

OMII-UK exists to help bridge this gap!

Page 12: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

17

Open Middleware Infrastructure Institute

Formed University of Southampton (2004) Focus on an easy to install e-Infrastructure solution Utilise existing software & standards

Expanded with new partners in 2006 OGSA-DAI team at Edinburgh myGrid team at Manchester

To be a leading provider of reliable interoperable and open-source

Grid middleware components services and tools to support

advanced Grid enabled solutions in academia and industry.

Page 13: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

18

Activity By providing a software repository of Grid

components and tools from e-science projects By re-engineering software, hardening it and

providing support for components sourced from the community

By a managed programme to contract the development of “missing” software components necessary in grid middleware

By providing an integrated grid middleware release of the sourced software components

Page 14: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

What is OMII-Europe?http://wiki.nesc.ac.uk/read/omii-eu-na3?BeijingMarch2007

Mike MineterTraining Outreach Education – National e-Science Centre,

Edinburgh, [email protected]

Page 15: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

21

EU project: RIO31844-OMII-EUROPE

What is OMII-Europe?

• Open Middleware Infrastructure Institute for Europe• European Union funded FP6 project (RI)

– FP: Framework Programme - all research-related EU investment – OMII-Europe is funded from the 6th FP – a ”Research Infrastructure - Integrated Infrastructure Initiative” – Starting May 2006, initial 2 year duration– 16 partners (8 European, 4 USA, 4 Chinese)

• Complimentary to existing national programmes (OMII-UK, NMI, C-OMEGA, OMII-China…)

• Goal is to provide key software components for building e-infrastructures

• Project will demonstrate “proof of concept” with expectation for a follow-on project in FP7

Page 16: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

22

EU project: RIO31844-OMII-EUROPE

What will OMII-Europe do?

• Initial focus on providing common interfaces and integration of major Grid software infrastructures

• Common interoperable services:– Data Access, Virtual Organisation Management,

Portal, Accounting, Job Submission and Job Monitoring

– Capability to add additional services• Infrastructure integration

– Initial EGEE/UNICORE/Globus/CROWN interoperability

– Interoperable security framework

Page 17: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

23

EU project: RIO31844-OMII-EUROPE

OMII-Europe JRA1 re-engineering activities

OGSA DAI BES VOMS RUSGrid

Sphere

Etc. Identified

Components

EGEE

(GLite)

UNICORE

Globus

Etc. OMII-UK, USA, China

Page 18: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

24

NextGRID:Next Generation Grids

Stephen Davey, NeSC, UK

Page 19: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

NextGRID Project 11M€ EU FP6 project; 3 years starting September 2004. 22 partners, some industrial, some academic. Developing Architecture for Next Generation Grids. Research and exploration project: A 5-10 year lookout.

www.nextgrid.org

Page 20: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

NextGRID Project Vision

Grid offering services

Business focus Grids Applicable to Industry Inter Enterprise Grids

Service Level Agreements & Quality of Service (not

just best effort). Basis in Standards (for interoperability & stability).

Page 21: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

Challenges & Experiments Key focus areas:

Service Level Agreements Workflows (across domains) Security Data

Challenges are manifested in NextGRID reference applications: Financial modelling (Implied Volatility, Derivatives Pricing)

Digital media production (On-demand video rendering)

Key components being developed and evaluated.

Page 22: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

NextGRID Architecture White Paper Presents the NextGRID Vision and Technical

Challenges, plus future work of the project Architectural Principles

Dynamics, Composition, Infrastructure NextGRID Generalized Specifications and Profiles

http://www.nextgrid.org/download/publications/NextGRID_Architecture_White_Paper.pdf

Contributors & Acknowledgments. Particular thanks to: Malcolm Atkinson (NeSC), David Snelling (Fujitsu), Bryce

Mitchell (BT) NextGRID Architecture WP1 & many others

www.nextgrid.org

Page 23: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

32

INFSO-SSA-26637

• Training– Targeted– Immediate goals– Specific skills– Building a workforce

• Education– Pervasive– Long term and sustained– Generic conceptual models– Developing a culture

• Both are needed

Society

Graduates

EducationInnovation

Invests

PreparesCreate

Enriches

Organisation

Skilled Workers

TrainingServices & Applications

Invests

PreparesDevelop

Strengthens

Malcolm Atkinson

International Collaboration to Extend and Advance Grid Education – ICEAGE

International Collaboration to Extend and Advance Grid Education – ICEAGE

Page 24: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

33

INFSO-SSA-26637

ICEAGE

• Mission

Stimulate and support advances in grid education throughout Europe

• Goals– Achieve rapid growth in effective advanced grid

education– Make best use of worldwide capacity for advanced grid

education– Deliver a stimulating programme of educational events

Including international summer schools

– Broaden engagement in an advanced grid education both geographically and across disciplines

Page 25: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

34

INFSO-SSA-26637

Iceage – Activities• Forum

– International panel of experts to develop curricula, policies & strategies, ontologies

• Support, Outreach, Induction & Training services

– Attracting & Training the Trainers

– Persuading Universities to adopt Grid Computing Curricula

– E-Learning, repository & course scheduling & announcement

• Summer Schools– General

– Specialised – S/W engineering Bio-informatics …

• T-Infrastructure

– A training grid - very different from a production grid• response time vs throughput

• lightweight CA

• middleware agility

• safe and effective play-ground

Page 26: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

35

Contents

• More of the projects and organisations that influence the NGS– EGEE

– OMII-UK

– OMII-Europe

– NextGRID

– ICEAGE

• NGS Future Developments

Page 27: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

36

NGS middleware: future

• Middleware recently deployed– Portal v2

– GridSAM – alternative job submission and monitoring

• Developed by partners:– Application Hosting Environment: AHE

– P-GRADE portal and GEMLCA

• Being deployed – VOMS support – coupled to developments of support procedures for projects

– WS-GRAM: GT4 job submission

– Resource Broker

• Under development– Shibboleth integration

Page 28: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

37

The End

That’s All Folks…

almost!!

Page 29: Http:// The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

38

Feedback

Thanks to EGEE’s GGUS for this picture!!

NGS