Interoperability gap analysis -

ETSI initiatives on gap

analysis for interoperability

in Grids

Julian Gallop

ETSI Specialist Task Force 331

on ICT Grid Interoperability and

visitor at STFC RAL, UK© ETSI 2009. All rights reserved

OGF25/EGR session - 2 March 2009

2

Sign up sheets

Not only OGF attendance sign up sheets

But also ETSI attendance sign up sheets

ETSI requires me to obtain this on ETSI’s own pro-forma

Therefore please make sure you sign up your attendance on both sheets

Thank you!

3

overview

ETSI and its involvement in Grids

ETSI Grid interoperability gap analysis

ETSI Grid plug test 2009 (one slide - I’ll give more detail in

presentation to OGF/GIN)

The way forward

4

ETSI - the organisation

European Telecommunications Standards Institute

SDO in area of information and communication technology

Globally recognised standards for Information & Communications

Technologies including fixed, mobile, radio, broadcast, internet

Unites almost 700 member organizations, including manufacturers,

network operators, administrations, service providers, research

bodies and users from 56 countries including the Far East and the

US. Likely to be broad overlap of interest with Enterprise Grids.

Track record of being responsible for globally applicable standards

such as GSM, DECT, ...

5

Moving away from traditional telecoms

Next Generation Networking

evolution of telecomm networks, generally using IP - involves many

standards and will take some time to achieve (sound familiar?)

ETSI heavily involved in this along with ITU-T

Recognising importance of distributed computing infrastructures

such as Grids and Clouds -

e.g. AT&T influential in clouds;

e.g. several European telecomms operators active in EU FP6 Grids

and other distributed computing projects

Formal Technical Committee TC GRID set up 2006

Co-operation agreement with OGF signed in May 2007

About ETSI and TC Grid

Active member of the grid community for a number of years

(Co)-organized numerous Grids@work events of the past years

TC Grid is an ETSI Technical Committee

Was set up 2006

Works on investigating and producing standardized solutions for

using, integrating and deploying grid & cloud technology in existing

and future telecommunication networks

Close collaboration and MoU with other grid SDOs such as OGF

7

Some aspects of ETSI TC Grid charter and focus

Address IT and telecommunications convergence

Actively involve and support Grid stakeholders

Develop consensus-based technical specifications and reports

NOT trying to duplicate standards development already underway

in other bodies

Aim is to complement existing work

Add ETSI proven experience of:

• convergence

• testing methodologies and languages (TTCN-3)

• test specification writing for interoperability and conformance

• 20 plug test events per year

8

ETSI TC Grid Work programme

[Work items can be added or brought to an appropriate end]

Inventory of Grid Stakeholders

Prepared by Specialist Task Force on Grid (STF331 - of which I am a member)

1st version published - being revised at present

Study of Grid interoperability gaps

will say more about this in this talk (prepared by STF331)

Grid interoperability testing framework and plugtest event

will say more about this in talk to OGF25/GIN (prepared by STF331)

Grid Services and Telecom Networks

architectural options

use cases, requirements analysis and business roles

Grid Component Model (GCM)

interoperability deployment; Application Description; Architectural

Description Language - key to the ETSI Grid plugtest

9

Grid gap analysis - main focus

Main focus of gap analysis

interoperability gaps and overlaps in Grid standards

interoperability gaps and overlaps between Grid and NGN standards

in an integrated environment

• hard because relationship between Grid and NGN is still under discussion

may be different emphasis from the EGR gap analysis

ETSI TC Grid gap analysis

• focussed on interoperability

• so the gap analysis is not necessarily

• what features+functions are required

• but instead, of those features+functions that are required, what are the gaps

and overlaps that hinder interoperability

10

Grid gap analysis - major categories

SLA and QoS

Security

Charging

Service Discovery

other - including integration

11

Grid gap analysis - case studies

It would have been hard to get a grip without making use of examples.

But they need to be diverse.

Online media and entertainment

some relevant NGN standards here

real time constraints

Integrated Emergency Management (IEM)

used as demonstrator in EU Project (Akogrimo, 2007)

critical application with some demanding QoS required

access to application Grid services provided and used by multiple

organisations - VO critical here

mobile services

High Performance Computing

traditional area of interest for Grids

e-Health

critical security and accuracy requirements

12

Grid gap analysis - examples A few examples of gaps and overlaps

integration of Grid standards is a problem - how does a Grid application

service provider coordinate multiple Grid standard specs?

Availability of commercial offerings of OGF standards

In a telecomms NGN environment, SLA will not only be required but will be

expected to work in complex, multi-provider, long term situations and will

need to relate to network QoS (until now service description terminology in

SLA is largely about computation)

security: X509 in wide use but there are gaps around authorization and

security infrastructure operation

charging: relationship of Grid usage to telecomms charging.

Standards overlap issues e.g. DMTF&CIM (Telecomms) / GLUE (OGF)

Organizational issues

ETSI will need to work with bodies such as OGF

But the ETSI Grid STF which prepares the report is a transitory group of

experts

ETSI TC Grid is a (more) permanent body

13

Grid gap analysis document - the 1st edition

You can obtain the document from ETSI Publications download

area - http://pda.etsi.org/pda/queryform.asp

Search term is Grid

Observe list of documents (not a long list)

Name of document is:

• Study of ICT Grid interoperability gaps;Part 2: List of identified Gaps

Click on download

You will be asked to register for free

You’re welcome to suggest improvements to the document

Current publicly available document contains the problems - you’re

welcome to feedback on this in order to contribute to …..

Currently (next 1.5 - 2 months) ETSI is working on pathways to

solutions

14

Plugtest brief announcement

To be hosted in Sophia-Antipolis (near Nice), France Nov 30 to

Dec 2

NDA to protect event participants

Overall results from Plugtest to be presented at co-located Workshop

(Dec 2 and 3)

Different form than at previous ETSI Grid Plugtests

Not programming contest

Goal is evaluation of application deployment based on ETSI GCM

(Grid Component Model) standards onto different grid and cloud

computing infrastructures

Intent is to bring key players of telecom community together with

grid and cloud infrastructure providers

Event open to participation for commercial as well as open source

infrastructure providers, ETSI as well as non-ETSI members

Telecom operators and equipment vendors will observe the event

15

Way forward

OGF EGR and ETSI TC GRID cooperation?

Feel free to feedback and express interest - can use me as an initial

contact (julian.gallop@stfc.ac.uk)

• gap analysis and solution identification will be worked on over next two

months - feedback welcome

• Grid plug test Nov 30 to Dec 2 - Grid providers and Grid software

providers should consider attending - if anyone in audience interested do

make contact

We could provide an update on ETSI Grid interoperability initiatives at

forthcoming OGF in North America (one of the next two).

longer term cooperation?

16

Thank you !

Any questions / suggestions for the future?

17

Subsequent slides available if needed

18

Slides on plugtest

Use these in my presentation to OGF25 / GIN

But available here (EGR) if needed

Overview of plugtests

About GCM

About the ETSI’s Grid Plugtest 2009

A Testing Framework for GCM

Summary of Approaches for GCM testing

About the Grid Plugtest test specification

About ETSI’s Grid Plugtest 2009

Planned to be hosted in Sopia-Antipolis, FR, from Nov 30 to Dec 2

co-located with a workshop organized by TC Grid (Dec 2 and 3)

NDA to protect event participants

Overall results from Plugtest to be presented at workshop

Different format than previous ETSI Grid Plugtests

Not programming contest – applications used for testing are fixed

prior to event

Goal is evaluation of application deployment based on ETSI GCM

standards onto different grid and cloud computing infrastructures

Intend is to bring key players of telecom community together with

grid and cloud infrastructure providers

Event open to participation for commercial as well as open source

infrastructure providers, ETSI as well as non-ETSI members

Telecom operators and equipment vendors will observe the event

About GCM

Collection of Grid Component Model standards

Developed by ETSI Technical Committee Grid

Goal is to define one way of specifying deployment of

applications on any grid infrastructure based on XML descriptors

Orthogonal but convertible to other web service based approaches

popular in the grid community

Deployment Descriptor (DD) - TS 102 827

Defines a XML schema for computing infrastructure and its access

Application Descriptor (AD) - TS 102 828

Defines XML schema for deploying different types of application onto

infrastructures (executable, virtual node, and grid component based)

Fractal Architecture Description Language (ADL) - TS 102 829?

Defines a XML schema for specifying grid applications in terms of

distributed, communicating components

A Framework for GCM Testing

Each grid or cloud infrastructure will be tested during the Plugtest

in the same way

Inputs are infrastructure specific GCM DD and AD as well as one

application per test

Observation of applications will be used as test results

Use one of four approaches to support GCM testing

1. Direct support by infrastructure for GCM based deployment

2. Implement a “GCM-based portal” that converts GCM DD and AD

information to interactions via the infrastructure specific interface for

deploying applications

3. Use existing or create new integration with available GCM based,

open source meta scheduler based on infrastructure specific

deployment interface

4. Manually convert GCM DD and AD information during the Plugtest

into interactions via the infrastructure specific interface for deploying

applications

Illustration of Approaches for GCM Testing

Cloud

Computing

Infrastructure X

Grid Computing

Infrastructure X

GCM AD for

App N on X

GCM DD

for XApp

N

or

ETSI GCM based portal

Syste

m U

nder

Test

App N

Execution

Observations

About the Grid Plugtest test specification

Currently under development in ETSI TC Grid

Will be published as its own ETSI Technical Specification (TS)

Test specification focuses on characteristics of interest to the

telecommunication industry when deploying applications

Example:

Ensure that a grid infrastructure is able to cope with a deployment

where the resource requested by the application exceeds the

available resources at the time of deployment

For each test requirements on GCM DD and AD specification as

well as the application to be deployed will be described

A reference application implementation for each of the tests will

be made available in the electronic annex of this document

Implementations are expected to be developed in Q2/2009