Interoperability Between EU and China

Interoperability Between EU and ChinaInteroperability Between EU and China

Denis Denis CaromelCaromel, Yu , Yu FengFeng and Brian and Brian AmedroAmedro

INRIA Sophia, FranceINRIA Sophia, France

OGF23, Barcelona, 2 June 2008OGF23, Barcelona, 2 June 2008

OFG23OFG23 BarcelonaBarcelona–– 2 June 20082 June 20082

EchoGRID – FP6 SSAEurope Chinese Co-Operation on the Grid

� Consortium formed by major R&D organizations in EU and China

� ERCIM FR (INRIA, STFC, CNR & FhG)

� NTUA GR

� Atos Origin SP

� Engineering IT

� THALES FR

� Beihang University CN

� ICT CN

� CNIC CN

� NUDT CN

� HUAWEI CN


EchoGRID Major Goals

� Foster collaboration in Grid research and technologies by defining short-, mid-, and long-term vision in the field

� Establish a common Grid Collaboration Roadmap, relying on European and Chinese experts, both from academia and industry;

� Consolidate this vision and promote cross-fertilisation between Grid-related projects and initiatives in Europe and China by interacting with the GRID research and industrial communities;

� Exchange experiences and best practices by selecting Grid Open Standards for Grid middleware and applications interoperability and by promoting the identification of guidelines for building a Standard Quality Assurance Process


EchoGRID Outcomes

� 3, 5 and 10 years roadmaps developing a shared European and Chinese vision of future GRID research perspectives for both research and industrial communities on which both sides may collaborate;

� a EU-China Interoperability Grid Plugtests to test and improve interoperability mechanisms of Grid middleware;

� a series of conferences and workshops open to both European & Chinese participants from research, industry, government, SMEs and user communities;

� a collaborative Multilingual Portal for grid-related resources


EchoGRID Roadmap http://echogrid.ercim.org/

� Divided the grid technological issues in 6 areas:

� (from the specific EchoGRID workshop in Rome in January 2008)

� New programing paradigms

� Grid Architectures

� Grid Management

� Virtual Organisations

� Component model

� WorkFlow – business progress

� Defined the expected progress along the roadmap at three points:

� Three years

� Five years

� Ten years

full version: http://echogrid.ercim.org/


Roadmap Structure

New programing

paradigms

EC and

China

Coverag

e

New Ideas

Grid Management

State of the

art

Recom

mend

ations

New Ideas

Recom

mendati

ons


Standardisation and PlugTests

� INRIA link with Standardization bodies, ETSI, OGF

ProActive/GCM accepted as ETSI Work Items towards Grid Standards

� BUAA, NUDT, INRIA with OW2 (Open source community on Grid middleware) http://www.ow2.org/


GCM Towards Standardization

•• GCM: Grid Component ModelGCM: Grid Component Model

• GCM Being defined in the NoE CoreGRID

•• (42 institutions)(42 institutions)

• Open Source ObjectWeb ProActive

• implements a preliminary version of GCM

• Service Oriented: NESSI relation

•• GridCOMPGridCOMP takes:takes:

• GCM as a first specification,

• ProActive as a starting point, and

• Open Source reference implementation.

The vision: The vision: GCMGCM to be the GRID to be the GRID GSMGSM


ProActive Parallel Suite (1)

Open

Source

+

PROFESSIONAL

SUPPORT


ProActive Parallel Suite: GUI


GCM Planned Parts:

•• GCM Interoperability DeploymentGCM Interoperability Deployment

•• GCM Application DescriptionGCM Application Description

•• GCM Fractal ADL GCM Fractal ADL

(Architecture Description Language)(Architecture Description Language)

•• GCM Management (Java, C, WSDL API)GCM Management (Java, C, WSDL API)

WorkWork ItemItem

WorkWork Item Item proposedproposed


Scope of GCM Interoperability Deployment

•• Describing Application, Components and Describing Application, Components and

Deployment in a Standard manner Deployment in a Standard manner

•• To be used as building blocks for Grid applications. To be used as building blocks for Grid applications.

•• To be used for VirtualizationTo be used for Virtualization

•• Targeting different frameworks: Targeting different frameworks:

• Grid, Clusters, SMP Parallel machines, Servers, Multi-Cores

•• XML basedXML based


Interoperability achieved with this technology :ETSI Grid Plugtests, 04, 05, 06, 07

•• Between 20 to 40 sites around the worldBetween 20 to 40 sites around the world::2006: 4130 cores

Total power: ~ 1700 GFlops (100 Giga Flops in 04)

•• Highly heterogeneousHighly heterogeneous ::Machines: IBM, SGI, Sun, Bull, Mac

OS: Linux, Windows, Solaris, MacOS, SGI Irix

JVMs: Sun, SGI, BEA

Protocols: ssh, rsh, sshGSI, rcp, scp, Unicore, Globus Gram

Job Schedulers: PBS, LSF, Sun Grid Engine, Oar, Prun,

EGEE gLite, NorduGrid, Globus,

IBM Load Leveler

Recently added: CGSP China Grid


Melbourne

Nancy

Metz

Napoli

ETSI Grid Plugtests, 04, 05, 06, 07

Nancy

Napoli

Nice

Metz

Paris

Pise

Rennes

Santiago

San Diego

Beijing

Amsterdam

Belfast

Fribourg

Grenoble

Lille

Manchester

Melbourne

Merida

Metz

Bombay



Grid PlugTestsGrid from all over the World

� A world wide Grid � More than 4 500 cores

� Nearly 500 000 CPU hours

� Deployed on : 18 sites in France, China, Japan, Netherlands

� Interoperability with Sun Grid Engine, PBS, Torque, OAR2, Prun, …

� Goal of the N-Queens contest� First Goal: TEST Interoperability

� Practical Way to achieve that:� Open Competition between teams from around the world

� Solve the maximum number of N-Queens solutions in 1 hour

� On a maximum number of machines

� With the most efficient algorithm


IV Grid Plugtests


IV Grid PlugTests 2007

� IV Grid Plugtests, 29th Oct - 2nd Nov 2007, Beijing, China

� Co-organisers:

� Co-hosts: SuperComputing Centre, CNIC, China

� Sponsors:


Grid PlugTests N-Queens - 6 TEAMS

� “ACT” - Beihang University – China

� “BUPT N-Queens” – China

� “OutPUT N-Queens” – POZNAN – Poland

� “KAAPI-MOAIS” – France

� “Grid-TU” - Tsinghua University - China

� “ChinaGRID-TU” - Tsinghua University – China


2007 CONTEST: N-Queens RESULTS

� The 3rd N-Queens Prize winners (2 teams Ties) are� Grid-TU - Tsinghua University – China

� Calculated N=22 Queens in 19 mn 36s and

� deployed 1735 workers

� BUPT - Beijing University of Posts and Telecommunications, China

� Calculated N=22 Queens in 24 mn 31s and

� deployed 2925 workers

� The 2nd N-Queens Prize winner is� BUAA – Beihang University, China

� successfully deployed 3 888 workers

� The 1st N-Queens Prize winner is� KAAPIMOAIS – INRIA, France

� with ~40 000 Billions solutions found deployed

� on 3 654 workers


Grid PlugTests IV 2007: Result Analysis

� Nb. Of Workers:� 3 888 by ACT, Beihang University (BUAA), China

� 3 654 by MOAIS, Grenoble, Fr.

� Compared to last year: x2

� Nb. of Solutions:� N=23 + 6 times N=22, MOAIS, Grenoble, Fr.

� N=22 + N=21 + 6 times N=20, BUPT

� Compared to last year: x6.5(2006: N=22 in 50mn on 2193 workers)

Keeping (or even improving) Moore’s Law:� x2 in middleware (Nb. Nodes) x2 Solution Quality (x2 Moore’s Law)


Next Grid

Plugtests

To

Test

Interoperability

with ETSI

GCM/ProActive

Using

Finance

Industrial

Applications

To reinforce

EU – China

Grid

Collaboration

Documents

Interoperability Between EU and China