1. ProActive context 2. GCM

INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER)

European CommissionDirectorate-General Information Society

Unit F2 – Grid Technologies

Overview of Overview of GCM GCM (Grid Component Model)(Grid Component Model) andand Grid GridCOMPCOMPEU ProjectEU Project

Denis Caromel Denis Caromel

OASIS INRIA-UNSA-CNRS I3SOASIS INRIA-UNSA-CNRS I3S

Melbourne, Jan. 29 2007Melbourne, Jan. 29 2007

1. ProActive context1. ProActive context2. GCM2. GCM



ProActive andProActive and GCM GCM

• StructuringStructuring of the libraryof the library

3 big layersInner bricks

• Component Component Aspects: notAspects: not onlyonly in Cp Box!in Cp Box!



ProActiveProActive• New GUIsNew GUIs

IC2D EclipseTimIt



Grid Computing with Grid Computing with ProActiveProActive

Melbourne

Amsterdam

Beijing

Shanghai

Hierarchical Deployment

Challenges: Programming Model, Scale, Latency, Heterogeneity,Versatility (protocols,firewalls...)



A

ProActiveProActive : Active objects : Active objects

Proxy

Java Object

A ag = newActive (“A”, […], VirtualNode)V v1 = ag.foo (param);V v2 = ag.bar (param);...v1.bar(); //Wait-By-Necessity

V

Wait-By-Necessity is a

Dataflow Synchronization

JVM

A

JVM

Active Object

Future Object Request

Req. Queue

Thread

v1v2 ag

WBN!



A

Creating AO and GroupsCreating AO and Groups

Typed Group Java or Active Object

A ag = newActiveGroup (“A”, […], VirtualNode)V v = ag.foo(param);...v.bar(); //Wait-by-necessity

V

Group, Type, and Asynchrony are crucial for Cpt. and GRID

JVM



Objects to Distributed ComponentsObjects to Distributed Components

Typed Group Java or Active Object

ComponentIdentity Cpt = newActiveComponent (params);A a = Cpt … .getFcInterface ("interfaceName");V v = a.foo(param);

V

AExampleof acomponentinstance

JVM

Truly Distributed

Components




GCMGCM + +

Scopes and Objectives:Scopes and Objectives:Grid Codes that Compose and DeployGrid Codes that Compose and DeployNo programming, No Scripting, … No PainNo programming, No Scripting, … No Pain

Innovation:Innovation:Composite Components Composite Components Multicast and GatherCastMulticast and GatherCast

MultiCastMultiCast GatherCastGatherCast



• GCM: Grid Component ModelGCM: Grid Component ModelGCM Being defined in the NoE CoreGRID

(42 institutions)Open Source ObjectWeb ProActive implements a preliminary version of GCMService Oriented: NESSI relation exp.

• GridCOMP takes:GridCOMP takes:GCM as a first specification, ProActive as a starting point, and Open Source reference implementation.

The vision: The vision: GCMGCM to be the GRID to be the GRID GSMGSM



GridCOMP PartnersGridCOMP Partners

http://www.wmin.ac.uk/

http://www.ibm.com/us/

http://www.atosorigin.com/en-us/Services/Industries/Major_Events/Olympics/

http://www.unimelb.edu.au/

http://www.uchile.cl/uchile.portal



GCM ArchitectureGCM Architecture



GCM Technical StructureGCM Technical Structure

1. Component Specification as an XML schema or DTD

2. Run-Time API defined in several languagesC, Java

3. Packaging described as an XML schema

4. Information for Deployment(Virtual Nodes, … Variables, File Transfer, …)



Content and ActivitiesContent and Activities

• 1 - Primitive Component Programming1 - Primitive Component Programming

• 2 - Legacy Code Wrapping, Interoperability2 - Legacy Code Wrapping, Interoperability

• 3 - Composition and Composites, Deployment3 - Composition and Composites, Deployment

• 4 – Autonomic features4 – Autonomic features

• 5 – IDE for GCM (Composition GUI, etc.)5 – IDE for GCM (Composition GUI, etc.)



Collective InterfacesCollective Interfaces



Collective InterfacesCollective Interfaces• SimplifySimplify the design and configuration of the design and configuration of

component systemscomponent systems• ExposeExpose the collective nature of interfaces the collective nature of interfaces

Cardinality attributeMulticast, Gathercast, gather-multicast

• The framework handles collective behaviour The framework handles collective behaviour • at the level of the interfaceat the level of the interface

• Based on Fractal API : Based on Fractal API : Dedicated controller Interface typing Verifications



Multicast interfacesMulticast interfaces

Transform a single invocation into a list of invocationsTransform a single invocation into a list of invocations• Multiple invocationsMultiple invocations

ParallelismAsynchronismDispatch

• Data redistribution (invocation parameters)Data redistribution (invocation parameters)Parameterisable: Distribution FunctionBroadcast, scatteringDynamic redistribution: Dynamic dispatch

• Result = Result = listlist of results of results





Multicast interfacesMulticast interfacesResults as lists of resultsResults as lists of resultsInvocation parameters may also be Invocation parameters may also be

distributed from listsdistributed from lists



Gathercast interfacesGathercast interfaces

Transform: Transform: a list of invocations a list of invocations a single invocationa single invocation• Synchronization of incoming Synchronization of incoming

invocationsinvocations~ “join” invocationsTimeout / Drop policyBidirectional Bindings (callers

callee)• Data gatheringData gathering

Aggregation of parameters into lists

• Result: Result: Redistribution of resultsRedistribution of results

Redistribution function



Status of GCM in ProActiveStatus of GCM in ProActive

• Partial implementation: Partial implementation: ADL schema, API, Multicast, Gathercast, …Component GUI (prototype)

• Distributed components for various applications: Distributed components for various applications: Numerical, Legacy, …

• On-going experiments:On-going experiments:up to 300+ CPUs



Current GCM experiments in ProActiveCurrent GCM experiments in ProActive

• JEM3D: 3D JEM3D: 3D electromagnetic electromagnetic application: application: a single Cp on 300+ a single Cp on 300+ CPUs on GridCPUs on Grid

• Vibro-Acoustic Vibro-Acoustic application with application with EADS (legacy MPI EADS (legacy MPI coupling)coupling)



Current GCM experiments in ProActiveCurrent GCM experiments in ProActive

• IBM:IBM:Security Fingerprint System

• ATOS Origin:ATOS Origin:Financial Application Optimization

• GridSystems:GridSystems:Wing SimulationTelecom Application, EDR processing



Update on ProActive and GCM (1)Update on ProActive and GCM (1)

• New Version under preparation:New Version under preparation:

Nov. 10: ProActive Version 3.2 Beta

Jan. 26: ProActive Version 3.2(After PlugTests’ Learning, New Web

Site)

New features in 3.2 release:Next slide



New Web Site with 3.2 VersionNew Web Site with 3.2 Version



Chinese Web thank to Tsinghua Univ.Chinese Web thank to Tsinghua Univ.



Update on ProActive and GCM (2)Update on ProActive and GCM (2)

• New Features in ProActive Version 3.2:New Features in ProActive Version 3.2:New features in 3.2 release:

Conformance tests for Fractal, towards conformance tests for GCM IC2D Eclipse Plugin

TimIt (Hierarchical, Visual) Skeleton (improved, with File Transfer, Documentation) gLite EGEE deployment updated Support for Java 1.5 Generics:

Active Objects can be instantiated from Generic Classes Some Warnings removed

Improvements in OSGi integration Prototype TTools for UML modeling of GCM components (TBC)



A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM

• Once upon a time: Once upon a time: GSM: Global System for Mobile communication

• Process: Process: “critical decisions […] the GSM initiative became a success in Europe

[…] Initially the strategy and technical specifications were agreed for

Europe and […] incorporating all non-European requirements […] worldwide to participate ”

From: Gsm & Umts: The Creation From: Gsm & Umts: The Creation

of Global Mobile Communicationsof Global Mobile Communications

Standardization of GSM was crucial for Standardization of GSM was crucial for EU advances in Mobile Telephony EU advances in Mobile Telephony

(Science and Business)(Science and Business)

http://www.amazon.fr/gp/reader/0470843225/ref=sib_dp_pt/171-5668783-6360215



A Vision:A Vision:GCM as EU’s GSMGCM as EU’s GSM

GRID faces the same challenge: GRID faces the same challenge: Build FlexibilityOpennessInteroperability

Objectives:Objectives: Build a Word-Wide standard for Build a Word-Wide standard for

Science and Business GRIDs: GCMScience and Business GRIDs: GCM



GSM and GCM PicturesGSM and GCM Pictures• GSM cells:GSM cells:

• Components:Components:



GSM and GCM PicturesGSM and GCM Pictures



GSM and GCM PicturesGSM and GCM Pictures



Conclusion (1)Conclusion (1) Scientific Issues and DirectionsScientific Issues and Directions

Components in the membrane:Components in the membrane:• Membrane:Membrane:

Meta-Objects Java Objects

• Components:Components:Active Objects

• If Cp in Mb:If Cp in Mb:Active Objects as

Meta-ObjectsNot suited for all

cases. If Dist. AO

If light+local POJOTBD




Conclusion (2) Conclusion (2) Key technology advancementsKey technology advancements

• Programming the Grid with reusable, composable, components Programming the Grid with reusable, composable, components vs. ad hoc solutions

• Component for Separation of Concerns and AOP:Component for Separation of Concerns and AOP:Gathercast allows to have synchronisation outside functional code

• Deployment on various architectures Deployment on various architectures Super Computer Center, Clusters, data-center, desktop Grids, …

• Interoperability with related Grid software Interoperability with related Grid software

• Integration into Service Oriented Architecture (SOA)Integration into Service Oriented Architecture (SOA)




Conclusion (3) Conclusion (3) Research ChallengesResearch Challenges

• A general enough GCM, still efficientA general enough GCM, still efficient

• Effective composition: Effective composition: Semantics, Deployment, Portability

• Non-Functional Aspects: Non-Functional Aspects: Security, Load-Balancing, Fault-tolerance,CP. Specif (Lotos, UML TTools, pNets) and Model Checking Verification

Documents

1. ProActive context 2. GCM