12
www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal de Campina Grande – UFCG [email protected] E-science grid facility for Europe and Latin America

Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

Embed Size (px)

Citation preview

Page 1: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 1Bogotá, EELA-2 1st Conference, 25.02.2009

On the Co-existence ofService and Opportunistic Grids

Francisco Brasileiro

Universidade Federal de Campina Grande – UFCG

[email protected]

E-science grid facility forEurope and Latin America

Page 2: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 2Bogotá, EELA-2 1st Conference, 25.02.2009

Motivation

• As the grid technology matures, more and more infrastructure enter in production

• Following the sharing spirit of grids, a lot of attention has recently been placed in the interoperation of grid systems

• Most of the interoperability efforts developed so far follow a “bridge” approach– Gateways allow resources of one grid (or the entire

grid) to be exposed as a resource of the other grid– Jobs submitted in one grid can, transparently, end up

being executed in resources of the other grid

Page 3: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 3Bogotá, EELA-2 1st Conference, 25.02.2009

Motivation

• Most grids currently in production can be classified as either service grids (eg. EGEE, TeraGrid, etc) or opportunistic grids (eg. voluntary computing, desktop grids)

• These are very different systems, catering for different needs, and providing different challenges to users and administrators– Dedicated vs shared resources– Clusters/supercomputers vs desktops– Small vs large number of administrative domains– Well defined QoS levels vs best effort– Complex vs simple management– All sorts of applications vs BoT applications

Page 4: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 4Bogotá, EELA-2 1st Conference, 25.02.2009

Motivation

• We advocate that co-existence (instead of interoperation) may be, in some cases, a better strategy to explore synergy between grids of different kinds– In particular, the co-existence of a service and an

opportunistic grid allows: Idle resources from the service grid to be used in an

opportunistic way Increase the size and reach of the grid infrastructure with

shared resources More suitable platform to run simple BoT applications,

possibly liberating service grid resources to run essentially the tightly-coupled applications or more sophisticated BoT applications

Page 5: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 5Bogotá, EELA-2 1st Conference, 25.02.2009

What is an OurGrid-based grid?

Sandboxing

(WM+WN)

Sandboxing

(WM+WN)

User Interface

Application Scheduling

User Interface

Application Scheduling

Resource Centre ManagerGrid-wide Resource SharingResource Centre Manager

Grid-wide Resource Sharing

Page 6: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 6Bogotá, EELA-2 1st Conference, 25.02.2009

UIJDL

Logging &Logging &Book-keepingBook-keeping

ResourceResourceBrokerBroker

Job SubmissionJob SubmissionServiceService

StorageStorageElementElement

ComputingComputingElementElement

Information Information ServiceService

LFCLFCCatalogCatalog

Author.&Authen.

What are the components of a gLite-based grid?

Page 7: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 7Bogotá, EELA-2 1st Conference, 25.02.2009

A closer look at the gLite CE

Page 8: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 8Bogotá, EELA-2 1st Conference, 25.02.2009

Road map for the middlewareco-existence and interoperation

• Allowing idle resources in an EELA-2 gLite resource centre to be exposed as OurGrid resources

Page 9: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 9Bogotá, EELA-2 1st Conference, 25.02.2009

Road map for the middlewareco-existence and interoperation

• Allowing resources of an OurGrid resource centre to be exposed as gLite resources– This will be achieved in two steps

Firstly, allow clusters to be exposed as a single resource in an OurGrid resource centre

Page 10: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 10Bogotá, EELA-2 1st Conference, 25.02.2009

Road map for the middlewareco-existence and interoperation

• Allowing resources of an OurGrid resource centre to be exposed as gLite resources– This will be achieved in two steps

Firstly, allow clusters to be exposed as a single resource in an OurGrid resource centre

Secondly, make these resources available at the gLite grid

Page 11: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 11Bogotá, EELA-2 1st Conference, 25.02.2009

• Latest version of OurGrid just released with support for the exploitation of idle cycles in service grids– Available for download at both:

https://forge.eu-eela.eu/projects/ourgrid-eela/ http://www.ourgrid.org/

– Customized installation guide available for sites already running gLite

• Cluster worker planned for the next release (within a couple of months)

• Evaluate the impact of the co-existence in a production environment

Current status and future work

Page 12: Www.eu-eela.eu 1 Bogotá, EELA-2 1 st Conference, 25.02.2009 On the Co-existence of Service and Opportunistic Grids Francisco Brasileiro Universidade Federal

www.eu-eela.eu 12Bogotá, EELA-2 1st Conference, 25.02.2009

Concluding remarks

• More information on the EELA-2 JRA1 activities at the project’s website:– http://www.eu-eela.eu/

• For OurGrid specifities, visit:– http://www.ourgrid.org/

• Contact me at:– [email protected]

Thanks for your attention!