Upload
dulcie-riley
View
214
Download
0
Embed Size (px)
Citation preview
1October 9, 2001
Sun in Scientific & Engineering Computing
Grid Computing with Sun Wolfgang Gentzsch Director Grid Computing
Cracow Grid Workshop, November 5 - 6, 2001
2October 9, 2001
Summary: Sun's Grid Computing Offerings Sun's existing scalable Grid Computing software stack
Open source building blocks (SGE, Broker, ClusterTools, TCP Portal, Jxta, ...)
Encourage Your research contribution to open source (community)
Integration with Globus etc. (SGE/Broker-Globus-SGEs)
Sun Center of Excellence Program (cooperation ! )
Collaboration, joint Grid projects, Sun GridSIG, . . .
3October 9, 2001
Different Levels of Grids
Stage 1 - 1 Owner / 1 ClusterCluster Grid Domain of SGE & Technical Computing Stack
Stage 2 - Multiple Owners, 1+ Clusters, 1 Enterprise, 1 SiteCampus Grid Domain of SGE/EE & Multicluster Solutions
Stage 3 - Multiple Sites, Multiple EnterprisesGlobal Grid Domain of SGE/EE plus Grid Frameworks
4October 9, 2001
Grid Levels
Global Grid (mult.owners, mult.sites)Grid Resource Mgmt, Security, Authentication, Distributed Data
User interface
GL
OB
AL
CA
MP
US
LO
CA
L
Campus 1mult.owners, 1site
Campus 2mult.owners, 1site
Resource Sharing & Brokerage Resource Sharing & Brokerage
Cluster 11owner, 1site
Cluster MgmtResource Mgt
Cluster 21owner, 1site
Cluster MgmtResource Mgt
Cluster 11owner, 1site
Cluster MgmtResource Mgt
Cluster 21owner, 1site
Cluster MgmtResource Mgt
5October 9, 2001
Grid Computing @ Sun
"The Network is the Computer"
Java, Jini, Jxta, . . .
July'00: Acquisition of Gridware
"Grid" projects since 1995, Julius, Medusa, Eroppa, Unicore, Autobench, . . .
Grid Engine, free, open source, ubiquitous, open API
Department for Grid Computing (inSun VSP): Cluster SW/Stack, Grid SW/Stack, Grid Computing Lab, customer pilots
Sun Grid Computing Council
6October 9, 2001
Sun Grid Software Stack
Global GridSun TCP, SGE Broker, Globus, Avaki, Cactus, Punch,...
Sun TCP Technical Computing Portal & iPlanet Security
GL
OB
AL
CA
MP
US
LO
CA
L
Campus 1 Campus 2
Sun TCP, SGE Broker Sun TCP, SGE Broker
Cluster 1 TCP SGE ClusterToolsSRM SunMCJxta Jiro QFS
Cluster 2 TCP SGE ClusterToolsSRM SunMCJxta Jiro QFS
Cluster 1 TCP SGE ClusterToolsSRM SunMCJxta Jiro QFS
Cluster 2 TCP SGE ClusterToolsSRM SunMCJxta Jiro QFS
7October 9, 2001
Sun Technical Computing Portal "prototype" (soon) commercially available hw/sw solution that...
Enables quick deployment of tech apps over Internet, similar to mail and calendaring
Combines light-weight architecture with Industry-proven security and system
management Based on iPlanet and Sun Grid Engine
8October 9, 2001
9October 9, 2001
Sun Distributed Resource Management Load balancing maximizes resource utilization
Transparent job submission & machine selection
Monitoring and accounting ==> SGE Sun Grid Engine, open source
Guaranteeing required resources
Full control over resource utilization
Fair and share based resource usage
Implementation of management policies ==> Sun Grid Engine Broker, open source
10October 9, 2001
Managing Compute Resources with Sun Grid Engine Broker
Department 1Department 2
Department 3
Department resource accessCampus wide resource demand
Project A
Team B-4
Contractor X
Project C
User 1
Manage the fullmatrix of demand - Users -Teams -Projects
User 2Department 4
Department 5
11October 9, 2001
Sun Grid Engine Status Ubiquitous, free, open source, open APIs
Current Release: SGE 5.2.3 (July 2001)
Over 13,000 downloads (Nov 2001) (-: 1 Mio downloads in 2084 :-) =>> SGE = The Leading RMS
OpenSource (July 2001) 500,000 lines, Sept 2001: 1000 downloads
Today: Grid Computing everywhere in Sun !! www.sun.com/gridware .../hpc .../edu /...
12October 9, 2001
Grid Resource Management
LOOSE STRINGENT
SGE BrokerShared Policy Model
Grid Infrastucture Layer (e.g. Globus, Avaki)
SGE Resource Broker
SGEsite C
local policy,user, etc. mgmt.
Cluster Grid
Campus Grid
Global Grid
SGEsite A
local policy,user, etc. mgmt.
SGEsite B
local policy,user, etc. mgmt.
13October 9, 2001
Demo'd at Argonne National Lab ANL, ARL Army Research Lab, Raytheon, and San Diego SDSC
On 2 SGE clusters (eg: SDSC, 30 cpus and 70 cpus)
Globus/SGE interaction through GRAM scripts
Globus jobs from ANL submitted to ARL cluster
Next step: SGE/EE on top of Globus
Globus & SGE/Broker on Top of SGE
14October 9, 2001
SGE: Scheduling decisions to select remote site
SGE acting as the resource broker for Globus
Globus: multi-site communication, authentication, security, file transfers,...
SGE/Globus interface to be developed:
SGE/Broker submits and tracks jobs to remote systems using Globus services
SGE/Broker as Part of Globus
15October 9, 2001
Sun and Open Grid Standards
Example: DRMAA Distributed Resource Management Application API
"The Glue" between Distributed Resource Management and Applications/Tools
=> Makes resource management transparent
Proposed new Working Group at Global Grid Forum in Frascati/Rome, October 2001
Presented by Veridian, Intel, and Sun
16October 9, 2001
Sun's Grid Strategy Strong Grid core team for developing and productizing
core components (like SGE, Grid Broker,TCP)
Sun Grid Computing Council: Integrate Sun technologies and products and port the environment to all Sun platforms
Sun's partners take care of other computing platforms
Collaborate with the Grid community, IT partners and our customers to build all kinds of different Grids
Sun currently is proposing, designing and building some 50 Grids with research labs, universities and industry Sun Grid software stack available TODAY