Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
Institute of Physics, BelgradeScientific Computing Laboratory
March 4, 2007
Petnica Science Center
FREE SCIENTIFIC COMPUTINGFREE SCIENTIFIC COMPUTING
GRID COMPUTINGGRID COMPUTING
Branimir AckovićBranimir Acković
Petnica, March 4, 2007. Free Scientific Computing
OverviewOverview 1/2 1/2 eScience Brief History of UNIX Feeling Free
Licensing, Copyright, Copyleft GNU, Free Software Foundation Open Source Licenses
Linux Supercomputers Clusters Why do we need Grid?
Petnica, March 4, 2007. Free Scientific Computing
OverviewOverview 2/2 2/2 Making Grid to work
Problems VOs Grid Site What really happens? Middleware
Developing & Using Grid EGEE SEE-GRID AEGIS
Petnica, March 4, 2007. Free Scientific Computing
eScienceeScience Trivial:
text editing, Internet services elementary visualization, special functions, ...
Nontrivial: differential eq., large linear systems, searching combinatorial spaces complex symbolic algebraic statistical data analysis complex visualization, ...
Advanced: stochastic simulations part functions/functional integrals risk assessment in complex systems dynamics of the systems with many degrees of freedom, ...
Petnica, March 4, 2007. Free Scientific Computing
Brief History of UNIXBrief History of UNIX
Petnica, March 4, 2007. Free Scientific Computing
Feeling FreeFeeling Free – Licensing, Copyright, Copyleft – Licensing, Copyright, Copyleft 1/3 1/3
1973. Licensing of UNIX by AT&T Copyright Copyleft
Petnica, March 4, 2007. Free Scientific Computing
Feeling FreeFeeling Free - GNU, Free Software Foundation - GNU, Free Software Foundation 2/3 2/3 “Free software” is the matter of liberty, not price. To understand the
concept you should think of “free” as in “free speech”, not as in “free beer”.
1983/1984. GNU's not UNIX – Richard Stallman
Free Software Foundation The freedom to run the program, for any purpose (freedom 0). The freedom to study how the program works, and adapt it to your needs
(freedom 1). Access to the source code is a precondition for this. The freedom to redistribute copies so you can help your neighbor (freedom 2). The freedom to improve the program, and release your improvements to the
public, so that the whole community benefits (freedom 3). Access to the source code is a precondition for this.
Petnica, March 4, 2007. Free Scientific Computing
Feeling FreeFeeling Free - Open Source Licenses - Open Source Licenses 3/3 3/3 GPL, GLPL BSD Licenses Apache License MIT (X11) License Mozilla Public License
Petnica, March 4, 2007. Free Scientific Computing
LinuxLinux Main distributions
Red Hat, Fedora Core SuSE Linux Enterprize, Open SuSE Debian Slackware Mandriva Ubuntu
Scientific Linux, CERN Linux
Shell
Desktop Environments KDE GNOME Window Maker Black Box
Petnica, March 4, 2007. Free Scientific Computing
SupercomputersSupercomputers First computers were supercomputers? TOP500.ORG
Petnica, March 4, 2007. Free Scientific Computing
ClustersClusters Commodity hardware become available in the last 10 years Local network 100-1000 Mbps easily deployed Linux mature and widely available Software available and even standardized - MPI
Petnica, March 4, 2007. Free Scientific Computing
Why do we need GridWhy do we need Grid Dramatically increasing efficiency Easy ti install Easy to maintenance Easy to use Easy to upgrade
Petnica, March 4, 2007. Free Scientific Computing
Making Grid to workMaking Grid to work – problems – problems 1/51/5 Too hard to keep track of authentication data (ID/password) across
institutions SOLUTION: VOs
Too hard to monitor system and application status across institutions SOLUTION: Grid Monitoring Tools
Too many ways to submit jobs SOLUTION: GDL - Grid Description Language
Too many ways to store, access & keep track of files and data SOLUTION: LFC – Logical Filename Catalog
Petnica, March 4, 2007. Free Scientific Computing
Making Grid to workMaking Grid to work – VOs – VOs 2/52/5
ComputingCenter
VO ComputingCenter
Service
Petnica, March 4, 2007. Free Scientific Computing
Making Grid to workMaking Grid to work – Grid Site – Grid Site 3/53/5
InformationServices
Computingelement
Storageelement
Disk poolWorkernodes
Petnica, March 4, 2007. Free Scientific Computing
Making Grid to workMaking Grid to work – What really happens? – What really happens? 4/54/5
ReplicaReplicaCatalogueCatalogue
Logging &Logging &Book-keepingBook-keeping
WorkloadWorkloadmanagementmanagementSystemSystem
ComputingComputingElementElement
Job Status
DataSets info
Auth.&Auth.
Job
Su
bm
it Even
t
Job
Qu
ery Job
Sta
tus
Input“sandbox”
Input “sandbox” +
Broker Info
Output “sandbox”
Output“sandbox”
Pu
blish
SE & CE info
User User interfaceinterface
Petnica, March 4, 2007. Free Scientific Computing
Making Grid to workMaking Grid to work – Middleware – Middleware 5/55/5 EDG – European Data Grid LCG – Large Hadron Collider Computing Grid gLite
Globus 2 based Web services based
EGEE-2EGEE-1LCG-2LCG-1
Petnica, March 4, 2007. Free Scientific Computing
EGEEEGEE Enabling Grids for eScience About 50 countries More than 220 sites About 40000 CPUs More than 13 PB storage
Petnica, March 4, 2007. Free Scientific Computing
SEE-GRIDSEE-GRID South East Europe GRID 13 countries
Greece – project lider, SEE-GRID CA, backup VOMS, Serbia – WP3 lider, RB, WMS, BDII, My proxy, LFC Turkey – WP4 lider, backup RB Croatia - WP4 lider, VOMS Hungary - pgrade Bosnia and Herzegovina – SAM tests Bulgaria - Registry FYR of Macedonia – Gridice Romania - Security Albania, Moldavia, Switzerland
About 30 sites About 430 CPUs More than 13 TB storage
Petnica, March 4, 2007. Free Scientific Computing
AEGIS01-PHY-SCLAEGIS01-PHY-SCL 1/5 1/5 Scientific Computing Laboratory, Institute of Physics, Belgrade wns: 100 CPU – 25x dual dual Xeon 2.8GHz, 1GB RAM services: CE, gCE, SE core services: RB, WMS, VOMS, BDII, MyProxy VOs: AEGIS, Atlas, CMS, ESR, Dteam, SEE-GRID, SEE, OPS
Petnica, March 4, 2007. Free Scientific Computing
AEGIS02-RCUBAEGIS02-RCUB 2/5 2/5 RCUB, University of Belgrade scavenger wns: 14 CPU 2.0GHz AMD Sempron, 1GB RAM services: CE, SE core services: LFC VOs: AEGIS, SEE-GRID, Dteam, SGDemo
Petnica, March 4, 2007. Free Scientific Computing
AEGIS03-ELEF-LEDAAEGIS03-ELEF-LEDA 3/5 3/5 Laboratory for Electronic Design Automation, Faculty of Electric
Engineering, University of Nis wns: 4 CPU PIV 2.4GHz, 512MB RAM services: CE, SE VOs: Aegis, SEE-GRID, Dteam
Petnica, March 4, 2007. Free Scientific Computing
AEGIS04-KGAEGIS04-KG 4/5 4/5 Center for Scientific Research, University of Kragujevac wns: 8 CPU PIV 1.7GHz, 1GB RAM services: CE, SE, gCE VOs: AEGIS, SEE-GRID, Dteam
Petnica, March 4, 2007. Free Scientific Computing
AEGIS05-ETFBGAEGIS05-ETFBG 5/5 5/5 School of Electrical Engineering, University of Belgrade scavenger wns: 30 CPU 2.6GHz AMD Sempron, 1GB RAM services: CE, SE