Upload
janet
View
40
Download
0
Embed Size (px)
DESCRIPTION
HPC at INRIA. Thierry Priol INRIA Scientific Deputy Director Research Department European Partnerships Department Myriads IPT. French Institute for Research in Computer Science and Control. Information and Communication Sciences and Technologies Research Experiment Transfer and innovate - PowerPoint PPT Presentation
Citation preview
1
HPC at INRIA
Thierry PriolINRIA Scientific Deputy Director
Research DepartmentEuropean Partnerships DepartmentMyriads IPT
2
French Institute for Researchin Computer Science and Control
Information and Communication Sciences and Technologies • Research• Experiment• Transfer and innovate• Share and disseminate• Create references
A public institution of a scientific and technological character, and under the dual authority of the Ministry of Research and the Ministry of Industry
3
2,800 scientists1300 researchers and teaching-researchers1000 Ph.D. students500 postdoctoral fellows
8 research centers in France80 associated teams throughout the world4 300 scientific publications24 international conferences
230 active patents
96 innovative companies created
60 software deposited in 2008
INRIA today
On 1st January 2009
3,900 people A budget of €190 M before taxesOf which more than 20% from external resources
4
INRIA NancyGrand Est
INRIA Grenoble Rhône-Alpes
INRIA Sophia AntipolisMéditerranée
INRIA RennesBretagne Atlantique
INRIA BordeauxSud-Ouest
INRIA LilleNord Europe
INRIASaclayÎle-de-France
INRIA ParisRocquencourt
INRIA’s Research Centers
5An original research model: The INRIA Project-Teams
• From 15 to 20 people, with a scientific leader
• A focused scientific theme
• A limited lifespan: 8 years on average
• Medium-term objectives and work program
• Joint projects with industrial and scientific partners in France and around the world
• Financial and scientific autonomy
• From research to transfer
• A priori and a posteriori evaluation
198 INRIA Project-Teams & Teams in 2020
with the majority in partnership
An organization that complements the universities
6
INRIA Research Areas
• Applied Mathematics, Computation and Simulation
• Algorithmics, Programming, Software and Architecture
• Networks, Systems and Services, Distributed Computing
• Perception, Cognition, Interaction
• Computational Sciences for Biology, Medicine and the Environment
7
INRIA strategy in HPC• INRIA has the research potential to be a leader of HPC in Europe
• Culture of multidisciplinary research
• Culture of mixing methodologies within computer science (Strong collaborations between theoretical and experimental research)
• Culture of exploration tools (testbed)
• National initiatives• 2/3 of the ANR (French NSF) projects related to HPC include INRIA researchers
• Collaboration with Bull on Supercomputer design
• Strategic Partnership with EDF on simulation
• Collaboration with CEA on key system software (Kadeploy) for Supercomputers
• French Strategic Committee on HPC: ORAP, TER@TEC
• Collaborate in the establishment of the « House of Simulation », Grand Paris, …
• Participation to GENCI
• « Grand emprunt »…
8
HPC within INRIA Research Areas
• Applied Mathematics, Computation and Simulation• Computational models and simulation
• Algorithmics, Programming, Software and Architecture• Architecture and Compiling
• Networks, Systems and Services, Distributed Computing• Distributed and High Performance Computing
9
HPC research at INRIAFrom Computer Arithmetic to Scientific Platform
Compilation for processors, Multi-core & GPU
Single System Image
Microprocessor design
Computer Arithmetic
Runtime environments
Computing & Communication Libraries
Batch Schedulers
Mathematical Methods
Mesh generation
Computing Models
Scientific software platform (Scilab)
Modeling molecules
Scientific visualization; Visual analytics
Scientific Visualization(e.g. Plasma Physic)
Earth reconstruction(inverse problems)
Cardiac imaging and simulation
Modeling Tissue Growth
Modeling microprocessortemperature Modeling Air quality
Platform for numerical computation
MUMPS Parallel sparse direct Solver
PM2 Runtime Environment
Kerrighed Single System Image
Batch SchedulerFault tolerant MPI
Automatic Mesh Generation
Middleware forCyber infrastructures
SUPERLU
general purpose library
10
INRIA Project-Teams (37 IPT)
• Numerical simulation and HPC (17 IPT): numerical analysis,mesh generation, LA solvers, coupling, multi-scale, uncertainties
• Visualization/interaction (3 IPT): post-process, collaborative work
• Programming (18 IPT): models, compilers, code generation, GPGPU (hybrid architectures)
• Middleware/runtime/OS (10 IPT): virtualization, SSI, fault-tolerance, energy management, grid for HPC
11
INRIA NancyGrand Est
INRIA Grenoble Rhône-Alpes
INRIA Sophia AntipolisMéditerranée
INRIA RennesBretagne Atlantique
INRIA BordeauxSud-Ouest
INRIA LilleNord Europe
INRIASaclayÎle-de-France
INRIA ParisRocquencourt
Some project-teams involved in HPC activities
PARIS: operating systemsSAGE: scientific computingALF: multicore/GPU
PARIS: operating systemsSAGE: scientific computingALF: multicore/GPU
HIEPACS: scientific computingRUNTIME: communication/threadsCEPAGE: task management
HIEPACS: scientific computingRUNTIME: communication/threadsCEPAGE: task management
MOAIS: scheduling & programmingMESCAL: models & toolsGRAAL: middleware & programming
MOAIS: scheduling & programmingMESCAL: models & toolsGRAAL: middleware & programming
GRAND-LARGE: large scale parallel computingALCHEMY: compilers & programming
GRAND-LARGE: large scale parallel computingALCHEMY: compilers & programming
ALGORILLE: algorithms & modelsALGORILLE: algorithms & models
NACHOS: scientific computingOASIS: programmingOPALE: scientific computing
NACHOS: scientific computingOASIS: programmingOPALE: scientific computing
DOLPHIN: combinatorial problemsDOLPHIN: combinatorial problems
12
www.grid5000.frwww.grid5000.fr
Developed since 2003:• A nationwide experimental platform for Large scale experiments
The main feature is Grid’5000 is the level of control it provides to users who can reconfigure the soft stack on every node
>400 active Users Coming from >70 Laboratories>400 publications including Ph.Ds, HDRs, etc.>400 experiments done or planned (including >100 applications)
External impacts:• Used for testing of OpenMPI• Kadeploy to be used as the deployment tool for TERA100
Map of Grid’5000
Ray2Mesh:first non trivial MPI
applicationScaling linearly
On Grid’5000
Many success stories in combinatorial optimizations:-solve the n-Queens problem for n=25, in 2005-solve (exact solution) of the flowshop Ta056-50-20 instance
one of the most remarkable one, in 2008:Grid’5000 was used to design and improve the algorithm used in the first computer victory against a professional Go player (9x9) in the last Paris tournament!
ALADDIN/Grid’5000: Nation wide experimental platform
An Example of INRIA Specificity
13
INRIA strategy in HPC• INRIA has the research potential to be a leader of HPC in Europe
• Culture of multidisciplinary research
• Culture of mixing methodologies within computer science (Strong collaborations between theoretical and experimental research)
• Culture of exploration tools (testbed)
• National initiatives• 2/3 of the ANR (French NSF) projects related to HPC include INRIA researchers
• Collaboration with Bull on Supercomputer design
• Strategic Partnership with EDF on simulation
• Collaboration with CEA on key system software (Kadeploy) for Supercomputers
• French Strategic Committee on HPC: ORAP, TER@TEC
• Collaborate in the establishment of the « House of Simulation », Grand Paris, …
• Participation to GENCI
14
ANR supports HPC!
• HPC is seen as an important challenge to increase the competitiveness of the industry and the development of science
• Numerical simulation is the third pillar (in silicio) to develop knowledge (in vitro and in vivo experimentations, theory)
• Numerical simulation paves the way for new scientific discoveries
• Available 2009 funding:• Programme COSINUS – Numerical simulation
• Programme BLANC / JCJC – long term, young researchers
• Programme Materials & Processes – multiscale simulation
• Programme ARPEGE – large-scale infrastructures
• Programme DEFIS – Architectures, algorithms, languages
• Programme P3N (nano) – simulation for nanomaterials
• And in other programmes….
http://www.agence-nationale-recherche.fr:
15
“Les cahiers de l’ANR” - HPC
• N° 3 of the ANR book series
• Presentation of 80+ projects
• Introduction to domains• Infrastructures
• Tools
• Librairies
• Applications
• Available in French
16
Some numbers
• Count done for preparing ANR’s « HPC book »• 219 projects using or doing HPC
• 92 in the ICST dept
• 82 in the Nonthematic Dept
• 86 Projects have sent a one-page presentation as of today• 34 in the ICST dept
• 26 in the Nonthematic Dept
• 2005-2008: > 100M€ funding (>25M€/y.)
17
18
19
2010 ANR Calls
• COSINUS – Numerical simulation - Feb 2010
• Embedded System and Large infrastructures – Feb 2010
• Non-thematic programme (Blanc) – Jan 2010
• The G8 Research Councils Initiative on Multilateral Research Funding
• Interdisciplinary Program on Application Software towards Exascale Computing for Global Scale Issues – May 7th
20
INRIA strategy in HPC• INRIA has the research potential to be a leader of HPC in Europe
• Culture of multidisciplinary research
• Culture of mixing methodologies within computer science (Strong collaborations between theoretical and experimental research)
• Culture of exploration tools (testbed)
• National initiatives• 2/3 of the ANR (French NSF) projects related to HPC include INRIA researchers
• Collaboration with Bull on Supercomputer design
• Strategic Partnership with EDF on simulation
• Collaboration with CEA on key system software (Kadeploy) for Supercomputers
• French Strategic Committee on HPC: ORAP, TER@TEC
• Collaborate in the establishment of the « House of Simulation », Grand Paris, …
• Participation to GENCI
21Grand Equipement Nationalde Calcul Intensif
Centre National Jacques-Louis Lions
20% 10% 49% 20% 1%
22
Bruyères-le-Châtel
100 km
Centre
Nat
ional
Jacq
ues-L
ouis
Lions
Montpellier
Open supercomputer centres
23Total capacity of Tier1 HPC ressources available for the french scientific community in 2010
0
100
200
300
400
500
600
MPPSMP
VectorielTotal
GPU
139
451
7
596
192
2010
2010
NEC SX8 Brodie (IDRIS)NEC SX8R-SX9 Mercure (CCRT)
Cluster BULL Titane (CCRT)
Cluster SGI ICE Jade (CINES)Cluster IBM Hera (CINES)Cluster BULL Titane (CCRT)Cluster BULL Platine (CCRT)Cluster IBM Vargas (IDRIS)
IBM BG/P Babel (IDRIS)
596 T596 Tfflopslops
3 Computer 3 Computer CentresCentres
Comprehensive Comprehensive set of system set of system architecturesarchitectures
24Allocation of HPC resources : a single coordinated process at the national level
Requests from shareholders
Orientation CSCI
Annual reports by HPC centres
Reserved resources
Resources to be distributed trough two annual sessions
Submission
Peer-review based on scientific and technical excellence by an
Evaluation Committee (10 Thematic Committees)
Allocation Committee : decisions based on transparent and clear
criteria
Reserved parts for shareholders
Reserved parts allocated to industrial projects
Orientations
25
Others Missions
To promote simulation and high performance computingin fundamental and industrial research
To promote the organization of an European HPC area and to participate to its achievements
To open its equipments to all interested scientific communities, academic or industrial, national, european or international
26
INRIA strategy in HPC (cont’d)
• European• Participation to PRACE-1IP (within GENCI)
• Participation to EESI (Exascale initiative led by EDF R&D)
• International• Associated teams with key HPC players
• Joint laboratory with UIUC-NCSA
27
INRIA and the Joint-Lab on PetaScale Computing
• Research and development in for Peta-ExaScale HPC needs international collaborations
• PetaScale Software are already raising many significant research problems
• ExaScale system design will open a very large domain of research and will require a huge effort from the community
• Projects like PRACE in Europe and IESP at the international level help establishing clear roadmaps and focusing on the right problems
• The economic situation is a threat for very large, single country, projects
• UIUC and NCSA with the BlueWaters project are in the forefront of research and development for Sustained PetaScale
• Strong opportunity for INRIA researchers to participate and contribute to the research on Key algorithmic and software challenges in PetaScale computing.
• Sustained PetaScale means a clear understanding of the applications and the design of truly scalable software
• May increase at INRIA the facet of HPC Research related to production
28
Technology Transfer
• A stream of Spin-offs• Kerlabs (OS)
• Caps Entreprise (GPGPUs compiler)
• ActiveEon (distributed objects for HPC)
• SysFera (Tools)
• INRIA/GENCI Initiative, with French competitiveness clusters, « national coordinated HPC program for SMEs »
29
To get more information
• project team-leaders involved in HPC
• Deputy Scientific Directors• Bernard Espiau (Applied Mathematics, Computation and Simulation)
• Hélène Kirchner (Algorithmics, Programming, Software and Architecture)
• Thierry Priol (Networks, Systems and Services, Distributed Computing)