Embed Size (px)
Citation preview
Co-funded bythe European Union
Co-funded bythe European Union
Fenix User Forum meetingParallel Session 1
Fenix User Forum meeting – outline
Welcome and introduction Anne Nahm, JUELICH
ICEI services overview and update Jacques-Charles Lafoucriere, CEA
Examples for how to use ICEI Alex Upton, CSCS
Fenix User Forum Javier Bartolomé, BSC
Discussion and questions Cristiano Padrin, CINECA
• BSC (Barcelona, ES)
• CEA (Bruyeres-le-Chatel, FR)
• CINECA (Bologna, IT)
• CSCS (Lugano, CH)
• JSC (Jülich, DE)
Introduction: Fenix & ICEI
5 supercomputing centres (PRACE Hosting Members)
Build the Fenix infrastructure
Project partners in ICEI*
* Interactive Computing E-Infrastructure for the Human Brain Project
-> Specific Grant Agreement under the umbrella of the HBP Framework Partnership Agreement
Introduction: Concept of Fenix
Layered approach for e-infrastructure service provisioning:
HBP Platform/EBRAINS Services
that build on/use
Fenix Infrastructure Services
Fenix Infrastructure Services for
HBP and European researchers
Introduction: Access to resources and Fenix User Forum
• Access to Fenix Infrastructure Services:
25 % of available resources are reserved for HBP
Resources need to be requested
Light-weight review process for small projects
• The Fenix User Forum = Opportunity for you as a user to engage
fenix-ri.eu🌐
ICEI services overview and updateJacques-Charles Lafoucriere (CEA)
Fenix infrastructure – overview
• Federated computing and data services for European researchers
• Data storage and scalable computing resources in close proximity to each other and tightly integrated
• Service-oriented provisioning of resources, aiming to
• Meet the requirements of various science communities
• Form a basis for the development and operation of community-specific platform tools and services
• Federation of infrastructure services to optimize for data locality, enhance availability and broaden variety of services
Fenix infrastructure – User resources (1)
• Scalable Computing Services
• Access to Europe's largest HPC systems
• Large parallel simulations or data analysis
• Interactive Computing Services
• No delay access to single servers
• Interactive use
• Virtual Machine Services
• VM deployment service
• User defined VM allocation time
Fenix infrastructure – User resources (2)
• Active Data Repositories
• Site-local data store
• File based interface (parallel file systems)
• Object storage interface (OpenStack swift)
• Archival Data Repositories
• Federated data store for long-term storage
• Object store interface (OpenStack swift)
Fenix infrastructure – Infrastructure services (1)
• Authentication and Authorization Infrastructure (AAI)
• Central user identification and authentication
• Used to access Fenix/ICEI resources
• Fenix User and Resource Management Service (FURMS)
• Central management of user roles and membership
• Community resource allocation and accounting
Fenix infrastructure – Infrastructure services (2)
• Data Location and Transfer Services
• Enable Fenix users to locate their data
• Enable Fenix users to move their data between centres
• Data Mover Services
• Enable Fenix users to move data inside centres between Data Repositories
• Same way to move data in all centres
Fenix infrastructure – Usages
• Compute and data analysis
• Interactive usage (“on demand”)
• Store data with different classes of service
• Data comes from simulation or from instruments
• Run user-defined virtual machines
• For permanent services
• For some pre-defined time for a specific service or data processing
Fenix infrastructure – Available resources
Resources at other centres will become available within the next months
See details at https://fenix-ri.eu/infrastructure/resources
Service ComponentICEI Total Allocation
(100%)Available Resources
(quarterly)1
Scalable Compute Piz Daint Multicore 250 nodes 465’375 node-hrs
Scalable + Interactive
ComputePiz Daint Hybrid 400 nodes 744’600 node-hrs
Virtual Machines OpenStack IaaS 35 servers 35 servers
Long-term StoragePOSIX, Object and
Tape4 PB 4 PB
Temporary StorageLow-Latency
Storage Tier80 TB 80 TB
1 Amount of available resources is subject to change
Fenix infrastructure services are currently available at CSCS:
Examples for how to use ICEIAlex Upton (CSCS)
What is ICEI being used for?
23 projects from HBP members that are making use of ICEI resources at CSCS
• These are approximately categorised as follows:
• 7 ‘small’ scalable compute projects (up to 4,999 hours per quarter)
• 7 ‘medium’ scalable compute projects (between 5,000 and 19,999 node hours per quarter)
• 4 ‘large’ scalable compute projects (20,000+ node hours per quarter)
• 5 ‘cloud compute’ projects (using Pollux OpenStack)
• Wide variety of projects, ranging from neurorobotics to cerebellum modelling to neuromorphic computing front-end
Examples of running projects
• The next slides, detail three examples of running projects
• ich002: Full-scale hippocampus model (PI: M. Migliore)
• ich006: NEST network construction and simulation (PI: H. E. Plesser)
• ich009: Neuromorphic Computing Front-end Services (PI: A Davison)
• The offering of ICEI/Fenix services supports variety of uses across multiple fields of neuroscience
ich002: Full-scale hippocampus model
• Detailed model of rat Hippocampus CA1 region with 460,000 neurons, includes input projections from CA3 region
• Studies conditions under which travelling waves of activity at theta rhythm emerge and how they interact with external inputs to perform cognitive functions
• Major and unique contribution to the field
• Model requires a minimum of 25,000 cores (approx. 700 nodes) to run on the Piz Daint multicore partition
ich002: Full-scale hippocampus model
In simulation above from the HBP Hippocampus Team, 0.5 secs of simulation time generated 1Tb of data and required 2hr15min to run
ich006: NEST network construction and simulation
• Simulations are essential in neuroscience, specifically the NEST simulator is a key tool for network simulation in HBP
• This project tests, benchmarks and optimises NEST network construction and simulation for the benefit of users of large scale cellular level simulation
• Comprehensive set of benchmarks with a focus on connectivity generation, automated using the JUBE tool
• Performance issues in NEST 2.16.0 identified and addressed, which have been subsequently removed in NEST 2.18.0
ich006: NEST network construction and simulation
Above plot shows the performance of different versions of NEST on Piz Daintusing different numbers of virtual processes
ich009: Neuromorphic Computing Front-end Services
• Migration of neuromorphic computing servers from commercial provider to ICEI resources
• Amongst others, the following is running on the ICEI VMs:
• Job Queue REST API
• Resource Manager REST API
• Benchmarking REST API
• Collaboratory apps inc. Job Manager, PyNN Network Builder, Benchmark results viewer and Job statistics dashboard
• Before end of SGA2, plan to deploy load balancer in front of the Job Queue API, and to deploy a centralised logging/monitoring server (based on the ELK stack)
ich009: Neuromorphic Computing Front-end Services
Fenix User ForumJavier Bartolomé (BSC)
Fenix User Forum
An online forum and set of relevant engagement activities directed to users
Objectives:
To establish a communication channel between Fenix resource providers and Fenix users on:
Current and future user needs
Experiences and best practices for using the Fenix infrastructure
User satisfaction
Fenix User Forum
An online forum and set of relevant engagement activities directed to users
Members:
Fenix users (including current, potential and rejected users)
Fenix resource providers
EBRAINS Infrastructure Allocation Committee (IAC) and other members of resource allocation committees
Other people interested in using ICEI/Fenix infrastructure services
Fenix User Forum: Using the platform
Post content, ask
questions, make
comments, participate
in discussions
Access documentation and
presentations
Join events like
webinars and Fenix
User Forum
meetings
Fenix User Forum: Signing up
Sign up by submitting a form
on the Fenix webpage
https://fenix-ri.eu/infrastructure/fenix-user-forum
Discussion and questionsCristiano Padrin (CINECA)
@Fenix_RI_eu
fenix-ri.eu🌐
Contact:
Co-funded bythe European Union
