Embed Size (px)
Citation preview
SUSE® High Performance Computing
Eduardo DiazPreSales
SUSE Linux Enterprise
Alberto EstebanTerritory Manager North-East
SUSE Linux Enterprise
2
HPC OverviewSUSE® High Performance Computing
• Solving computational, data-intensive, or numerically-intensive tasks
• Reducing the time and effort required to set-up and maintain HPC clusters
• Ensuring that all components of the HPC stack work together
3
HIGH PRODUCTIVITY COMPUTING
TotalBaker Hughes
Texas Instruments…..
MULTI- and MANY-CORE PROCESSOR SUPPORT
Intel, AMD,POWER
…..
TECHNOLOGY
Kernel 3.xLustre File System
Ceph storage platformHighly scalable - up to
4096 cores…..
COOPERATION
IBMSGIHPDell…..
ACADEMIC AND RESEARCH
LRZ / SuperMUCBSC / MareNostrum
Tokyo Institute of TechnologyBeijing Computing Center
NASA…..
SUSESince 1992
Strong Presence in Top500
BullNECCrayCisco…..
SUSE – Strong in HPC Market!SUSE® HPC
4
Why SUSE® Linux Enterprise ServerFor High Performance Computing
• Early player in HPC, pushing innovation and new technologies
• Highly reliable, interoperable and manageable server operating system
• Built to power mission-critical workloads in physical, virtual and cloud environments
• The natural successor to UNIX, backed by proven services for UNIX migration
• Special features to improve performance
• Backed by established ecosystem – support and certificates
• The only Linux recommended by Microsoft
5
• Up-to-date 3.0 Linux Kernel for optimal performance
• CPU Management and System Activity‒ CPUset System, CPUset command line tool
‒ Sysstat package
‒ IRQbalance
• OpenFabrics Enterprise Distribution (OFED)‒ Remote Direct Memory Access (RDMA) switched fabric
technologies, high-speed data transport technologies for server and storage connectivity
• SystemTap, LTTng 2.0
• Packaged Lustre
SUSE Additional FeaturesSUSE® High Performance Computing
6
Recent EnhancementsSUSE® High Performance Computing
• Storage‒ Support for btrfs
‒ Improved support for iSCSI and FCoE
‒ Major filesystem performance increases
• Management‒ Faster, more powerful
control groups for resource isolation
‒ Improved power management
• Kernel‒ Newest processors and
chipsets
‒ Better idle-load balancing
‒ Transparent huge pages
‒ Improved scaling of incoming network traffic
• Network‒ Higher network throughput
‒ Added tunables in the IP stack (for lower latency)
7
HPC StackSUSE® High Performance Computing
SUSE Linux Enterprise Server
Network
OFED10G
Storage
OCFS2 NFS
Message Passing InterfaceMPI
SGIIntelParastation
GPFS
Hardware
Queuing / ManagementSoftware & Tools
Application
IBRIX
= SUSE Partner= SUSE supported = SUSE future
cephFS
pNFS
pNFS
EXT3 XFS BTRFS
TCP offload MPICH openMPI
HP
PBS Pro Moab IBM LSF Bright CM
Lustre
8
SUSE® Studio Onsite –HPC Image Creator, use for free in: www.susestudio.com
• SUSE Studio Onsite is a web application for building and testing software appliances in a web browser
‒ build your own application images or appliances based on SUSE Linux Enterprise
‒ test-drive your software appliances➔ acts as a web UI to KIWI image builder with multi-user support
9
• Manage both SUSE Linux Enterprise and Red Hat Enterprise Linux and Centos servers with a single centralized solution
• Automated and cost-effective software management, system provisioning/configuration/auditing and monitoring capabilities
• Manage Linux server deployments across physical, virtual and cloud environments
SUSE® Manager
SUSE Manager
10
SUSE Cloud 2.0 Overview• Based on OpenStack Grizzly
‒ New features and fixes
• Mixed hypervisor support‒ Use existing infrastructure and lower costs
• Enhanced set-up and management capabilities
‒ Improves ease of use and installation
• Plug-in model for vendor integration‒ Storage: Ceph, NetApp, EMC
‒ Networking: Cisco, Open vSwitch, VLAN bridging
• Suse Coud 3.0 Beta 1 now (Havana)
11
SUSE Cloud 2.0
12
• Local storage
‒ Maintain existing capabilities (e.g. EXT3, XFS)
‒ Full btrfs support, improving manageability
‒ Maximum flexibility for customers
• Expand network filesystem capabilities (NFSv4.x/pNFS)‒ Improve performance, reliability and security
‒ pNFS client support, server support for later version of SUSE Linux Enterprise
File Systems – TodaySUSE High Performance Computing
13
• Integrated Volume Management
• Support for copy on write
• Powerful snapshot capabilities
• Scalability
• Other Capabilities:‒ Compression
‒ Data integrity (checksums)
‒ SSD optimization
• Status:‒ SLE 11: Fully supported
‒ SLE 12:Planned as default file system
File Systems – BTRFSSUSE High Performance Computing
14
• OCFS2‒ Superior cluster file system for up to 32 nodes
‒ Scalable network access via CTDB
‒ Used for big storage and user directories
• GPFS
‒ 3rd party offering by IBM
• IBRIX
‒ 3rd party offering by HP
File Systems – ClusterSUSE High Performance Computing
15
• SUSE sponsored and developed
• Maintenance Release 2.1‒ Available for SUSE Linux Enterprise Server 11 SP1+
• Maintenance Release 2.4‒ Aailable for SUSE Linux Enterprise Server 11 SP2+
• Client already accepted by Whamcloud(http://downloads.whamcloud.com)
http://drivers.suse.com/lustre/
Community – LustreSUSE High Performance Computing
Storage Options
17
• Ceph is a scalable open source storage platform comprised of an object store (Rados), block store (RDB),a POSIX-compatible distributed file system (Ceph FS), and an Amazon S3 integration
• Ceph has been integrated with OpenStack and is included in the Linux kernel
File Systems – CEPHSUSE High Performance Computing
18
• Maintenance Release 2.1‒ Available for SUSE Linux Enterprise Server 11 SP1+
• Maintenance Release 2.4‒ Available for SUSE Linux Enterprise Server 11 SP2+
• Client already accepted by Whamcloud (http://downloads.whamcloud.com)
• SUSE sponsored and developed port provided to the community
http://drivers.suse.com/lustre/
File Systems – LustreSUSE High Performance Computing
Thank you.
19
www.suse.com/products/server/hpc.html
Learn more
Corporate HeadquartersMaxfeldstrasse 590409 NurembergGermany
+49 911 740 53 0 (Worldwide)www.suse.com
Join us on:www.opensuse.org
20
