SERVER AGGREGATION CREATING THE POWER OF ONE · •OpenEye FRED •OpenEye OMEGA •Schrödinger Jaguar •Schrödinger Glide •SCM ADF •VASP ... Solutions 4 2/10/2012 . Confidential

Confidential and Proprietary

THE HIGH-END VIRTUALIZATION COMPANY SERVER AGGREGATION – CREATING THE POWER OF ONE

ScaleMP Introduction


300+ Customers Worldwide

Israel

Qatar India

China

Brazil

South Africa

Canada

US

Russia

Spain

France

Belgium

Denmark

UK

Korea

HK

Vietnam

Malaysi

a

Taiwan

Poland

Italy

German

y NL

Australi

a

Norway

Japan

Creating the Power of One

1 VM 1 OS N x Servers N x OS

2/10/2012

ScaleMP Fact-sheet

Founded in 2003

Software-based Shared-memory System

Single VM across 128 systems: 16384 CPUs, 64 TB RAM

Processor and interconnect agnostic

Product shipping since 2006

Channel-only business model

300+ customers worldwide


Selected Customers and Applications

2/10/2012

Life Sciences Computational Chemistry

•AMBER

•CFOUR

•DOCK

•GAMESS

•Gaussian

•GOLD

•NWChem

•Octopus

•OpenEye FRED

•OpenEye OMEGA

•Schrödinger Jaguar

•Schrödinger Glide

•SCM ADF

•VASP Molecular Dynamics

•GROMACS

•MOLPRO

•NAMD

•OpenEye ROCS

•Schrödinger Desmond

•Turbomole

Numerical Simulations

•Octave

•R

•MathWorks MATLAB

•Wolfram Mathematica

Manufacturing Structural Mechanics

•ABAQUS/Explicit

•ABAQUS/Standard

•ALTAIR Radios

•ANSYS Mechanical

•LSTC LS-DYNA

•NASTRAN

•TNO Diana Fluid Dynamics

•ANSYS CFX

•AVL FIRE

•EXA PowerFlow

•EZNSS

•FLUENT (+TGrid)

•GeoDict

•MHD3D

•NASA Cart3D

•STAR-CCM+

•STAR-CD

•Tgrid Other

•Comsol

• inTrace OpenRT

Energy • IMEX

•Norsar 3D

•Paradigm GeoDepth

•Schlumberger ECLIPSE

EDA •Cadence

•HSPICE

•Mentor

•Quartus

•Silvaco SmartSpice

•Synopsys

Bio-informatics •454/Newbler

•Abyss

•Bowtie

•CLC Bio

•FASTA

•HMMER

• Illumina

•mpiBLAST

•SOAPDenovo

•Velvet

Weather Forecasting

•MITgcm

•MM5 (MPI & OpenMP)

•MOM4

•WRF

Finance •KX

•Wombat

…and many more homegrown applications

http://en.wikipedia.org/wiki/Image:NorthropGrummanLogo.png

http://en.wikipedia.org/wiki/Image:Dunlop_tyres.svg

http://en.wikipedia.org/wiki/Image:Honeywell_logo.svg

http://en.wikipedia.org/wiki/File:Naval_Research_Laboratory.png

http://images.google.com/imgres?imgurl=http://www.tcnj.edu/~teamdpx/DPX II/images/Logos/pppl_logo.jpg&imgrefurl=http://www.tcnj.edu/~teamdpx/DPX II/Home2.html&usg=__X4orpqIVPwXPwEBZYfxvhVcCGYM=&h=300&w=750&sz=54&hl=en&start=1&um=1&tbnid=ldjFqN8maJ7myM:&tbnh=56&tbnw=141&prev=/images?q=pppl&hl=en&rls=com.microsoft:en-us&um=1

http://upload.wikimedia.org/wikipedia/en/8/8d/Idf_logo4.jpg

http://en.wikipedia.org/wiki/Image:Total_SA_Logo.svg

http://en.wikipedia.org/wiki/Image:Total_SA_Logo.svg

http://en.wikipedia.org/wiki/Image:Official_Yale_Shield.png

http://en.wikipedia.org/wiki/Image:Cornell_emblem.png

http://en.wikipedia.org/wiki/File:Harvard_Wreath_Logo_1.svg


Server Virtualization

2/10/2012

Hypervisor or VMM

Virtual Machines

App

OS

App

OS

App

OS

Virtual Machine

App

OS

Hypervisor or VMM

Hypervisor or VMM

Hypervisor or VMM

Hypervisor or VMM

AGGREGATION Concatenation of physical resources

PARTITIONING Subset of the physical resources

http://images.google.com/imgres?imgurl=http://www.scalent.com/images/partners/XenSourceTM_logo.GIF&imgrefurl=http://www.scalent.com/html/partners/index.htm&usg=__EzRUAqHZ45ynhPh9Ux6tMa9rJv8=&h=423&w=993&sz=13&hl=en&start=8&um=1&tbnid=yxbP-eDd0_Y2xM:&tbnh=63&tbnw=149&prev=/images?q=xen&hl=en&rls=com.microsoft:en-us&sa=N&um=1

http://images.google.com/imgres?imgurl=http://www.btfl.com/Bayshoretraining/images/Image_Citrix_corporate_logo.jpg&imgrefurl=http://www.btfl.com/Bayshoretraining/University.asp&usg=__t_NG_5MqyURZapFS_PukvnwXR8c=&h=250&w=632&sz=14&hl=en&start=2&um=1&tbnid=VwdjdOjHc1au4M:&tbnh=54&tbnw=137&prev=/images?q=citrix&hl=en&rls=com.microsoft:en-us&um=1

http://images.google.com/imgres?imgurl=http://www.aiesec.org/australia/images/Partnerlogo/microsoft.jpg&imgrefurl=http://www.aiesec.org/australia/organizations/partners/&usg=__OXFsIMfVVXDv4IHrDEQf6QgniVM=&h=686&w=2846&sz=80&hl=en&start=2&um=1&tbnid=qXPGv2e2QgNLeM:&tbnh=36&tbnw=150&prev=/images?q=microsoft&hl=en&rls=com.microsoft:en-us&um=1

http://images.google.com/imgres?imgurl=http://www.nvp.com/images/companies/4991Qumranet_logo._web.jpg&imgrefurl=http://www.nvp.com/portfolio/investDrill.aspx?categoryID=12&usg=__PGjz5VW8MRQeBlq-9YVZbdGskeg=&h=37&w=150&sz=26&hl=en&start=15&um=1&tbnid=3rCVLU7I5x3jSM:&tbnh=24&tbnw=96&prev=/images?q=qumranet&hl=en&rls=com.microsoft:en-us&um=1

http://images.google.com/imgres?imgurl=http://www.rim.edu.bt/rhce/images/redhat.jpg&imgrefurl=http://www.rim.edu.bt/rhce/index.php&usg=__LiXECjM28PHWQZ-cQ6h8i641fms=&h=396&w=360&sz=63&hl=en&start=2&um=1&tbnid=mw3P22rAAis9PM:&tbnh=124&tbnw=113&prev=/images?q=redhat&hl=en&rls=com.microsoft:en-us&um=1


ScaleMP saves you

ScaleMP provides you with

By reducing CAPEX

Utilizing industry standard servers to create more powerful SMP systems

By lowering OPEX

Simplifying small cluster management by reducing complexity

2/10/2012

Increased flexibility

Providing cluster with on-demand SMP capability for mixed workload requirements

More performance

Utilizing the latest and fastest processor and memory technologies


Usage Models for Server Aggregation

2/10/2012

Large Memory I/O Intensive

Compute Intensive Consolidation

Virtual SMP

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

Operating System

App.

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

Operating System

App. App. App. App. App. App. App. App.

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

Operating System

App.

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

CPU CPU

I/O

Memory

Operating System

App.


Performance

2.1

2/10/2012

Confidential and Proprietary 2/10/2012

More benchmarks: http://www.ScaleMP.com/performance

http://www.scalemp.com/performance



9,2

97

14

,07

8

23

,35

2

40

,46

9

80

,21

5

15

9,7

27

31

7,3

47

62

7,3

46

1,2

47

,17

5

1,5

90

,38

3

2,2

59

,70

9

100%

76%

42%

36% 36% 36% 36% 35% 35% 33% 32%

100% 99% 99% 98% 97% 96%

92%

87%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0

500,000

1,000,000

1,500,000

2,000,000

2,500,000

1 2 6 12 24 48 96 192 384 512 768

Effi

cie

ncy

MB

/Se

c

# Cores

STREAM-OMP (Triad)

Triad (MB/s)

Efficiency (CPU)

Efficiency (Board)

2/10/2012









See more performance info at http://www.ScaleMP.com/performance

2/10/2012




Products

3

2/10/2012


Products Comparison

2/10/2012

Flexibility Scalability

Performance Licensing

vSMP Foundation Advanced Platform

vSMP Foundation Advanced Platform

On-demand SMP Up to 128 nodes

Multi-rail InfiniBand Floating license

vSMP Foundation

vSMP Foundation

Static VM

Up to 32 nodes

Single-rail InfiniBand

Node-locked license

Virtual SMP

Detailed comparison: http://www.ScaleMP.com/compare

http://www.scalemp.com/compare




DEMO

Boot Process

2/10/2012


Boot Process

2/10/2012

2 Quad Core Processors

48 GB RAM vSMP Foundation loaded

from Network or Flash


Boot Process

2/10/2012

Total: 768 GB RAM 66 GB used by vSMP Foundation

VM will have 32 processors (128 cores)

16 nodes found


Loading the OS

2/10/2012

RHEL 5 boots Loading kernel




Solutions

4

2/10/2012


vSMP Foundation - Solutions

Single Operating System

OPEX savings

Cluster management and server

consolidation

Single (large) System

CAPEX savings

Compute and memory demanding

applications

Single Infrastructure

Flexibility (CAPEX and OPEX savings)

Cloud enabler – on-demand infrastructure

2/10/2012

vSMP Foundation for Cluster vSMP Foundation for SMP vSMP Foundation for Cloud


22

Simplified Clustering: • Single Operating System • Storage: –Fast internal storage – excellent for

scratch space –Eliminate the need for cluster file system

• Ease of programming: OpenMP, POSIX threads, MPI, PVM, Global Arrays, and any other common parallelism paradigms

• Versatile: Run jobs that require more memory than single physical server

• From unboxing to production in less than 3 hours

- 22 -


23

Highly Scalable Shared-memory System: • Up to 64TB RAM • Up to 16,384 CPUs • Support for latest CPU architecture • Ease of programming • Best price-performance

- 23 -


24

Unified Infrastructure for Mixed Workloads: • On demand SMP • No need for workload-dedicated systems: –Distributed applications use native nodes –Shared-memory use virtualized nodes

• Match workload requirements with system capabilities

• Provision and re-provision as needed: • Integrated with world’s best provisioning

systems: XCAT, CMU, ROCKS, Bright Cluster Manager and others

- 24 -


Legacy vs. On-Demand Infrastructure

Dedicated system for each business-need

Unified infrastructure + SW provisioning

Legacy HPC Infrastructure On-demand HPC Infrastructure

- 25 -


Legacy vs. On-Demand Infrastructure

Legacy On-Demand

System for each type of application: • Scale-out Cluster: Distributed codes, throughput

codes (batch)

• Scale-up Shared Memory System (SMP): Multi-threaded applications (OpenMP), large memory applications, data intensive applications

Single hardware infrastructure: • Create execution environment matching application

characteristics

• Provisioning system controls the nodes personality

Underutilization Dedicated shared-memory resources are under-utilized as many OpenMP codes do not scale over 64 cores.

Allocate resources as needed SMP is created per each project requirement. Otherwise-used resources are allocated for general cluster usage.

Clutter Multiple small-scale OpenMP projects share same system, interfering with each other.

Improved management SMP on demand (island) is created and allocated for each project requiring such a resource – just like on MPI cluster.

SMP System Cost Shared-memory system is far more expensive resource than the cluster (on per socket basis) and ends-up running MPI codes.

Cluster price point Nodes configured to run MPI codes by de-provisioning the virtual-SMP software.

2/10/2012


On-demand Infrastructure

• More capacity per $ – Single, cost-effective platform

across the board

• Increased utilization – Shape the resource to the

application usage model – Larger, unified and less-

fragmented run-queues

• Greater customer satisfaction – On-demand resource allocation

• Choice of provisioning system – Adaptive Computing’s MOAB – Bright Cluster Manager Suite – HP’s Insight CMU – IBM’s xCAT – ROCKS

2/10/2012

Create

Add Nodes

Run


THE HIGH-END VIRTUALIZATION COMPANY SERVER AGGREGATION – CREATING THE POWER OF ONE

[email protected]

Documents

SERVER AGGREGATION CREATING THE POWER OF ONE · •OpenEye FRED •OpenEye OMEGA •Schrödinger Jaguar •Schrödinger Glide •SCM ADF •VASP ... Solutions 4 2/10/2012 . Confidential