Embed Size (px)
Citation preview
High Productivity Computing With Windows
Windows HPC Server 2008
Product Unit ManagerWindows HPC ServerMicrosoft Corporation
Trends ImpactingHPC Landscape
Data Proliferation Management
• Data Explosion • Managing data
Control & Align Costs• Enmeshing of
Enterprise IT and HPC• System Management
Costs
Accelerate Innovation • Multi-core platforms • Heterogeneous systems
Make HPC Broadly Accessible• Upgrade IT skills • Easy access for end
users
Trends affecting HPC
Information workers
Corporate infrastructure
Today’s HPC Environment
Mainstream technologies
StorageHigh speed networking
Clusters/supercomputers
Financial analystsEngineersScientists
CompilersSpecialized languages Debuggers
Simplified parallel development
Integrated desktop and HPC environment
Combined infrastructure
Unified development environment
High Productivity Computing
HPC and IT data centers merge, streamlined cluster management
Users with broad access to multiple cores and servers
Microsoft Entry into HPC
Personal Super Computing Built on Windows Server 2003 Microsoft Entry into HPC Addressing Personal And Workgroup Needs End User Applications available for Windows Parallel and HPC Development Tools Ease of Management and Deployment
Microsoft HPC Server Today
Broad Reaching HPC Built on Windows Server 2008 Support Traditional & Emerging HPC Larger Cluster support & Top500 Range Better integration for Windows-based Users Broader Developer support with tools and SOA Improved Management and Deployment
Systems Management
Job Scheduling
Networking& MPI Storage
New System Center UI PowerShell for CLI ManagementHigh Availability for Head NodesWindows Deployment ServicesDiagnostics/ReportingSupport for Operations Manager
Support for SOA and WCF Granular resource scheduling Improved scalability for larger clusters New Job scheduling policiesInteroperability via HPC Profile
NetworkDirect (RDMA) for MPI Improved Network Configuration Wizard Shared Memory MS-MPI for multi-coreMS-MPI integrated with Windows Event Tracing
Improved iSCSI SAN & parallel file system Support in Win2008 Improved Server Message Block ( SMB v2) New 3rd party parallel file system support for Windows New Memory Cache Vendors
HPC Pack 2008 Overview
Ferrari: “We are always looking for the most advanced technological solutions and, of course, the same applies for software and engineering. To achieve industry leading power-to-weight ratios, reduction in gear change times, and revolutionary aerodynamics, we can rely on Windows HPC Server 2008.”
Gordon Bell: “Congratulations on making it into the HPC club! You guys have come a long way, especially since Bill’s Keynote at Supercomputing 2005 in Seattle.”
Microsoft HPC MOMENTUM
#10
Wall Street Journal: “The Cray HPC brand name and experience, combined with Microsoft's strategy of extending the familiar Windows environment upward to the server level, gives the Cray CX1 solution strong potential for exploiting the anticipated growth of this market segment.”
Ansys: “We have achieved some impressive performance gains on the latest solution from Microsoft. The combination of ANSYS software and Windows HPC Server 2008 enhances cluster computing as an option for our customers who need more HPC capacity.”
Gartner: “Windows HPC Server 2008 should be seriously considered as the sole operating environment or as an alternative mode side-by-side with Linux.”
HPCWire Editors’ Choice Award: “Best HPC software product or technology” –Windows HPC Server 2008
• Simple to setup and manage in a familiar environment– Turnkey cluster solutions through OEMs
– Simplify system and application deployment• Base images, patches, drivers, applications
• Focus on ease of management– Comprehensive diagnostics , troubleshooting and
monitoring
– Familiar, flexible and “pivotal” management interface
– Equivalent command line support for unattended management
• Scale up– Scale deployment, administration, infrastructure
– Head node failover
– Cluster usage reporting
– Compute node filtering
• Better integration with enterprise management– Patch Management
– System Center Operations Management
– PowerShell
– Windows 2008 high Availability Services
Improved Efficiency for the Systems Admin
• Priorities– Comparable with hardware-optimized MPI
stacks• Focus on MPI-Only Solution for version 2
– Verbs-based design for close fit with native, high-perf networking interfaces
– Coordinated w/ Win Networking team’s long-term plans
• Implementation– MS-MPIv2 capable of 4 networking paths:
• Shared Memory between processors on a motherboard
• TCP/IP Stack (“normal” Ethernet)• Winsock Direct (and SDP)
for sockets-based RDMA• New RDMA networking interface
– HPC team partners with networking IHVs to develop/distribute drivers for this new interface
User Mode
Kernel Mode
TCP/Ethernet Networking
Ker
nel B
y-P
ass
MPI AppSocket-Based
App
MS-MPI
Windows Sockets (Winsock + WSD)
Networking HardwareNetworking HardwareNetworking Hardware
Networking HardwareNetworking HardwareHardware Driver
Networking Hardware
Networking Hardware
Mini-port Driver
TCP
NDIS
IP
Networking HardwareNetworking HardwareUser Mode Access Layer
Networking Hardware
Networking Hardware
WinSock Direct Provider
Networking Hardware
Networking Hardware
NetworkDirect Provider
RDMA Networking
OS Component
CCP Component
IHV Component
(ISV) App
NetworkDirectA new RDMA networking interface built for speed and stability
App.exe App.exe Service(DLL)
Service(DLL)
Service(DLL)
Service(DLL)
App.exe App.exe
Engineering Applications
Structural AnalysisCrash Simulation
Oil & Gas Applications
Reservoir simulationSeismic Processing
Life Science Applications
Structural AnalysisCrash Simulation
Financial Services
Portfolio analysisRisk analysisComplianceActual
Excel
PricingModeling
InteractiveCluster Applications
Your applicationshere
Job Scheduler
Resource allocationProcess Launching
Resource usage trackingIntegrated MPI execution
Integrated Security
WCF Service Router
WS Virtual Endpoint ReferenceRequest load balancing
Integrated Service activationService life time management
Integrated WCF Tracing
V1 (focusing on batch jobs) V2 (focusing on Interactive jobs)
+
Scenario: Broaden Application Support
Single pack with HPL 1.0a + Intel math Kernel Lib
Tuning Wizard for Linpack
Demo
IT Pro Productivity
End User
Productivity
Developer Productivity
Boosting Developer Productivity- Visual Studio for Parallel Programming- Range of compilers/ libraries / debuggers and profilers for Visual Studio- Program SOA based workloads and deploy on Windows HPC using Visual Studio
Boosting End User Productivity- Rich Ecosystem of ISV applications100’s of applications are now integrated with Windows HPC Server-SharepointHPC oriented web parts for customizing Sharepoint integration with HPCS -XLRunner and UDF OffloadingScale long running Excel spreadsheets using Windows HPC Server
Boosting IT Pro Productivity- HPC Server built in tools- Enterprise management tools- MOAB Adaptive HPC Suite
Microsoft in HPC, A Solution Component
Jobs
Res
ults Head Node
Job Mgmt
Resource Mgmt
Cluster Mgmt
Scheduling
Parametric SweepsEnd user scheduling of long running calculations
Excel 14 using Excel RunnerOffice SharePoint
(Document Libraries)
Schedule Job
Customer Momentum
Windows HPC Tomorrow
Highly Scalable, Efficient HPC Built on Windows Server 2008 R2 Scalable HPC Infrastructure for 1000+ nodes Customizable management elements for superior control Evolved SOA support for scale and programmability Programming Patterns for HPC with Extensions .NET Continued support for integration with Microsoft Infrastructure
Parallel Extensions
2010
What’s coming in R2 Beta 1Windows HPC Server 2008 R2 dramatically increases the scale of HPC clusters with an out-of-the-box experience to deploy, manage and schedule large scale HPC systems.
Systems Management
JobScheduler
SOA Model
Scalability Ease of Use Efficiency• Reliable deployment at scale• Admin tool experience at scale• Support for enterprise
databases
• High volume job & task scheduling
• Dynamic parametric tasks
• Duplex Message Exchange Pattern
• Message persistence• Automated broker restart or
failover
• Heat map customization• Updated node template
and software patching wizard
• Filter by node location
• Job progress tracking • Node prep and release tasks• Streamlined job
troubleshooting • Improved password
management
• Fire & Recollect SOA jobs• Out-of-the-box setup for broker• Unified WCF configuration• SOA job monitoring
• iSCSI boot for diskless compute nodes
• Saved views and filtering• Extensible diagnostics• Support for custom reporting
• Service job resource balancing• Activate GPGPU jobs
• Enhanced environment diagnostics• Service list and configuration• Graceful service shutdown
Demo
Demo
Release Schedule
May June July Aug Sept Oct Nov Dec Jan Feb Mar
Q2 2009 Q3 2009 Q4 2009 Q1 2010
Community Technical Preview
May 2009
CTP 2Sept 2009
BetaNov 2009
RTM Spring 2010English, Chinese, Japanese
RCFeb 2010
RTMH1 2010
Q2 2010
Windows HPC Server 2008 SP1
Interoperability
• Microsoft’s strategy for growing HPC market– Support for non-CS domain experts
• Matlab, R, Excel users doing data analytics
– Integration with the enterprise data center
– Rich programming models• MPI, SOA, and the new Parallel Computing Platform
– Reduce support costs and provide great performance for existing HPC ISVs
Interoperability
• Present– New categories of apps
on HPC Server
– Horizontal applications starting to use clusters
– Major HPC apps on Windows
Windows
Linux
Interoperability
• Future– Windows support helps
grow HPC market
– New application types flourish
– Horizontal applications regularly leverage clusters
– Major HPC apps on Windows
Windows
LinuxExpands HPC reach within your organization –Take advantage of new Windows HPC capabilities for new HPC users
Interoperability
• Dynamic workloads require a dynamic datacenter– Moab Adaptive HPC Suite to dynamically change OS
• Sophisticated policies and SLAs to determine OS mix
– Applications still integrate directly with HPC Server job scheduler• Progress, troubleshooting, integrated security provided by HPC Server
T = 1 T = 2 T = 3 T = 4
Dynamic Adaptation
A New Model:Hybrid Windows/Linux HPC Clusters
Allows you to address both Windows HPC and Linux demand as needed
Enables new HPC cluster users stuck on Windows Workstations
Can still take direct advantage of Windows HPC benefits (Excel, ...)
Expand Cluster Utilization by enabling both Windows and Linux users to co-exist
Provides a framework for your cluster to dynamically respond to user demand over time
http://www.microsoft.com/hpc/
http://www.clusterresources.com
Working Together
Rocky Mountain Supercomputing Centers
Windows HPC in the Future
Seamless Parallelism Addressing the data explosion with petabyte data analytics tools Tackling scalable applications from workstation to cluster to cloud Dynamic and elastic virtualized clusters Uniform programming model for scalable applications Easily deploy and manage scalable applications Capacity without limitations for users of those applications
• Microsoft HPC Web site – Evaluate Today!– http://www.microsoft.com/hpc
• Windows HPC Community site– http://www.windowshpc.net
• Windows HPC TechCenter– http://technet.microsoft.com/en-us/hpc/default.aspx
• HPC on MSDN– http://code.msdn.microsoft.com/hpc
• Windows Server Compare website– http://www.microsoft.com/windowsserver/compare/default.mspx
Additional Information
© 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation
as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
MICROSOFT MAKES NO WARRANTIES, EXPRESS,IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
