Welcome To The 45 th HPC User Forum Meeting April 2012

Welcome To The 45th HPC User Forum

MeetingApril 2012


MeetingApril 2012

Important Dates For Your Calendar Important Dates For Your Calendar

FUTURE HPC USER FORUM MEETINGS:

2012 International Meetings: Imperial College, UK, July 5 & 6 HLRS/University of Stuttgart, July 9 & 10

Next 2012 US Meeting: 2012 September 17 to 19, Dearborn,

Michigan

Thank You To Our Sponsors! Thank You To Our Sponsors!

Gold Intel HP

Silver Altair Engineering AMD Platform Computing

Bronze Appro International Bright Computing Gnodal Mellanox Panasas Raytheon

Monday: Dinner – AMD & Platform

ComputingTuesday:

Breakfast -- Mellanox AM Break – Raytheon Lunch – Altair Engineering PM Break – Bright Computing Dinner – Intel and HP

Wednesday: Breakfast -- Panasas AM Break – IDC Lunch – Appro International PM Break – Gnodal

DinnerThanks to:

AMD & Platform Computing

DinnerThanks to:


Tuesday Dinner Vendor Updates: 10 MinutesTuesday Dinner Vendor Updates: 10 Minutes

• Parallel Scientific• Appro• Altair • AMD• Bright Computing• Gnodal• Panasas• Platform


MeetingApril 2012


MeetingApril 2012

DinnerThanks to:


BreakfastThanks to: Mellanox

DinnerThanks to:


BreakfastThanks to: Mellanox


Gold Intel HP




ComputingTuesday:



Introduction: LogisticsIntroduction: Logistics

Ask Mary if you need a receipt We have a very tight agenda (as usual)

Please help us keep on time!

Review handouts Note: We will post most of the

presentations on the web site Please complete the evaluation form

www.hpcuserforum.comwww.hpcuserforum.com

New HPC Innovation Award Program:www.hpcuserforum.com/innovationaward/New HPC Innovation Award Program:www.hpcuserforum.com/innovationaward/

Welcome

Steve FinnHPC User Forum

Chairman

Welcome

Steve FinnHPC User Forum

Chairman





Michigan

HPC User Forum MissionHPC User Forum Mission

To Improve The Health Of The

High Performance Computing Industry

Through Open Discussions, Information-sharing And Initiatives Involving

HPC Users In Industry, Government And Academia

Along With HPC Vendors

And Other Interested Parties

Steering Committee MembersSteering Committee Members

• Steve Finn, Cherokee Information Services, Chairman• Rupak Biswas, NASA Ames, Vice Chairman • Earl Joseph, IDC, Executive Director• Vijay Agarwala, Penn State University• Alex Akkerman, Ford Motor Company • Doug Ball, The Boeing Company• Paul Buerger, Avetec• Steve Conway, IDC Research Vice President• Jack Collins, National Cancer Institute• Jeff Broughton. NERSC/Lawrence Berkeley National Lab • Merle Giles, NSCA/University of Illinois• Chris Catherasoo, Caltech• James Kasdorf, Pittsburgh Supercomputing Center• Doug Kothe, Oak Ridge National Laboratory• Paul Muzio, City University of New York• Michael Resch , HLRS, University of Stuttgart• Vince Scarafino, Industry Expert • Allan Snavely, Livermore National Lababoratory

IDC HPC

Market Update

IDC HPC

Market Update

IDC’s HPC TeamIDC’s HPC Team

Earl Joseph IDC HPC research studies, HPC User Forum and strategic consulting

Steve ConwayStrategic consulting, HPC User Forum, market trends, Big Data

Chirag DeKateHPC QView, technology trends, Big Data, innovation awards program

Lloyd CohenHPC market analysis, data analysis and workstations

Beth ThrockmortonGovernment account support and special projects

Charlie Hayes Government HPC issues, DOE and special studies

Mary Rolph HPC User Forum conference planning and logistics

Top Trends in HPCTop Trends in HPC

The global economy in HPC is growing again 2010 grew by 10%, to reach $9.5 billion 2011 grew by 8.4% to reach $10.3 billion We are forecasting ~7% growth over the next 5 years

Major challenges for datacenters Power, cooling, real estate, system management Storage and data management continue to grow in

importance

Software hurdles are rising to the top for most users

GPUs are seeing real tractions in certain verticals

The worldwide Patascale Race is in full speed

IDC PRESS RELEASE: HPC Server Market Delivers Record Revenues and 8.4% Growth in 2011IDC PRESS RELEASE: HPC Server Market Delivers Record Revenues and 8.4% Growth in 2011

FRAMINGHAM, Mass., March 20, 2012 – Worldwide factory revenue for the high performance computing (HPC) technical server market increased by 8.4% in full-year 2011 to reach a record $10.3 billion, up from $9.5 billion in 2010, according to the newly released International Data Corporation (IDC) Worldwide High-Performance Technical Server QView. The 2011 results exceeded IDC's forecast of 7.2% year-over-year revenue growth.

Unit shipments in 2011 declined 6.9% year over year as average selling prices grew, indicating a continued shift to large system sales. IBM and HP ended the year in a statistical tie for leadership with 32.6% and 32.1% of overall factory revenue market share, respectively. (Note: IDC declares a statistical tie in the worldwide server market when there is less than one percent difference in the factory revenues of two or more vendors.)

The brightest spot was the "Supercomputers" segment for HPC systems selling for $500,000 and up, which jumped 24% to reach revenues of nearly $4.4 billion during a year of continuing worldwide economic recovery. At the other end of the price spectrum, revenue from "Workgroup" HPC systems sold for below $100,000 fell 4% to $1.2 billion as buyers continued to delay or cancel some planned acquisitions in this segment that is characterized by purchases based on shorter sales cycles and more discretionary spending. These results reflect a continuing, dramatic shift of HPC technical server revenue share toward the Supercomputers segment.

"HPC technical servers, especially Supercomputers, have been closely linked not only to scientific advances but also to industrial innovation and economic competitiveness. For this reason, nations and regions across the world are increasing their investments in supercomputing even in today's challenging economic conditions," said Earl Joseph, program vice president for HPC at IDC.

IDC expects the HPC technical server market to grow at a healthy 7% to 8% yearly rate to reach revenues of $13.4 billion by 2015.

Vendor Highlights:• IBM had an exceptionally strong year, achieving 19.3% revenue growth over 2010. • HP revenue increased by a robust 9.6%, enabling the company to tie IBM for HPC market share leadership.• Dell grew revenue by 2.1% and maintained its number three position with nearly 14.5% market share.

2012 IDC HPC Research Areas 2012 IDC HPC Research Areas

New And Potentially Disruptive Technologies & New Approaches Big data Co-processors All types of flash/SSDs New software solutions Government programs to help bring to market new capabilities

Special HPC Research Areas & Reports: A new user-based data tracker product End-user based MCS reports: clusters, processors, accelerators,

storage, interconnects, system software, and applications The evolution of government HPC budgets Emerging markets including China, Russia, etc. SMB and SMS research The HPC award program The evolution of clouds in HPC Scaling of software – issues and soultions Worldwide Petascale and Exascale Initiatives

S

1. The HPC Market Will Continue to Benefit from the Global Economic Recovery

2. The Worldwide High End Race Will Accelerate

3. Exascale Decisions Could Shift Future Leadership

4. Software Leadership Will Become the New Battleground

5. The Processor Arena Will Become More Crowded

6. National/Regional Technology Development Will Gain Momentum

7. Big Data Methods Will Start to Transform the HPC Market, Including Storage

8. Cloud Computing Will Make Steady Progress

9. There Will Be Shifting Sands in the Networking Market

10. Petascale Performance on Big Systems Will Create New Business Opportunities

IDC Top 10 HPC Predictions for 2012IDC Top 10 HPC Predictions for 2012

S

2011 HPC WW Market Results: By Competitive Segments 2011 HPC WW Market Results: By Competitive Segments

C

2011 HPC WW Market Results: By Price Bands2011 HPC WW Market Results: By Price Bands

C

2011 HPC WW Market Results: By Region2011 HPC WW Market Results: By Region

C

2011 HPC WW Market Results: Processor Packages Shipped2011 HPC WW Market Results: Processor Packages Shipped

C

2011 HPC WW Market Results: By System Units Sold2011 HPC WW Market Results: By System Units Sold

C

HPC Vendor Revenue SharesHPC Vendor Revenue Shares

C

HPC Forecasts

And

Growth Areas

HPC Forecasts

And

Growth Areas

E

New HPC Forecasts New HPC Forecasts

• 2011 was a very strong year and we are projecting 7% yearly growth to 2016

• 2016 should exceed $14 billion

New HPC Forecasts: By Competitive Segment New HPC Forecasts: By Competitive Segment

New HPC Forecasts: By Verticals New HPC Forecasts: By Verticals

National Use Of HPC

And

Supercomputers

National Use Of HPC

And

Supercomputers

Why Is HPC Becoming So Important To Nations?Why Is HPC Becoming So Important To Nations?

Worldwide political leaders increasingly recognize this trend:• In 2009, Russian President Dmitry Medvedev warned that

without more investment in supercomputer technology, “Russian products will not be competitive or of interest to potential buyers.”

• In June 2010, Rep. Chung Doo-un of South Korea’s Grand National Party: “If Korea is to survive in this increasingly competitive world, it must not neglect nurturing the supercomputer industry, which has emerged as a new growth driver in advanced countries.”

• The Korean National Assembly then called for the creation of a national five-year plan for advancing HPC

• In February 2012, the European Commission announced that it has adopted a plan to double spending on HPC to €1.2 billion, with much of that money aimed at the installation of additional petascale supercomputer systems

Supercomputer WW Growth Is Reshaping The Market Supercomputer WW Growth Is Reshaping The Market

• The overall HPC market was hard it by the recession, and has now fully recovered

• The worldwide supercomputer segment went into a major growth cycle – from 2008 to 2011

2003 2004 2005 2006 2007 2008 2009 2010 2011 -

2,000

4,000

6,000

8,000

10,000

12,000

Workgroup

Departmental

Divisional

Supercomputers

2003 2004 2005 2006 2007 2008 2009 2010 2011 -

500

1,000

1,500

2,000

2,500

3,000

3,500

4,000

4,500

5,000

Supercomputers

USA Supercomputer GrowthUSA Supercomputer Growth

• The USA HPC market was hard it by the recession, and still hasn’t fully recovered

• The USA supercomputer segment grew some, but at a lower rate

2003 2004 2005 2006 2007 2008 2009 2010 2011 -

1,000

2,000

3,000

4,000

5,000

6,000

Workgroup

Departmental

Divisional

Supercomputers

2003 2004 2005 2006 2007 2008 2009 2010 2011 -

200

400

600

800

1,000

1,200

1,400

1,600

1,800

2,000

Supercomputers

China Supercomputer GrowthChina Supercomputer Growth

• The China HPC market wasn’t impacted by the recession, and is well underway to reach $1 billion in 5 years

• The china supercomputer segment grew the most, heavily since 2007

2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 -

100

200

300

400

500

600

700

Workgroup

Departmental

Divisional

Supercomputers

2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 -

50

100

150

200

250

300

350

400

Supercomputers

Japan Supercomputer GrowthJapan Supercomputer Growth

• The Japan HPC market was hard it by the recession

• The Japan supercomputer segment is very up and down (Riken will make 2012 very large)

2003 2004 2005 2006 2007 2008 2009 2010 2011 -

50

100

150

200

250

300

350

400

450

500

Supercomputers

2003 2004 2005 2006 2007 2008 2009 2010 2011 -

100

200

300

400

500

600

700

800

900

Workgroup

Departmental

Divisional

Supercomputers

ConclusionsConclusions

2010 and 2011 were both strong years – and show a return to healthy growth in the HPC market

IDC predicts the HPC market will continue growth in 2012 and grow by 7% over the next five years

The recovery will benefit HPC segments unevenly:

The Supercomputer segment growth will remain turbo-charged by government spending aimed at HPC leadership and “petaflops club” membership

And could exceed our current forecasts

But There are Still Major Customer Pain PointsBut There are Still Major Customer Pain Points

Software is still the #1 roadblock Parallel software is lacking for most users:

– Many applications can’t grow their parallelism level– Better management software is needed– New buyers – require “ease-of-everything”

Clusters are still hard to use and manage: – System management & growing cluster complexity – Power, cooling and floor space are major issues – Third party software costs – Weak interconnect performance at all levels– RAS is a growing issue

Storage and data management are becoming new bottle necks Lack of full software support for heterogeneous environments

and accelerators

Please email:[email protected]

Or check out:www.hpcuserforum.com

Questions?Questions?

mailto:[email protected]

http://www.hpcuserforum.com/

Agenda: Day One MorningAgenda: Day One Morning

8:00am Welcome, Steve Finn, Rupak Biswas and Earl Joseph 8:10am HPC Market Update, Earl Joseph, Chirag Dekate and Steve ConwayMorning Session Chair: Steve Finn8:30am Data-Intensive Computing: Redefining HPC? (Moderator: Paul

Muzio)• Big Data in Cancer Research, Jack Collins, National Cancer Center-

ABCC• Stampede: Intel MIC And Data-Intensive Computing, Jay Boisseau,

Texas Advanced Computing Center• Big Data Approaches at Convey, John Leidel • Cray Technical Perspective On Data-Intensive Computing, Amar

Shan, Cray10:15am - 10:45am Break

• Data-intensive Computing Research At PNNL, John Feo, Pacific Northwest National Laboratory

• Trends in High Performance Analytics, David Pope, SAS11:30am Invited Vendor Technology Updates: Intel and HP12:00pm Networking Lunch

AM Break Thanks to: Raytheon

Lunch Thanks to: Altair

Please Return Promptly at 1:00pm

AM Break Thanks to: Raytheon

Lunch Thanks to: Altair


Thank You To: Altair Engineering

For Lunch

Thank You To: Altair Engineering

For Lunch

Agenda: Day One AfternoonAgenda: Day One Afternoon

Afternoon Session Chair: Rupak Biswas1:00pm Data-Intensive Computing: Redefining HPC? (Part two)

• Processing Large Volumes of Experimental Data, Shane Canon, LBNL• SGI Technical Perspective On Data-Intensive Computing, Eng Lim Goh, SGI• Big Data and PLFS: A Checkpoint File System For Parallel Applications, John

Bent, EMC • HPC Data-intensive Computing Technologies, Scott Campbell, Platform/IBM

2:45pm Break3:15pm Performance Modeling: Better Understanding Future System

Performance • HPCMP Benchmarking & Performance Analysis, Mark Cowan, USACE

ERDC ITL • Performance Optimization, Phil Mucci, Minimal Metrics• Modeling Performance, Energy Metrics And Reliability, Robert Sinkovits, San

Diego Supercomputer Center• Advances in Parallel Programming Environments, John Tran, NVIDIA

5:00pm RENCI HPC Activities Update, Charles Schmitt, RENCI5:30pm Networking Break and Time for 1-on-1 Meetings 6:30pm Reception and Dinner Event. Keynote Speaker: Roger Hunter, NASA

Kepler Mission Manager, The Search for Exoplanets

Thank You To:Bright Computing

For The Break

Thank You To:Bright Computing

For The Break

Dinner LogisticsDinner Logistics

Special Dinner Event Sponsored by Intel and HP

WelcomeTo Day 2 Of TheHPC User Forum

Meeting

WelcomeTo Day 2 Of TheHPC User Forum

Meeting

DinnerThanks to:

Intel and HP

BreakfastThanks to:

Panasas

DinnerThanks to:

Intel and HP

BreakfastThanks to:

Panasas

Agenda: Day Two MorningAgenda: Day Two Morning

8:10am Welcome, Earl Joseph and Steve Finn Morning Session Chair: Vince Scarafino 8:15am Potential Disruptive Technologies -- Short Presentations and Panel

Discussion: Exploring emerging technologies that have the potential to redefine the HPC market (Moderator: Earl Joseph):• The use of ARM-based processors at HP and Redstone, Scott Misage• ARM-based processors by Calxeda, Karl Freund• The use of DSP technology, Arnon Friedmann, TI• New Aspects of VPI, Virtualization and Co-Design, Todd Wilde, Mellanox• MIC Directions and Ideas, Jim Jeffers, Intel• High Performance Cluster Computing, Charles Kaminski, LexisNexis• Emerging Parallel Programming Approaches, Guang Gao, ETI• Phil Mucci, Minimal Metrics• GPUs, David Luebke, NVIDIA

10:15am Break10:30am Update on HPC at HLRS, Michael Resch, HLRS/Stuttgart11:00am DOD HPCMP Update, John West, Director, HPCMP11:30am DOD PETTT Program: Leveraging National HPC Assets, Patrick

Dreher, HPTi12:00pm Networking Lunch

Lunch Thanks to: Appro


Lunch Thanks to: Appro


Thank You Appro International

For Lunch

Thank You Appro International

For Lunch

Agenda: Day Two Afternoon Agenda: Day Two Afternoon

Afternoon Session Chair: Merle Giles, NCSA1:00pm Center for Applied High Performance Computing (Danville, VA), Gil Miller,

Noblis1:30pm Panel: Government Funding Approaches & New Ideas (Moderator: Vince

Scarafino)• John West, DoD HPCMP• Jay Boisseau, TACC• Michael Resch, HLRS/University of Stuttgart• Mike Little, NASA

2:30pm Break2:45pm Industrial Access to HPC -- Short Presentations Followed By A Panel

Discussion (Moderator: Merle Giles):• INCITE Program Update, Julia White, ORNL• Blue Waters, Merle Giles, NCSA• Industrial Advisory Council on HPC in South Africa, Happy Sithole • ORNL Industrial Outreach Program, Suzy Tichenor, ORNL• Industrial Outreach in Europe, Michael Resch, HLRS/University of Stuttgart

4:00pm Boeing Design, Analysis and Optimization with HPC, Jeremie Albert and David Bowen, Boeing, introduced by Altair

4:45pm Meeting Wrap-Up, Steve Finn, Rupak Biswas, Steve Conway and Earl Joseph

Thank You To:Gnodal

For The Break

Thank You To:Gnodal

For The Break





Michigan


Gold Intel HP




ComputingTuesday:



Thank YouFor Attending The 45th

HPC User ForumMeeting

Thank YouFor Attending The 45th

HPC User ForumMeeting

Please email:[email protected]

Or check out:www.hpcuserforum.com

Questions?Questions?

mailto:[email protected]

http://www.hpcuserforum.com/

Documents

Welcome To The 45 th HPC User Forum Meeting April 2012