NCAR Supercomputing ‘Data Center’ Project
An NCAR-led computing ‘facility’ for the study of the Earth system
May 30, 2006
Project Review• NCAR Mesa Lab computer facility: power,
cooling and floor space will be inadequate beyond the current procurement
• Science being restricted by focusing on capacity ahead of capability
• Facility concept: 30,000 (initial to 60,000) sq. ft., 150,000 (to 300,000) sq. ft., 4 (to 24) MW redundant power, cooling, ~ 20 year lifetime
• Phase 1 facility est. construction cost @ $50M to $70M
– Such a facility would be a computational equivalent of the Hubble Telescope for geoscience simulation
SCD Computer Facility Equipment Power Consumption (kW)
0
100
200
300
400
500
600
700
800
900
1000
Jan-97 Jan-98 Jan-99 Jan-00 Jan-01 Jan-02 Jan-03 Jan-04 Jan-05 Jan-06
Cray C90
IBM POWER3 blackforest & babyblue
SGI Origin3800
IBM POWER4 bluesky,thunder &bluedawn
IBM Linux
IBM BlueGene/L
IBM POWER5bluevista
Cray T3D
SGI O2K ute
HP SPP2000
SGI O2K ute
Compaq ES40
Network & Enterprise Systems
SGI O2K dataproc
Cray J90's
Average Electrical Cost by State(1990 - 2003)
Data From Energy Information Administrationhttp://www.eia.doe.gov/cneaf/electricity/epa/average_price_state.xls
0
2
4
6
8
10
12
14
IDWA ORWY KY WV NE MT UT COVA IN OK WI MO MN ND SC TN IA AR NC KS SD FL AL MD TX MS DE NV GA LA DC OH
ILNM MI AZ PA NJ AK RI MA CT ME VT CA NH NY HI
(cents per kWh)
Commercial
Industrial
Schedule
• Project plan development - Sep-Dec• Community engagement - Ongoing• Partnership development - Nov-Mar, down-select in April and June• Engage National Science Foundation (GEO, OCI) - Ongoing• Forge international collaborations (UK/NERC, ENES)• Initiate facility building project ~ Summer 2006• Community workshop - September at NCAR• Submit project prospectus to NSF – Jan 2007• First electrons ~ Summer 2010
2006 2007 2008 2009 2010
Discovery
Planning/Financing
DesignConstruction
An OpportunityNSF’s Petascale Roadmap
“Overarching Recommendation: Establish a Petascale Collaboratory for the Geosciences with the mission to provide leadership-class computational resources that will make it possible to address, and minimize the time to solution of, the most challenging problems facing the geosciences.”
www.joss.ucar.edu/joss_psg/meetings/petascale/
NSF’s Cyberinfrastructure Vision2006-2010
A petascale center linked with multiple 100+ teraflop centers…
Track-1 $200m1 Petaflop Sustained
Track-2 $30m100TF
Track-2 $30mTrack-2 $30m
Track-2 $30m
Geosciences HPC Research Consortium Concept
NCAR + Facility Partner
Geosciences HPC Collaboratory Center
Atmospheric Science
Resource Center
Other National Labs and Supercomputer
Centers and International
AlliancesNSF Geosciences
Research Community ATM, OCE, EAR, +
Earth Interiors Resource Center
Ocean Science Resource
Center
Minority Institution
Resource Center
Energy Research Resource
Center
Computational Science Resource
Center
Hydrology, Energy, etc. Research Communities
Scientific Steering Committee• Rick Anthes Meteorology, UCAR• Rafael Bras Hydrology, MIT• Guy Brasseur Atmospheric Science, Max Planck Institute,
Hamburg• Kelvin Droegemeier Atmospheric Science, OU• Tamas Gombosi Space Science, U Michigan• Gregory Jenkins Atmospheric Science, Howard• Thomas Jordan Geophysics, USC• David Maidment Hydrology, Univ. Texas• Jean-Bernard Minster Seismology, SIO• John Orcutt Oceanography, SIO• Tim Palmer Weather and Climate, ECMWF• Annick Pouquet Geophysical Turbulence, NCAR• Jagadish Shukla Climate, COLA• Paola Rizzoli Oceanography, MIT• David Yuen Geophysics, UMN
NCAR committee• Tim Killeen, Larry Winter, Katy Schmoll, Al Kellie, Lawrence Buja, Peter Fox,
Aaron Anderson, Peter Backlund, Frank Bryan, Krista Laursen, Rich Loft, Jeff Reaves, Henry Tufo, Olga Wilhelmi, Michael Wiltberger
Contacts at NCAR
• Tim Killeen ([email protected]) - NCAR Director
• Lawrence Buja ([email protected]) and Peter Fox ([email protected]) are co-chairs of the NCAR project team
• Aaron Anderson ([email protected]) is the computing facilities contact
• Jeff Reaves ([email protected]) is the financial/ contracts contact