Embed Size (px)
Citation preview
© 2008 Parabon Inc. All rights reserved. | 1© 2010 Parabon Computation, Inc. All rights reserved. |
Climate@HomeClimate@HomeClimate Modeling as a Servicewith Existing Infrastructure
NASA IT Summit 2010
Climate Modeling as a Servicewith Existing Infrastructure
NASA IT Summit 2010
© 2009 Parabon Computation, Inc. All rights reserved. |10
Steve Armentrout, ParabonTsengdar Lee, NASA HQ
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
© 2010 Parabon Computation, Inc.
SBIR: Modeling and Simulation as a Service Tsengdar Lee Mike Seablom
Frontier pilot project on Nebula cloud Chris Kemp
Climate@Home NASA SIVO Northrop Grumman Parabon
Background and ParticipantsBackground and Participants
DomainProgramme
rEnd User
QA Tester
Core ApplicationDeveloper
M&SaaS
© 2010 Parabon Computation, Inc.
Climate Change is our Copernican Controversy
Climate modeling is under intense scrutiny
Model validation and transparency are needed
Sensitivity experiments could be large and costly
An “@home” style project could: Advance Earth system science Engage the public Inform the debate Do so affordably
MotivationsMotivations
© 2010 Parabon Computation, Inc.
NASA Model E Climate Model
Each experiment:Monthly diagnostics for an ensemble of 1,000 simseach spanning 100 simulated years = 1.2M outputs
Output files 20-200 MB => 240 TB per experiment
Storage requirements > 1 PB
1 simulated month ~ 1 hour of processing =>
100 simulated years ~ 50 days of processing
Problem Specifications and DimensionsProblem Specifications and Dimensions
© 2010 Parabon Computation, Inc.
Problem Specifications and DimensionsProblem Specifications and Dimensions
QuickTime™ and a decompressor
are needed to see this picture.
Climate@Homeor
Dont-Try-This@Home
© 2010 Parabon Computation, Inc.
Client must be unobtrusive
Client must support Windows, Mac and Linux
Linux required for Model E execution
Results must be bit-for-bit reproducible
RequirementsRequirements
© 2010 Parabon Computation, Inc.
Client must be unobtrusive
Client must support Windows, Mac and Linux
Linux required for Model E execution
Results must be bit-for-bit reproducible
Solution: VM Management
RequirementsRequirements
© 2010 Parabon Computation, Inc.
Climate@Home Grid ArchitectureClimate@Home Grid ArchitectureFrontier Grid Server
on Nebula Cloud
NASA Ames NASA Goddard GeneralPublic
Frontier Data Serveron Amazon S3
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
NEBULA
E
© 2010 Parabon Computation, Inc.
ClientClient
© 2010 Parabon Computation, Inc.
ClientClient
QuickTime™ and a decompressor
are needed to see this picture.
© 2010 Parabon Computation, Inc.
ClientClient
© 2010 Parabon Computation, Inc.
ClientClient
QuickTime™ and a decompressor
are needed to see this picture.
© 2010 Parabon Computation, Inc.
ClientClient
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
© 2010 Parabon Computation, Inc.
ClientClient
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
Ryan Boller, NASASciences and Exploration Directorate
QuickTime™ and a decompressor
are needed to see this picture.
© 2010 Parabon Computation, Inc.
Problem DecompositionProblem Decomposition
…t
© 2010 Parabon Computation, Inc.
Problem DecompositionProblem Decomposition
m m+1 m+2 m+3…t
Calculate monthlycheckpoints once
© 2010 Parabon Computation, Inc.
Problem DecompositionProblem Decomposition
m m+1 m+2 m+3…t
Calculate monthlycheckpoints once
Save them ina repository
© 2010 Parabon Computation, Inc.
Problem DecompositionProblem Decomposition
m m+1 m+2 m+3…t
m
m+1
m+2
m+4
Calculate monthlycheckpoints once
Save them ina repository
…
Subsequently,perform deepdiagnostics runsin parallel fashion
© 2010 Parabon Computation, Inc.
Problem DecompositionProblem Decomposition
m m+1 m+2 m+3…t
m
m+1
m+2
m+4
Calculate monthlycheckpoints once
Save them ina repository
…
Subsequently,perform deepdiagnostics runsin parallel fashion
Solution credit:Mike Seablom
© 2010 Parabon Computation, Inc.
Speedup and CostSpeedup and Cost
In round numbers, time to compute ensemble … > 100 years on single computer 50 days on 1,000 computers 12 hours on 100,000 computers NASA has ~80,000 desktops
© 2010 Parabon Computation, Inc.
Speedup and CostSpeedup and Cost
In round numbers, time to compute ensemble … > 100 years on single computer 50 days on 1,000 computers 12 hours on 100,000 computers NASA has ~80,000 desktops
Cost = Marginal cost of electricity Incremental wattage expenditure: ~30W “Flat out” (worst case) marginal cost: $0.07 per day
© 2010 Parabon Computation, Inc.
Modeling & Simulation as a ServiceModeling & Simulation as a Service
DomainProgrammer End User
QA TesterCore ApplicationDeveloper
© 2010 Parabon Computation, Inc.
Climate Modeling as a ServiceClimate Modeling as a Service
© 2010 Parabon Computation, Inc.
Climate Modeling as a ServiceClimate Modeling as a Service
© 2010 Parabon Computation, Inc.
What’s New Since 25 June?What’s New Since 25 June?Frontier Grid Server
on Nebula Cloud
NASA Ames NASA Goddard GeneralPublic
Frontier Data Serveron Amazon S3
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
NEBULA
E
© 2008 Parabon Inc. All rights reserved. | 26© 2010 Parabon Computation, Inc. All rights reserved. |
Climate@HomeClimate@HomeClimate Modeling as a Servicewith Existing Infrastructure
NASA IT Summit 2010
Climate Modeling as a Servicewith Existing Infrastructure
NASA IT Summit 2010
© 2009 Parabon Computation, Inc. All rights reserved. |10
Steve Armentrout, ParabonTsengdar Lee, NASA HQ
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
