Upload
anastasia-cox
View
213
Download
1
Embed Size (px)
Citation preview
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Cecelia DeLuca / NCAR2nd ESMF Community MeetingPrinceton, NJ
NSIPP Seasonal ForecastNCAR/LANL CCSM
NCEP ForecastGFDL FMS Suite
MITgcm
NASA GSFC PSAS
ESMF Design Overview andImplementation Strategy
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Outline
• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Design Goals
• Composable, swappable, nestable model components for building Earth system applications
dyn
assimatm
hurr_sim
phys
assim_atmocean
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Design Goals (cont.)• Reusable toolkits for grid operations and
routine utilities• Performance portability and ease of use in a
complex, transient computing environment• Application and infrastructure codes that are
maintainable and extensible
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Design Goals (cont.)• Flexibility
– To allow unconstrained scientific development– To encourage technical innovation– To support partial adoption of framework services– To accommodate different programming models
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Outline
• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Architecture
External Libraries
Low Level Utilities
Fields and Grids Layer
Model Layer
Coupling Layer
ESMF Infrastructure
User Code
ESMF Superstructure
BLAS, MPI, NetCDF, …
Composable, swappable, nestable model components for building Earth system applications
Reusable toolkits for grid operations and routine utilities
Performance portability and ease of use in a complex, transient computing environment
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Design Approach
• Component-based architecture: large, functionally related pieces of software (e.g., atmosphere, land models) interact through well-defined interfaces
• Object oriented design: smaller, functionally related pieces of software are bundled into modules containing data and methods
• Layered design: details of platform and parallelism are not visible at the highest level interfaces
Application and infrastructure codes that are maintainable and extensible
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Design Approach (cont.)Flexibility• To allow unconstrained scientific development• To encourage technical innovation• To support partial adoption of framework services• To accommodate different programming models
• Physical interfaces to components are not prescribed• Designed to be compatible with user-managed intra-
component communication• Extensible for new grids / algorithms / comm libraries• Many ESMF services may be used independently • Allows arbitrary placement of inter-component
communication
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Outline
• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
General Features
• ESMF will be usable by models written in F90/C/C++• ESMF will be usable by models requiring adjoint capability• ESMF will be usable by models requiring shared or
distributed memory parallelism semantics• ESMF will support sequential and concurrent modes of
execution• ESMF will support several I/O formats, including
GRIB/BUFR, netCDF, HDF• ESMF will have uniform syntax across platforms• ESMF will target a broad range of platforms, from major
centers commodity hardware
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Services
event alarmsperformance profilingI/O primitivescommunication primitives, etc.
Low-Level Utilities
transpose, halo, etc.abstract machine layout
Parallel Utilities
grid metadatagrid decomposition
Grids
field metadatafield and field bundle datafield I/O
FieldsFields and Grids
components (gridded, coupler, app)states
Components / Coupling
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Field: Halo( ), Import( ), Export( ) + I/O
ESMF Components
2. ESMF provides a toolkit that components use to
i. increase interoperability
ii. improve performance portability
iii. abstract common services
Component: Init( ), Run( ), Checkpoint( )
Grid: Regrid( ), Transpose( ) + Metrics
DELayout, PE List, Machine Model
Application Component
Gridded Components Coupler Components
1. ESMF provides an environment for assembling geophysical components into an application.
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
ESMF Version 1.0
MachineModel
Layout
DistGridPhysGrid
State
Bundle
GriddedComponent
Array
Utilities: TimeMgr, Config, LogErr, I/O etc.
F90
Superstructure
Infrastructure
Field
Grid
Regrid
Comm
Data Communications
Design CompleteLimited PrototypeFuller Prototype
Route
CouplerComponent
C++
ApplicationComponent
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Outline
• ESMF Design Goals• ESMF Design Strategies• Architecture and Features• Implementation Strategy
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Implementation Strategy for ESMF Version 1.0
Infrastructure
Superstructure
• Sufficient breadth to prototype how all major parts of the ESMF system will interact
• Well-developed superstructure (Components and States)
• Basic functions in most infrastructure classes
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Implementation Strategy for ESMF Version 1.0 (cont.)
• Sufficient depth to develop simple ESMF applications
• Groundwork laid for high performance communication, uniform API across shared/distributed memory, load balancing capability
• Fully developed F90/C++ interoperability strategy
Infrastructure
Superstructure
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Implementation Strategy for ESMF Version 1.0 (cont.)
Infrastructure
Superstructure
Over the next year:• Development of grid and parallel
regrid services• Continued work on communication,
decomposition, and other utilities• Organization, standardization, fine-
tuning interfaces• Hardening and optimizing
implementation• Extending and polishing
documentation and tutorial examples
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
Development Focus
Near-term framework development focus is on creating sufficient infrastructure and superstructure to achieve the initial set of interoperability experiments.
These are:– FMS B-grid atmosphere coupled to MITgcm ocean– CAM atmosphere coupled to NCEP analysis– NSIPP atmosphere coupled to DAO analysis
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
The Team• Fields and Grids
– Nancy Collins, Jon Wolfe, David Neckels
• Regrid– Phil Jones
• Time + Machine Model/Comms– Earl Schwab
• Benchmarks– Gerhard Theurich
• Web and Admin– Robbie Stauffer
• I/O– Nancy Collins, Atanas Trayanov
• Profiling and logging– Shep Smithline, Erik Kluzek
• Attributes– Leonid Zaslavsky, Nancy Collins
• System Tests and Demos– Silverio Vasquez, Nancy Collins,
Jon Wolfe• Build
– Dennis Flanigan
15 May 2003
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH
More information
ESMF website: http://www.esmf.ucar.edu
On the website:• Information about the Community Meeting• ESMF documents • ESMF browsable source code repository • On-line forms for community input and catalogued responses• Milestone schedule, project archives and history, related projects• Management plan, board and team contacts• More …