8
ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Embed Size (px)

Citation preview

Page 1: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

ESMF Development Status and Plans

ESMF 4th Community Meeting

Cecelia DeLuca

July 21, 2005 ClimateData Assimilation

Weather

Page 2: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Outline• Where we are now• Where we are going• Challenges

Page 3: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

ESMF Development Status• Overall, component-based architecture is well-defined• Serial or parallel execution (mpiuni stub library)• Concurrent or sequential execution, single executable• Logically rectangular grids with regular and arbitrary distributions can be

represented and regular distributions can be regridded• On-line parallel regridding (bilinear, 1st order conservative) implemented and

optimized• Other parallel methods - e.g. halo, redistribution, low-level comms implemented• Utilities such as time manager, logging, and configuration manager usable and

adding features• Virtual machine with hooks for load balancing implemented• Fortran interfaces and complete documentation, some C++ interfaces

Page 4: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Growing ESMF Customer Base• Original ESMF applications:

NOAA GFDL atmospheresNOAA GFDL MOM4 oceanNOAA NCEP atmospheres, analysesNASA GMAO models and GEOS-5NASA/COLA Poseidon oceanLANL POP oceanNCAR WRFNCAR CCSMMITgcm atmosphere and ocean

• Other groups adopting ESMF:NASA GISSUCLACSU NASA Land Information Systems (LIS) projectNOAA Integrated Dynamics in Earth’s Atmosphere (IDEA) project, more…

• New applications coming in during FY05 through the newly funded, ESMF-based DoD Battlespace Environments Institute (BEI):DoD Navy HYCOM oceanDoD Navy NOGAPS atmosphereDoD Navy COAMPS coupled atm-ocean DoD Air Force GAIM ionosphereDoD Air Force HAF solar windDoD Army ERDC WASH123 watershed

• More new applications will begin adopting ESMF during FY06 through the ESMF-based NASA Modeling Analysis and Prediction (MAP) Climate Variability and Change program.

• Further growth of the customer base is anticipated through partnership with space weather computational environments.

Page 5: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Supported Platforms and theESMF Test Suite• IBM AIX (32 and 64 bit addressing) • SGI IRIX64 (32 and 64 bit addressing) • Compaq OSF1 (64 bit addressing) • Linux Intel (32 and 64 bit addressing, with mpich and lam) • Linux PGI (32 bit addressing, with mpich) • Linux NAG (32 bit addressing, with mpich) • Linux Absoft (32 bit addressing, with mpich) • Linux Lahey (32 bit addressing, with mpich) • Mac XLF (32 bit addressing, with lam) • Mac Absoft (32 bit addressing, with lam) • SGI Altix (64 bit addressing) • Cray X1 (64 bit addressing)

The ESMF Test Suite consists of ~1500 unit tests, ~17 system tests, ~40 examples. The Suite is run nightly on the platforms above. The ESMF Test Suite is bundled with the ESMF source code so that users can run it themselves for verification, debugging, and porting.

Page 6: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Planned ESMF Extensions• Support for representing, partitioning, communicating with, and regridding

data based on general curvilinear coordinates and unstructured grids• Advanced support for data assimilation systems, including data structures

for observational data and adjoints for ESMF methods• Looser couplings: support for multiple executable and Grid-enabled

versions of ESMF• I/O including asynchronous I/O• Support for nested, moving grids and adaptive grids • Support for regridding in three dimensions and between different

coordinate systems• Advanced optimization and load balancing

Page 7: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

Current Development Challenges• Refocus of core team on grid development, production quality and

performance, increased customer support – new balance of tasks, new hires

• Rework mid-level data structures for more advanced decompositions and grids – ensure the framework is usable for real, complex applications

◦ Integrate mid-level data structures with advanced low level communications (threading, chunking, load balancing)

◦ Create a mid-level array class that offers a set of commonly used index space communications

◦ Increase generality of the decomposition and grid representation ◦ Add options such as masking to grids and arrays◦ Increase grid and regrid extensibility (read/write grids, read/write

interpolation weights, interface for user registration of new grids and their methods)

• Many new requirements◦ New tool for tracking requirements (DOORS)◦ New mechanism for prioritizing design and implementation tasks

(CRB)

Page 8: ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather

This Time Next Year…• Representation, regridding, communication methods for grids with

general curvilinear coordinates • Representation, regridding, communication methods for unstructured

grids and location streams• Read/write interpolation weights and read/write grid specifications• Robust netCDF-based IO capability• Fully-featured utilities (config attributes, logging, Tau timers)