Upload
isaac-summers
View
214
Download
0
Embed Size (px)
Citation preview
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 Team Lead Science Computing Facility
TLSCF at UAH
Dr. Roy SpencerDr. Danny Braswell
Dr. Elena LoblMr. Don Moss
Ms. Dawn Conway
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
TLSCF at UAH
• Overview of TLSCF tasks• TLSCF Data Flow• TLSCF Operating Environment• Science Team Software Delivery
Requirements• TLSCF Science Software Integration and
Test (SSI&T) Procedures• Current AMSR-E Science Software• AMSR-E / AMSR2 Schedule
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Overview of Tasks
• Support Science Team• Integrate and test science software• Maintain metadata, QA software, and
ESDT’s• Prepare all software for operations
environment• Deliver DAP to the SIPS• Support the SIPS in resolving processing
anomalies• Support NSIDC (user inquiries and
documentation)• Documentation and web pages
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR-E / AMSR2TLSCF
Science Team
GHCCSIPS
NSIDC DAAC
Algorithm, documentation, QA, and ECS metadata updates
Documentation, ESDT’s, user support
Browse images, anomaly resolution, Provenance metadata, LANCE product review
Delivered Algorithm Package (DAP)
Data Flow
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E AMSR2 /Future AMSR-E
Operating System RHEL 5 - 32 bit RHEL 6 - 64 bit
C compiler gcc gcc
Fortran compiler Lahey gfortran
HDF 4.2r1 5
HDF-EOS 2.14 5
TLSCF Operating Environment
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Science Team Software Delivery Requirements
• Update from the latest DAP• Software
o HDF versiono HDF-EOS Geo fieldso Use current version of input data
• Delivery notes o Documenting science software changeso Describing the products and the ancillary fileso Documenting all third party software usedo Documenting known issues / bugs
• Include test input / output data
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Science Software Integration & Test Procedures
• Review each science team delivery o Begin with current DAP?o Document changes in software and ancillary files?o Output file meets ECS requirements?o Known issues, bug fixes
• Compile and run the science softwareo Document changes necessary to compile at TLSCFo Compare output with that provided by the
scientist
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Science Software Integration & Test Procedures
• Update the metadata, QA, and operational codeo Document changeso Integrate the science software o Compile and run the completed software
packageo Compare output
• Update Provenance metadata• Provide documentation to NSIDC• Update the ESDT
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Science Software Integration & Test Procedures
• Deliver DAP to the SIPSo Science, metadata, & QA softwareo Makefile and wrapper scriptso Delivery noteso Static ancillary fileso Checksums
• Support SIPS in resolving processing anomalies
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Delivered Algorithm Package
• A package containing software and documentation sufficient to allow a user to recreate the associated standard product
• 1 DAP per science software delivery• DAP version = file version• Delivered and installed at SIPS for
processing• Available to users from NSIDC
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Delivery Notes
• Describes the software changes, including new requirements
• Lists known issues associated with the release
• Describes the file naming convention• Includes input and output file descriptions• Identifies the required operating system,
compilers, and libraries • Lists and describes all routines and ancillary
files, identifying the ones that have changed
• Contacts• Operating instructions
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
Data Product
Current Version Current Status
L2A Tb’s V12 New version coming soon L2 Ocean V07 Updates expected L2 Land V10 New algorithms due Oct 2014 L2 Rain V11 V12 awaiting documentation L3 Sea Ice V15 Reprocessing completed Jul 2014
Updates for Bootstrap at TLSCF L3 Ocean V05 Updates expected L3 Land V07 Updates due following L2 Land L3 Snow V10 Updates due L3 Rain V07 New algorithm; monthly? L3 Sea Ice Drift B03 Updates due
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• All operational software was updated in 2010 for LANCE processing
• All operational software will be updated to includeo New ISO metadata, updated ECS metadatao New ESDTo New L2A Readero Digital Object Identifier (DOI)
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2A Brightness Temperatureso V12 reprocessing completed July 2013 (RSS v07)o Recalibrated Brightness Temperatureso Improved RFI flags; format changes
• L3 Sea Ice V15o Reprocessing completed August 2015• Update Southern Hemisphere sea ice
mask • Update the algorithm to correct
internal land / ocean flag that conflicted with the new sea ice mask
o Updates expected based on new L2A?
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2 Ocean o Last algorithm updates were in V05, April 2007o Updates expected; will utilize latest TB’s and
record new RFI flags
• L3 Ocean o Last algorithm updates were in V04, May 2010o Updates expected; will utilize the latest RFI flagso Reprocessing after L2 Ocean reprocessing
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2 Land o New delivery due October 2014 o Combined Single Channel Algorithm (SCA) and
Normalized Polarization Difference (NPD) algorithm
o New formato Unified ancillary files
• L3 Land o Updates expected after L2 Land deliveryo Reprocessing after L2 Land reprocessing
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2 Raino V11, July 2010 updates for LANCE processingo GPROF 2010 currently in SSI&T (V12)• Awaiting documentation
• L3 Raino New algorithm; derived from L2 Rain (GPROF
2010)o Monthly; 0.25 degree resolution
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L3 Snow • Last algorithm update B05, November 2005• Updates?
• L3 Sea Ice Drift • Last algorithm update B03, October 2013• Replacement algorithm expected from science
team
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR2 Science Software
• Integration at TLSCF equivalent to AMSR-E products
• JAXA L1Ro Reader written and tested by Bruce Beaumont of
the SIPS (LANCE) and available to science team now
o Data available from SIPS
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR-E Schedule2014 2015 2016 2017
Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4
All Alg to
TLSCF TLSCF Integration & Testing
Algorithm
Updates due
TLSCF I&T*
Final updates to
TLSCF*
TLSCF I&T*
• Jan 2015: Algorithm updates due to TLSCFo For those algorithms with no changes, TLSCF updates
ECS metadata, ISO Lineage metadata, documentation, and DAP
o Please advise if there are no updates to the algorithms• Dec 2016: FINAL End of Mission algorithm updates due to
TLSCF
AMSR-E Senior Review Feb 1, 2016 *AMSR-E extension due to Terra-Aqua ROSES ?
September 23-24, 2014 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR2 Schedule2014 2015 2016 2017
Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4
Beta version Transitional version Validated versionUnified Mask
All alg to TLSCF
TLSCF I&T
Alg Updates Due
TLSCF I&T Alg Updates due
TLSCF I&T