16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 Team Lead Science Computing Facility
TLSCF at UAH
Dr. Roy SpencerDr. Danny Braswell
Dr. Elena LoblMr. Don Moss
Ms. Dawn Conway
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
TLSCF at UAH
• TLSCF Data Flow• TLSCF Operating Environment• Science Team Software Delivery
Requirements• Current AMSR-E Science Software• Current AMSR2 Science Software• AMSR-E / AMSR2 Schedule
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR-E / AMSR2TLSCF
Science Team
GHCCSIPS
NSIDC DAAC
Algorithm, documentation, QA, and ECS metadata updates
Documentation, ESDT’s, user support
Browse images, anomaly resolution, Provenance metadata, LANCE product reviewDelivered Algorithm Package (DAP)
Data Flow
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E(Sunny)
AMSR2 /Future AMSR-E(Gusty)
Operating System RHEL 5 - 32 bit RHEL 6 - 64 bitC compiler gcc gccFortran compiler Lahey, ifort gfortran, ifortHDF 4.2r1 5HDF-EOS 2.14 5
TLSCF Operating Environment
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCFScience Team
Software Delivery Requirements
• Update from the latest DAP• Software
o HDF versiono HDF-EOS Geo fieldso Use current version of input data
• Delivery notes • Include test input / output data
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Delivery Notes
• Describes the science software changes, including new requirements
• Lists known issues associated with the release
• Describes the file naming convention• Includes input and output file descriptions• Identifies the required operating system,
compilers, libraries, and third party software
• Lists and describes all routines and ancillary files, identifying the ones that have changed
• Contacts• Operating instructions
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software Data Product
Current Version Current Status
L2A Tb’s V12 New version soon? L2 Ocean V07 Updates due L2 Land V10 New algorithm delivered to TLSCF L2 Rain V11 Delivered to SIPS L3 Sea Ice V15 Reprocessing completed Jul 2014
Updates for Bootstrap at TLSCF L3 Ocean V05 Updates? L3 Land V07 Updates due following L2 Land L3 Snow V10 Updates due L3 Rain V07 New algorithm; monthly? L3 Sea Ice Drift B03 Updates due
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• All operational software is updated to includeo New ISO metadata, updated ECS metadatao New ESDTo New L2A Readero Digital Object Identifier (DOI)
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2A Brightness Temperatureso V12 reprocessing completed July 2013 (RSS v07)o Recalibrated Brightness Temperatureso Improved RFI flags; format changes
• L3 Sea Ice V15o Reprocessing completed July 2014• Update Southern Hemisphere sea ice
mask • Update the algorithm to correct
internal land / ocean flag that conflicted with the new sea ice mask
o Minor updates to Bootstrap at TLSCF (received 9-14-15)
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2 Ocean o Last algorithm updates were in V05, April 2007o Updates expected; will utilize latest TB’s and
record new RFI flags• L3 Ocean
o Last algorithm updates were in V04, May 2010o Updates expected; will utilize the latest RFI flagso Reprocessing after L2 Ocean reprocessing
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2 Land o At TLSCF, I&T has beguno Combined Single Channel Algorithm (SCA) and
Normalized Polarization Difference (NPD) algorithm
o New formato Unified ancillary files
• L3 Land o Updates expected after L2 Land deliveryo Reprocessing after L2 Land reprocessing
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L2 Raino GPROF 2010 currently at SIPS for reprocessingo Next update?
• L3 Raino New algorithm; derived from L2 Rain (GPROF
2010)o Monthly; 0.25 degree resolution
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Current AMSR-E Science Software
• L3 Snow o Last algorithm update B05, November 2005o Updates?
• L3 Sea Ice Drift o Last algorithm update B03, October 2013o Replacement algorithm expected from science
teamo Validated?
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR2 Science Software
• Integration at TLSCF equivalent to AMSR-Eo Update the metadata, QA, and operational codeo Update Provenance metadatao Integrate and testo Compare outputo Prepare DAPo Provide documentation to NSIDCo Update the ESDTo Provide support to the SIPS to resolve processing
issues
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR2 Science Software
• JAXA L1Ro Reader written and tested by Bruce Beaumont of
the SIPS (LANCE) and available to science team now
o Data available from SIPS• Version B01 of AMSR2 Standard Products
Ready for I&T at TLSCFo L3 Sea Ice o L2 Land o L2 Rain / Ocean (GPROF)
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
AMSR-E Schedule2014 2015 2016 2017
Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4
All Alg to TLSCF TLSCF Integration & Testing
Algorithm
Updates due TLSCF I&T*
Final updates
to TLSCF TLSCF I&T*
• Dec 2016: FINAL End of Mission algorithm updates due to TLSCF
AMSR-E Senior Review Feb 1, 2016 *AMSR-E extension due to Terra-Aqua ROSES ?
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Tentative AMSR2 Schedule
2014 2015 2016 2017Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4
Beta version Transitional version Validated versionUnified Mask
Algorithms to TLSCF TLSCF I&T
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Overview of Tasks
• Support Science Team• Integrate and test science software• Maintain metadata, QA software, and
ESDT’s• Prepare all software for operations
environment• Deliver DAP to the SIPS• Support the SIPS in resolving processing
anomalies• Support NSIDC (user inquiries and
documentation)• Documentation and web pages
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCFDelivered Algorithm Package
• A package containing software and documentation sufficient to allow a user to recreate the associated standard product
• 1 DAP per science software delivery• DAP version = file version• Delivered and installed at SIPS for
processing• Available to users from NSIDC
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Science Software Integration & Test Procedures
• Update the metadata, QA, and operational codeo Document changeso Integrate the science software o Compile and run the completed software
packageo Compare output
• Update Provenance metadata• Provide documentation to NSIDC• Update the ESDT
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCFScience Software
Integration & Test Procedures
• Review each science team delivery o Begin with current DAP?o Document changes in software and ancillary files?o Output file meets ECS requirements?o Known issues, bug fixes
• Compile and run the science softwareo Document changes necessary to compile at TLSCFo Compare output with that provided by the
scientist
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer
AMSR-E / AMSR2 TLSCF
Science Software Integration & Test Procedures
• Deliver DAP to the SIPSo Science, metadata, & QA softwareo Makefile and wrapper scriptso Delivery noteso Static ancillary fileso Checksums
• Support SIPS in resolving processing anomalies