7
National Aeronautics and Space Administration Soil Moisture Active Passive Mission SMAP 3 rd Cal/Val Workshop Nov. 14-16, 2012 Core Validation Site Data Flow in SMAP Cal/Val A. Colliander Jet Propulsion Laboratory, California Institute of Technology This work was carried out in Jet Propulsion Laboratory, California Institute of Technology under contract with National Aeronautics and Space Administration. © 2012 California Institute of Technology. Government sponsorship acknowledged.

10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

Embed Size (px)

Citation preview

Page 1: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

National Aeronautics and Space Administration

Soil Moisture Active Passive Mission

SMAP

3rd Cal/Val Workshop Nov. 14-16, 2012

Core Validation Site Data Flow in

SMAP Cal/Val

A. Colliander

Jet Propulsion Laboratory, California Institute of Technology

This work was carried out in Jet Propulsion Laboratory, California Institute of Technology under contract with National Aeronautics and Space Administration. © 2012 California Institute of Technology. Government sponsorship acknowledged.

Page 2: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

Data  storage  for  all  sites

Production  and  data  storage

Time  and  space  collocation  wrt  validation  sites  (cal/val  products)

Data  sets  over  the  sites

Scaling  function  to  represent  footprint

Data  sets  corresponding  to  SMAP  products  

Compare  data  sets

Field  experiment  data

SDS

Time  and  space  collocation  wrt  

other  data  sources  (cal/val  products)

Data  sets  matching  other  data  sources

Model  products

Other  satellite  data  products

Analyze  results

Cal/Val  Community

Cal/Val  ReportingFeedback

Data  sets  corresponding  to  SMAP  products  

Soil Moisture Cal/Val Processing Flow: Core Validation Site Data Pre-processing

Page 3: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

In Situ Data Flow for SMAP Data Product Calibration and Validation

SMAP Science Data System at JPL

Internet

1. Ingestion

Match-up data

Supporting data

Other than automated

data Raw Data

3. Quality check

QC’d Data

SMAP Products

Local FTP-Site of a Core

Validation Site

4. Up-scaling

function

Upscaled data

5. Match-ups for all sites

and products

2. Reformatting

(if needed)

Page 4: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

•  In situ data processing tools 1.  Ingestion tool

•  Specifications for the source 2.  Reformatting tool

•  Original format (if different from the pre-defined format)

3.  Quality checking tool •  Some default tests •  What is done by the provider?

4.  Up-scaling tool •  Function defined for each site individually •  Possible to have several up-scaled footprints

within a site (geographically and product-wise) 5.  Match-up tool

•  Overpass time at site location

TJJ–4

SMAP Cal/Val Tools

Page 5: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

Data  storage  for  all  sites

Production  and  data  storage

Time  and  space  collocation  wrt  validation  sites  (cal/val  products)

Data  sets  over  the  sites

Scaling  function  to  represent  footprint

Data  sets  corresponding  to  SMAP  products  

Compare  data  sets

Field  experiment  data

SDS

Time  and  space  collocation  wrt  

other  data  sources  (cal/val  products)

Data  sets  matching  other  data  sources

Model  products

Other  satellite  data  products

Analyze  results

Cal/Val  Community

Cal/Val  ReportingFeedback

Data  sets  corresponding  to  SMAP  products  

Soil Moisture Cal/Val Processing Flow: Data Analysis and Reporting

Page 6: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

Validation Using Core Validation Sites: Baseline Sequence of Actions

Goal Confirm soil moisture product meets 0.04 m3/m3 accuracy

Steps 1.  Match up retrieved soil moisture with up-scaled core validation site ground data in time and space.

2.  Inspect scatterplots and time series. 3.  Compute RMSE, bias, and correlation for each core validation site. 4.  Compute mean RMSE over all core validation site to get the metric.

Resolution of anomalies

When/where retrieval and observed data do not match well (not inclusive list): •  Inspect flags for anomalous surface conditions (e.g., rain, snow, high

biomass, high topography, high water fraction within grid cell, etc.). •  Test alternate soil dielectric models. -  Baseline is Mironov. Dobson and Wang are also available for testing.

•  Test alternate soil temperature sources. -  Baseline is GEOS-5. ECMWF, GLDAS, or NCEP can be acquired at

small volume for regional study. •  Test alternate retrieval algorithms. -  E.g. for L2_SM_P the baseline is SCA. LPRM and DCA are also

available for testing.

AC–6

Page 7: 10. Core Validation Site Data Flow in SMAP Cal/Val (A. Colliander

•  Analysis tools –  Required tools

•  Tool to provide validation metric against core validation sites (mean, rmse, correlation)

•  Tool to provide comparison with satellite and model products (triple-collocation) •  Tool to visualize products and validation results •  Cross-comparison between SMAP soil moisture products

–  Support tools (not inclusive list) •  Identify the areas where the retrievals have not been compromised by the surface

conditions (Precipitation, VWC, F/T, water bodies, Urban area) •  Tools to select the known water bodies •  Assess the threshold limits of conditions when algorithms meet soil moisture

accuracy requirements •  Cross calibrate against various ancillary information and land covers •  Product specific airborne data pre-processing •  Pattern mapping with other satellites (Aquarius, GCOM-W, SAOCOM, and SMOS) •  Pattern mapping with land surface models (GEOS-5, NCEP, ECMWF)

TJJ–7

SMAP Cal/Val Tools