Embed Size (px)
DESCRIPTION
Cold Land Processes Workshop 28 May 2003 Unique aspects of field data collection Data entry techs (data monkeys) learned data protocol first hand; Aware of changes in protocol (briefings); some say in protocol changes Collected data as well as entered Data entry while collection fresh in surveyor's mind catches errors and clearly identifies idiosyncrasies (Saved as much as 10-20% of data collection that would otherwise have to have been thrown out due to unanswerable questions.) “Touching the data”—Data monkeys had some understanding of data applications, processing, and science and caught things a computer wouldn’t “Belt and suspenders” back ups
Citation preview
CLPx Data ManagementMark Parsons
9th Cold Land Processes Workshop28 May 2003
Cold Land Processes Workshop 28 May 2003
Field data collection process
1. Interview surveyor and note any idiosyncrasies2. Photocopy field notebook3. Enter data into spreadsheets according to detailed style
sheet4. Download photos and save according to surveyor5. Note questions for surveyor and follow up at briefing6. Print and review data entry accuracy7. Check counts, means, and standard deviations (depths)8. Convert to ASCII and run auto QC and formatting (pits)9. Make backups and deliver beta version of data10. Produce GIS images and review
Cold Land Processes Workshop 28 May 2003
Unique aspects of field data collection• Data entry techs (data monkeys) learned data protocol first
hand; Aware of changes in protocol (briefings); some say in protocol
changes Collected data as well as entered
• Data entry while collection fresh in surveyor's mind catches errors and clearly identifies idiosyncrasies (Saved as much as 10-20% of data collection that would otherwise have to have been thrown out due to unanswerable questions.)
• “Touching the data”—Data monkeys had some understanding of data applications, processing, and science and caught things a computer wouldn’t
• “Belt and suspenders” back ups
Cold Land Processes Workshop 28 May 2003
Additional QC and formatting• Rename photos and edit according to surveyor
comments (Four photo types: roughness, general terrain, pit wall detail, other)
• Create/Revise automated QC and formatting scripts
• Produce final QCed ASCII tables of the data (over 30 warnings, and QC flags)
• Derived values include snow water equivalent and various means, maximums, and minimums.
• Thorough documentation and references
Cold Land Processes Workshop 28 May 2003
Satellite data from NSIDC
• MODIS, SSM/I, AMSR• Common grids and formats:
UTM and Geographic grids of the LRSA GeoTIFF and flat binary files with ASCII
headers Individual files per channel
Cold Land Processes Workshop 28 May 2003
Other data
• We’ve collected basic metadata for all data sets. Thanks to our data wrangler, Nick.
• Please contact me or Nick Rutter to make data delivery arrangements:[email protected] [email protected] 952-361-6610 ext. 230
• Please deliver final data• Data will be embargoed to CLP investigators for
one year from receipt• All data will be open to the public 1 October 2004
Cold Land Processes Workshop 28 May 2003
Current Data Access
• Data currently embargoed to CLP investigators. 1st public data release 1 Oct. 03
• You must register with NSIDC and be approved by the Chair of the CLP working group
• Register at http://nsidc.org/data/clpx/• Access data at ftp://sidads.colorado.edu/clp
five subdirectories aircraft ground_data ground_remote_sensing incoming satellite
• Summary table of data available at http://nsidc.org/data/clpx/data.html
Cold Land Processes Workshop 28 May 2003
Cold Land Processes Workshop 28 May 2003
Data sets currently availableData Set Period Available
Snow depth transects IOP1 and 2
ISA Snow Pits All IOPs (IOP1 preliminary)
LSOS Snow Pits IOP1 and 2
Photos IOP1 and 2
Sub-canopy Energetics at LSOS IOP1 and 2
FMCW quicklooks IOP1 and 2
GBMR-7 4 days Dec. 02, IOP3, part of IOP4.
PSR IOP1
MODIS Several days in spring 02
Ungeoreferenced Hyperion reflectances
15 Feb. 2002 and 19 Mar. 2002
GPS at Langley IOP1
Cold Land Processes Workshop 28 May 2003
Future data access
• All products listed in NSIDC data catalog with simple search and subject and title indexes
• Summary table of all CLP products, temporal and spatial coverage, and parameters
• Sophisticated search by space, time, parameter, and source?
• Integrated (e.g., GIS) data set of key parameters
Cold Land Processes Workshop 28 May 2003
Integrated data set parameters
• Key gridded remote sensing radiances and reflectances (Pathfinder channels?)
• Remote sensing derived products: Snow water equivalent Snow-covered area Snow depth Grain size Soil moisture Freeze/thaw
• Key in-situ measurements SWE Snow depth Snow wetness Grain size Surface roughness Soil, snow, air temperature Soil moisture Other Met data?
• Separate consideration of LSOS?
