Accessing NASA data

Accessing NASA dataNASA ORNL DAAC

(Distributed Active Archiving Center)

Oak Ridge National Laboratoryhttp://www.daac.ornl.gov/

NASA Observing Spacecraft for Earth System Research

Moderate Resolution Imaging Spectroradiometer (MODIS)

How a Polar Orbiting Satellite orbits…

Sunglint

Haze

Cloud

Data provided by NASA Goddard Space Flight Center. Image processed by Battelle using MODIS HDF Look.

MODIS Aerosol Optical Depth

25 June 2002

Data provided by NASA Goddard Space Flight Center. Image processed by Battelle using MODIS HDF Look.

•NASA’s Earth Observing System (EOS) Program– centerpiece of NASA’s Earth Science Directorate, largest component in the

U.S. Climate Change Science Program– spaced-based observing system– ground-based field campaigns– objective is to enable quick and easy access to data about the earth

•EOS Data and Information System (EOSDIS)– explicitly planned and funded by NASA to make maximum use of the data– data available at 8 Distributed Active Archive Centers (DAACs), organized

by scientific discipline

EOSDIS Archive

TerraTerra

The Earth Observing System (EOS) Program

EOSDIS Distributed Active Archive Centers

JPLJPL

U. AlaskaU. Alaska

U. ColoradoU. Colorado

EDCEDC

ORNLORNL

GSFCGSFC

LaRCLaRC

Cryosphere

Land ProcessesSEDACSEDAC

Socio-economic

BiogeochemicalDynamics

Sea Ice andPolar Processes

AtmosphericProcesses

Upper Atmosphere,Global Biosphere, and

Geophysics

Ocean CirculationAnd Air-sea Interaction

Data Center Earth System Science disciplineASF DAAC- Alaska Satellite Facility

U. of Alaska

Synthetic Aperture Radar (SAR), Sea Ice, Polar processes, Geophysics

GES DAAC - GSFC Earth Sciences

Goddard Space Flight Center

Atmospheric Composition , Atmospheric dynamics, Global Precipitation, Ocean biology, Ocean dynamics, Solar irradiance

GHRC – Global Hydrology Resource Center

Nat’l Space Science & Technology Center

Hydrologic cycle, Severe Weather Interactions, Lightning, Convection

LaRC DAAC –

Langley Research CenterRadiation budget, clouds, Aerosols, Tropospheric Chemistry

LP DAAC – Land processes

EROS Data Center (USGS)Land Processes

NSIDC DAAC- National Snow and Ice Data

U. of Colorado

Snow and ice, Cryosphere and climate

ORNL DAAC-

Oak Ridge National Lab

Biogeochemical dynamics, Ecological data, Environmental processes

PO,DAAC – Physical Oceanography

Jet Propulsion Lab (JPL)

Oceanic Processes, Air-Sea interactions

SEDAC – Socioeceonomic Data and Applications Center

Columbia University

Population, Sustainability, Geospatial data, Multilateral Environmental Agreements

Getting data from Data Centers

• Directly from Data Centers websites– Center-unique search-and-order systems– Specialized data set tools

• Viewing, subsetting, web GIS

• EOS Data Gateway (EDG)- A NASA site where one can search across all the NASA data centers and also order (soon to be replaced by another system called ECHO). Has browse capability. http://eos.nasa.gov/imswelcome

• Global Change Master Directory – Allows one to search across all the NASA data centers plus many other data sites. Over 2,400 providers. Points you to where to order. ( but is not the place to order.) http://gcmd.nasa.gov

• Many of the data sets require special tools for image processing and analysis. These tools are provided by the data centers and are under continual development.

http://eos.nasa.gov/imswelcome

http://gcmd.nasa.gov/

http://ghrc.msfc.nasa.gov/

http://datapool.nsstc.nasa.gov

http://datapool.nsstc.nasa.gov/

Example of a data center search system - hydrology

EOS Data Gatewayhttp://eos.nasa.gov/imswelcome

http://eos.nasa.gov/imswelcome

http://gcmd.nasa.gov/

ORNL DAAC ~ Distributed Active Archive Center

• Mission: Support the needs of NASA’s Earth Science Enterprise (ESE) and Earth Observing System (EOS) Program by assembling, archiving, and distributing terrestrial biogeochemistry and ecosystem dynamics data

• Sponsor: NASA– Martha Maiden - EOSDIS– Diane Wickland - Earth System Science – Carbon Cycle and

Ecosystems

• Is not responsible for satellite downloading. Does get satellite data from other NASA data centers… and then puts it in a format accessible to ecological field researchers.

http://www.daac.ornl.gov/

http://www.daac.ornl.gov/

ORNL DAAC: Roles in EOSORNL DAAC: Roles in EOS

3. Regional and3. Regional and Global Global Studies*Studies*

• Climate• Soils• Vegetation• Hydroclimatology

2. Validation of Remote Sensing 2. Validation of Remote Sensing ProductsProducts

Four primary data management roles, supporting:

1. Field Campaigns1. Field Campaigns• 6-9 year intensive

study of a region:•Amazon (LBA)•Canada (BOREAS)•Southern Africa(SAFARI 2000)

BOREAS

LBA

LBA

S2KS2K

In-situObservations

?

Remote Sensing

LAI/fPAR NPP

LAI/fPARNPP

4. Model Code*4. Model Code*• Benchmark Models

•IBIS, BIOME-BGC, LSM• Manuscript Models

•PNeT, Century, Biome-BGC

http://glcf.umiacs.umd.edu/treecover/zoom1.html



ORNL DAAC data sets & renewable energy?

• Regional & global data relevant to hydropower

– Climate collections - Several global climate data sets. Climate data include measured and modeled values for variables such as temperature, precipitation, humidity, radiation, wind velocity, and cloud cover

– Hydroclimatology collections - data on streamflow and climatology. The data were collected with a range of frequencies (daily and monthly) and are from meteorological and streamflow discharge stations in the U.S.

– River discharge - The Global River Discharge (RivDIS) data set contains monthly discharge measurements for 1018 stations located throughout the world. The period of record varies widely from station to station, with a mean of 21.5 years.

ORNL DAAC data sets & renewable energy?

• Regional & global data relevant to bioenergy

– Climate collections - Several global climate data sets. Climate data include measured and modeled values for variables such as temperature, precipitation, humidity, radiation, wind velocity, and cloud cover

– Soil Collection - data on the physical and chemical properties of soils, including soil carbon and nitrogen, soil water-holding capacity, soil respiration, and soil texture. The data are gridded at spatial scales ranging from regional to global.

– Vegetation Collections - Gridded data on vegetation from regional to continental scales. Information about vegetation data archived at the ORNL DAAC is available on the Leaf Area Index Web page. The DAAC also offers data from the Net Primary Productivity Database, which contains biomass and NPP estimates.

MODIS ASCII Subsets: Remote Sensing Products for Field

Sites

Bob Cook, Steve Margle, Susan Holladay, and Suresh Kumar

ORNL DAACOak Ridge National Laboratory

Distributed Active Archive CenterOak Ridge, Tennessee, USA

Subsets of Terra and Aqua MODIS Land Products for 280 sites worldwide (field sites or flux towers) in ASCII format

7 km x 7 km centered on flux tower or field sites Two annual products, four 8-day products, two 16-day products,

and calculated albedo, from 2000 to present

MODIS ASCII MODIS ASCII Subsets (Coll. 4)Subsets (Coll. 4)MODIS ASCII MODIS ASCII Subsets (Coll. 4)Subsets (Coll. 4)

MODIS Products

Surface Reflectance

Surface Temperature

Land Cover

NDVI / EVI

LAI / fPAR

Net Photosynthesis

Annual NPP

Albedo (calc)

Reflectance – BRDF

Adjusted

Getting MODIS Data from the ORNL DAAC

NDVI Time series for cropland in Michigan

Dec 02 Feb 02 Apr 02Mar 02Jan 03

Greenup (Above images) – Matches with time series

Also 2001, seems to be a special case – Scope for further analysis

Location from Google maps

Location

* Images from USGS Global Visualization Viewer

http://glovis.usgs.gov/

Multiple paths to access data

• FTP – most popular method • Picklists

– Site, investigator, land cover class, network

• WebGIS– Site location plus background layers

• GeoTIFF file picklist– with WebGIS

• Google Earth– MODIS Subset metadata file that opens in

Google Earth application

Using Google Earth to Access Subsets

Using Google Earth to Access Subsets

NDVI at Lost CreekLAI at Lost Creek

Pixel ValuesMean Value of Pixels

Percent of Pixels that meet QC Criteria

Albedo (Visible)

Comparison of MODIS and Tower NDVIMissouri Ozark Site

0

0.2

0.4

0.6

0.8

1

0 50 100 150 200 250 300 350

Julian Day in 2005

ND

VI

Tower NDVI

MODIS NDVI

NDVI

Pixel ValuesMean Value of Pixels


Beginning to compile site data for comparison

ASCII tiles ASCII tiles (per SDS)(per SDS)

InventoryInventory

Acquisition and Processing of MODIS Tiles: Tool for North America

MODISMODISDataDataPoolPool HDF TilesHDF Tiles

InventoryInventoryAutomatic Automatic

FTP pull from FTP pull from Data PoolData Pool

ORNL DAACORNL DAAC

MODIS Reprojection

Tool:Conversion

to Binary

LP DAACLP DAAC

1200 x 1200 km

ORNL Code: Conversion

to ASCII

SDS = Science Data Set

Files for User Interface

Computer Resources

Dedicated Server

10 TB RAID storage

(capacity through 2009 for 1.5 TB/y)

Temporary

User Interface

• User selects center coordinates or site, areal extent, and period of interest

• Processing of time series (selection of tiles, mosaicking, generating time series data file and graphs) takes 10 to 60 minutes for most products (depends on area, time period, and product)

• URL with graphs and pointers to data files is emailed to user

EVI Southern California

Time SeriesExample

Center PixelMean Value of Pixels


Land Cover Visualization

Mean (std dev) for pixels with same land cover as the center pixel (20 of 49 pixels)

Center pixel = Woody Savannas

Center PixelMean Value of Pixels


Time SeriesExample

Data Download Options

Importing ASCII Grid Data into GIS/Image processing software

Table of Contents

Importing data into:

• ArcGIS 9.x

• ENVI

• ArcView 3.x

• GRASS

Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC

Importing the ASCII Grid data into ArcGIS 9.x


Go to Table of Contents

Example File : GRID.MOD13A2.asc

MODIS ASCII Subsets: Data Visualization[MOD13A2] Terra Vegetation Indices (NDVI, EVI) USA, Walker Branch Watershed, Oak Ridge, TennesseeCentered on Latitude [35.958767] Longitude [-84.287433]7 Kilometers [7 Pixels] Wide and 7 Kilometers [7 Pixels] High Requested Time Span November 2005 to November 2005For a PRJ file, access http://daac.ornl.gov/cgi-bin/MODIS/GR_common/modis.prjFor a prj.adf file, access http://daac.ornl.gov/cgi-bin/MODIS/GR_common/prj.adf

MODIS HDF Tile MOD13A2.A2005305.h11v05.004.2005325075111.hdf

-----START Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005305 (Nov. 1, 2005)-----ncols 7nrows 7xllcorner -7589988.98yllcorner 3995608.83cellsize 926.62543305583381nodata_value -99999995579 5846 5940 5769 5566 5869 57766173 5722 5876 5912 5920 5882 56325844 5812 5972 5904 5154 4966 52825786 5765 5822 5695 5739 5817 59925609 5094 4333 5790 5763 5793 58635602 5499 5844 5811 5210 5436 57284749 5674 5419 2617 4012 5607 5219-----END Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005305 (Nov. 1, 2005)-----

MODIS HDF Tile MOD13A2.A2005321.h11v05.004.2005342022515.hdf

-----START Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005321 (Nov. 17, 2005)-----ncols 7nrows 7xllcorner -7589988.98yllcorner 3995608.83cellsize 926.62543305583381nodata_value -99999995279 5480 5584 5584 5226 5248 52755781 5508 5517 5383 5347 5281 50515634 5554 5571 5511 4825 4557 53445635 5375 5293 5432 5298 5562 55815386 4646 4660 5279 5446 5480 53935396 5118 5750 5563 4825 5260 55874774 5425 5047 3500 4174 5187 4955-----END Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005321 (Nov. 17, 2005)-----


Step 1

Copy contents between “-----START Scientific Data Set (Band)…………..”And “-----END Scientific Data Set (Band)……………...”

Into a separate file.

If there are more than one START-END entries, copy contents within each of the START-END statements into individual files like:

File GRID_MOD13A2_A2005305 _1_km_16_days_NDVI.asc from example file GRID.MOD13A2.asc

ncols 7nrows 7xllcorner -7589988.98yllcorner 3995608.83cellsize 926.62543305583381nodata_value -99999995579 5846 5940 5769 5566 5869 57766173 5722 5876 5912 5920 5882 56325844 5812 5972 5904 5154 4966 52825786 5765 5822 5695 5739 5817 59925609 5094 4333 5790 5763 5793 58635602 5499 5844 5811 5210 5436 57284749 5674 5419 2617 4012 5607 5219


Importing the individual file GRID_MOD13A2_A2005305 _1_km_16_days_NDVI.asc into ArcGIS :

Step 2

Using ArcToolbox from ESRI’s ArcGIS 9.x software

Select:

Conversion Tools To Raster ASCII to Raster


Step 3

Provide path to ASCII file (GRID_MOD13A2_A2005305 _1_km_16_days_NDVI.asc )and Output Raster (MD13A205305)

Click OK


Step 4

After converting to Raster the output raster (MD13A205305) would automatically load into ArcMap


Export this file (MD13A205305) into ArcGIS GRID

Step 5

Right Click on the file to Export

Provide output filename (e.g. md13a2053051)and format


Setting up the projection

Download file prj.adf from http://daac.ornl.gov/cgi-bin/MODIS/GR_common/prj.adf

copy the prj.adf file into the GRID file directory (md13a2053051) created in the previous step

Step 6


If the projection isn't defined, use the following file to define the projection.

Download file modis.prj from http://daac.ornl.gov/cgi-bin/MODIS/GR_common/modis.prj

Copy this file into <ESRI installation Folder>\Coordinate Systems\Projected Coordinate Systems\World\Sphere-basedand manually set the projection for the file

Step 7

Load the GRID file in ArcMap – Make sure that the projection is defined on the dataset

Final output md13a2053051 with projection set, overlaid with the MODIS site locations


Documents

Accessing NASA data