Overview of AMRC Goals of AMRC and efforts to improve efficiency of data distribution New AMRC...
28
AMRC Meteorological Data Distribution System Part II: Data Services Antarctic Meteorological Research Center (AMRC), Space Science and Engineering Center (SSEC), University of Wisconsin-Madison, Madison, WI Zach Uttech, Matthew Lazzara, K. Elena Willmot and Linda M Keller
Overview of AMRC Goals of AMRC and efforts to improve efficiency of data distribution New AMRC Website Improved organization User friendly Current
Overview of AMRC Goals of AMRC and efforts to improve
efficiency of data distribution New AMRC Website Improved
organization User friendly Current Data Services Future Data
Services Summary
Slide 3
AMRC aims to provide real-time and archived data and
observations to the public Multiple data sources Observational data
NWP data Old methods of data distribution FTP (File Transfer
Protocol) site Old website A new method of data distribution
Developing a new website portal Improved organization Increased
efficiency And more
Slide 4
Commonly used information AWS Network tab Data & Imagery
tab Recent news posted
Slide 5
Dynamic (click-able) AWS Map AMRC project distributes data for
~63 AWS stations Serves as an accessible central location for
archived AWS data Sidebar Contains supporting AWS information
Slide 6
Dynamic (click-able) AWS Map How to select an individual AWS
Beneficial feature Simultaneous access to data of selected AWS and
the dynamic map Zooming and panning capabilities
Slide 7
AWS Ferrell Station Selection Example General layout Metdata
data loads next to picture Additional data will be organized into
tables Compress region and station lists into pull- down tabs
Slide 8
Sidebar What makes up an AWS? AWS diagram AWS Maps Data
Books/Field Reports
Slide 9
AMRCs Archived Data (FTP site and more)
Slide 10
Satellite Imagery and Composite Thumbnail Constructed from
geostationary and polar orbiting satellites Examples IR, WV, pseudo
color, hourly animations Data & Imagery Tab IR WV
Slide 11
Data & Imagery Tab Models and Forecasts Thumbnail Computer
model data (ECMWF and GFS) overlayed with IR and WV composites
(new!) Mid-level data heights, RH, and VV Surface data isobars,
isotherms, streamlines 500mb Heights MSLP
Slide 12
Data Fusion Thumbnail Composite Animations Satellite derived
motion vectors Ice concentrations Control speed, zoom, and refresh
image Additional composites SST with IR Aqua and Terra motion
vectors Satellite Derived Motion Vectors Ice Concentrations
Slide 13
Antarctic Surface Observations Current and archived data
Upper-Air Observations Recent and archived Radiosonde data, Skew-t
diagrams, and hodographs Aircraft Observations Current
meteorological aircraft reports Satellite Navigations American and
international polar orbiting satellite tracks USAP Stations
Historical surface observation database South Pole, McMurdo, and
Palmer AMRCs Archived Data Ftp site and more
Slide 14
Current Data Services 5 Data Services FTP server Stores
archival data with minimal real-time datasets Wont be eliminated
Rsync Service Updates requested data automatically; saves user
timer Antarctic-IDD (Internet Data Distribution) Local Data Manager
Data sharing network based on Unidatas LDM software Focus on
real-time data Abstract Data Distribution Environment (ADDE)
Contains both real-time and archived data E-mail distribution
Everything we have can be distributed via email Goal provide
self-serviceable data to reduce the effort to fill data
requests!
Slide 15
Slide 16
AMRC.SSEC.WISC.EDUAWS.SSEC.WISC.EDU ADDE Group AWS All
Real-time datasets Examples Hourly composites AWS Model output
Satellite winds More ADDE Group ARCHIVE All ADDE ready archive data
ADDE Group AMRC All Real-time datasets Examples Three hourly
composites AWS Model output More Becoming obsolete ADDE Group
ARCHIVE Will be discontinued
Slide 17
Future Data Services RAMADDA (Repository for Archiving,
Managing and Accessing Diverse Data) Hierarchical collection of
folders and entries (accessed by public via URL) Primary advantages
Store any data type Make data easily accessible to users Built by
NSF funded Unidata Program
Slide 18
Future Data Services RAMADDA (Repository for Archiving,
Managing and Accessing Diverse Data) Testing capabilities as an
experimental effort Easy to load and manage new/old data entries
Long-term goal Most of AMRCs archived data ingested into
RAMADDA
Slide 19
Future Data Services RAMADDA Layout Add descriptions about a
data entry and the time range it covers Data type examples xls file
Mt Flem and Capte H r file Pegasus txt file FTP McIDAS Area File
URLs View Tab Allows for instant visualization of data Animations
and McIDAS area files Graph View
Slide 20
GIS (Geographic Information Systems) software and extensions
used for AMRC products ArcGIS PostGIS PostgreSQL ZigGIS QuantumGIS
Future Data Services
Slide 21
Definitions for GIS Software and Extensions GIS computer system
capable of capturing, storing, analyzing, and displaying
georeferenced information ArcGIS suite of GIS software products
produced by the Environmental Systems Research Inst (ESRI)
QuantumGIS (QGIS) and ArcGIS interact with PostGIS-enabled
databases for data management, visualization, and cartographic
mapping ZigGIS provides access specifically to PostGIS databases
(extension) ArcGIS ZigGIS PostGIS
Slide 22
Definitions for GIS Software and Extensions PostgreSQL
powerful, open-source, relational database system Accessed by users
indirectly through an external application rather than by
application programming stored within the database (back-end
database) PostGIS spatially enables the PostgreSQL server Open
source add-on, gives PostgreSQL the ability to store and manipulate
spatial data used in GIS and Mapping
Slide 23
Applications of the GIS software We use PostgreSQL, PostGIS,
and ZigGIS to Add tables which contain data that is not spatially
referenced Create a database that updates the AWS network map in
real- time
Slide 24
Applications of the GIS software We use ArcGIS and qGIS in day
to day work Beginning to manage information about the ~120 (AMRC +
International) active Antarctic AWS using PostGIS Using the zigGIS
(extension to ArcGIS) to Generate maps of AWS directly from the
database Map any station-related (non-spatial) data through
relation joins in the database
Slide 25
Applications of the GIS software Server applications such as
Geoserver and Mapserver can generate web mapping/feature services
from the same PostGIS-enabled database Allows us to Build near
real-time web mapping interfaces that access the most current data
automatically (from the PostGIS database) Develop a PHP 5/Apache
web interface to allow group editing/management of data about the
AWS network (in the PostGIS database)
Slide 26
Current data services Antarctic-IDD Continue to expand the
number of participants in the network ADDE AMRC group has more
capabilities than AWS server AWS group becoming obsolete Future
data services New AMRC website Dynamic AWS map Satellite composite
and meteorological variable (NWP) overlays (new) Improved
organization over old website GIS software/extensions Update AWS
network in real-time Allow for group editing
Slide 27
Thanks to the Office of Polar Programs at the National Science
Foundation grant No ANT-0838834 for its support of the AMRC project
The authors also wish to thank SSEC and AMRC members for their
contributions to the new AMRC website
Slide 28
Lazzara, MA, G Langbauer, KW Manning, R Redinger, MW Seefeldt,
R Vehorn, and T Yoksas, 2006 Antarctic Internet Data Distribution
(Antarctic-IDD) System 22 nd International Conference on
Interactive Information Processing Systems for Meteorology,
Oceanography, and Hydrology Atlanta, GA American Meteorological
Society Seefeldt, MW, T Yoksas, and MA Lazzara, 2009a Real-time and
archived Antarctic meteorological data via a synergy of interactive
processing tools Antarctic Meteorological Observing Modeling and
Forecasting Workshop 14-15 July 2009 Charleston, SC Seefeldt, MW, T
Yoksas, and MA Lazzara, 2009b The distribution, retrieval, and
visualization of real-time Antarctic numerical weather prediction,
satellite and observational data 10 th Conference on Polar
Meteorology and Oceanography, May 18-21, 2009 Madison, WI Yoksas,
T, J Caron, J McWhirter, M Richards, M Seefeldt, KW Manning, JG
Powers, D Steinhoff, and MA Lazzara, 2009 Using Unidatas RAMADDA
and THREDDS Services to Support Two Disparate Projects AGU 2009
Joint Assembly The Meeting of the Americas, May 24-27, 2009,
Toronto, ON, Canada www.postgis.org www.postgresql.org www.qgis.org
www.unidataucar.edu/software/ramadda