WQX Web and FIFRA DataEPA Region 5
pre-SFIREG meeting WQX demonstration
Larry Theller, ABE, Purdue UniversityLeighanne Hahn, OISC
Conference CallApril 19, 2012 from 1:00 - 2:30 central time
(2:00 - 3:30 eastern time). The conference call number is 866-299-3188, conference code
7193131.
WQX and FIFRA Data
• What is WQX• How is it used• Original concept for data upload• Current “state of the art” data loader• Process flow• Data loader upgrades created for this project• Future Tool (2 year NEIEN project)
2OISC WQX
OISC WQX
WQX as Framework
• The Water Quality Exchange (WQX) is a framework that makes it easier for States, Tribes, and others to submit and share water quality monitoring data over the Internet.
• States, Tribes and other organizations can now submit data directly to the publicly-accessible STORET Data Warehouse using the WQX framework.
• WQX will eventually replace the distributed STORET, the STORET Data Entry Module, Reports Module, and STORET Import Module or SIM as the primary means of submitting water quality monitoring data to EPA.
3
OISC WQXhttp://www.epa.gov/storet/wqx/products/WQX_factsheet.pdf
CDX
STORET
NODEWEB
4
Win 2003
Server
2008 Purdue-OISC WQX NODE Design
Red Hat Entp
MySQL
ECN 8-Core Red Hat Server
Ubuntu
MySQL
MySQL
Oracle
Authenticated QUERY to CDX
Development (Test) computer
Main Development Server
Interim Production ServerRollover to:
Permanent Production Server
abeip867
abe2k3s2
Templeton.ecn
laptops
Data Loader Test Query Test
Backup of Prod. database
Proposed, Tested, but Not Implemented
5
Current WQX Web Design
Staging
CDX
Authenticated upload to staging database
Spreadsheet of results
Excel
QC done and
Reformat to XML
OISC
Authenticated XML upload to CDX
1
26
OISC WQXWQX_Web_User_Guide_v2.0.pdf 7
OISC WQX 8
OISC WQX
WQX_Web_User_Guide_v2.0.pdf
9
OISC WQXhttp://www.epa.gov/storet/wqx/products/WQX_factsheet.pdf
Project Name Monitoring Locations
2011 Activity - Results
2010Activity - Results
2009 Activity - Results
10
OISC WQX
Sample XML for monitoring location upload.
11
OISC WQX 12
In this typical spreadsheet layout, the measurements are in columns, and each set of samples from a location is a row.
12
OISC WQX
The columns need to pivot so each measurement becomes one row, and the data collection notes need to be replicated for each measurement.
13
OISC WQX 14
OISC WQX
The pink colored tab is used to export data for upload; The yellow tabs to set-up the input data;
The green tabs provide a linked reference for documented elements in WQX.
15
OISC WQX 16
OISC WQX 17
OISC WQX 18
OISC WQX 19
OISC WQX 20
OISC WQX
New Tool under development
• Load and Flow Duration Curve (LDC)– Upload of flow data from USGS– Upload of water quality data from USGS– Upload of water quality data from WQX
Current Grant: WQX data in Action21
OISC WQX 22
OISC WQX 23
OISC WQX
Load and Flow Duration Curves
24
OISC WQX
The End
25