Enhancing Data Sharing Enhancing Data Sharing and Access: STORET and Access: STORET

and WQXand WQX

The STORET ProgramThe STORET Program

STORET: STOrage and RETrieval of water STORET: STOrage and RETrieval of water quality monitoring dataquality monitoring data

EPA’s STORET Program:EPA’s STORET Program: promotes sound data management practices promotes sound data management practices stores and maintains water quality data stores and maintains water quality data

submitted by agencies/groups across the submitted by agencies/groups across the nation in the STORET Data Warehousenation in the STORET Data Warehouse 3

The National STORET Data The National STORET Data WarehouseWarehouse

A national repository of water quality monitoring data – A national repository of water quality monitoring data – “Modernized STORET”“Modernized STORET”

Stores water data of all types (biological, chemical, Stores water data of all types (biological, chemical, physical) submitted by states, tribes, watershed groups, physical) submitted by states, tribes, watershed groups, other federal agencies, and universitiesother federal agencies, and universities

Web-enabled: Data are available -- and can be Web-enabled: Data are available -- and can be submitted -- using the Websubmitted -- using the Web

Encourages data sharing at a national levelEncourages data sharing at a national level

Who Puts Data in?Who Puts Data in?

State environmental agenciesState environmental agencies

Tribal environmental agencies and groupsTribal environmental agencies and groups

Volunteer groups and watershed organizationsVolunteer groups and watershed organizations

UniversitiesUniversities

Federal AgenciesFederal Agencies

Importance of Data SharingImportance of Data Sharing

State and Tribal 106 ProgramState and Tribal 106 Program Water Quality Programs require Monitoring Strategies Water Quality Programs require Monitoring Strategies

that include monitoring objectives, design, etc.that include monitoring objectives, design, etc. Water monitoring data management and sharing is Water monitoring data management and sharing is

vitalvital

Biannual Assessment Reporting Biannual Assessment Reporting State 305(b) and 303(d) programs and Integrated State 305(b) and 303(d) programs and Integrated

ReportingReporting Cross jurisdictional monitoring data in support of Cross jurisdictional monitoring data in support of

water quality condition assessmentswater quality condition assessments

Managing Data LocallyManaging Data Locally

Data sharing at a national level benefits Data sharing at a national level benefits from:from: Well documented data at a local levelWell documented data at a local level Well managed data at a local level Well managed data at a local level

WQX FlowWQX Flow

Updated STORET

HomepageWeb Services

Mapping Applications(EM, WME)

Tools for Data Analysis National STORET

Data Warehouse

Central Data Exchange

(CDX)

WQX Node or

Node ClientSubmission

XML sent via Internet

Processing Software

WQXDatabase

State / TribeData Mgmt System

Exchange NetworkExchange Network

WQX is one of many media “flows” on the WQX is one of many media “flows” on the Exchange NetworkExchange Network

Grants available to all organizations that Grants available to all organizations that wish to submit via WQXwish to submit via WQX States (DEQs, DPHs, Ag agencies); TribesStates (DEQs, DPHs, Ag agencies); Tribes Have various goals – basic capacity to Have various goals – basic capacity to

mentoringmentoring WQX gets over 20 proposals every year WQX gets over 20 proposals every year

(more than any other flow in OW)(more than any other flow in OW)

Goals of the WQX EffortGoals of the WQX Effort

1.1. Make data submittal to WQX easierMake data submittal to WQX easier

2.2. Make data sharing more sustainableMake data sharing more sustainable

3.3. Make it easier to get data out of Make it easier to get data out of STORETSTORET

Goal 1: Data Easier to submitGoal 1: Data Easier to submit

WQX 1.0 was released in February 2007WQX 1.0 was released in February 2007 Since then we’ve received >7 million results Since then we’ve received >7 million results

via WQXvia WQX WQX 2.0 was released in July 2008WQX 2.0 was released in July 2008

Convened a workgroupConvened a workgroup Identified and discussed data elementsIdentified and discussed data elements Finalized the schema in April 2008Finalized the schema in April 2008

WQX Web currently availableWQX Web currently available Small organization’s data submission toolSmall organization’s data submission tool

Goal 2: More SustainableGoal 2: More Sustainable

WQX is based around the ‘Science of WQX is based around the ‘Science of water monitoring’, not a technologywater monitoring’, not a technology

No longer chasing a specific technologyNo longer chasing a specific technology No longer force our data partners to run a No longer force our data partners to run a

particular software in order to share dataparticular software in order to share data

Goal 3: Easier to get data out of Goal 3: Easier to get data out of STORET STORET

Began efforts to revamp sections of the Began efforts to revamp sections of the STORET web siteSTORET web site Created new mapping interfacesCreated new mapping interfaces Created Watershed summary reportsCreated Watershed summary reports Created Web ServicesCreated Web Services

What does WQX mean for users?What does WQX mean for users?

Distributed STORET users:Distributed STORET users: Need to get a replacement databaseNeed to get a replacement database Found that a lot of states where mainly using Found that a lot of states where mainly using

distributed STORET as a way of submitting – not to distributed STORET as a way of submitting – not to actually manage dataactually manage data

Non distributed STORET users:Non distributed STORET users: Can continue to use their own databasesCan continue to use their own databases Must “map” their data to the common schemaMust “map” their data to the common schema

Small usersSmall users WQX Web is the tool they can useWQX Web is the tool they can use

State / Tribal WQX UsersState / Tribal WQX Users The following organizations, by region, have submitted The following organizations, by region, have submitted

data via WQX data via WQX R1: ME DEP, VT DEC, RI DEMR1: ME DEP, VT DEC, RI DEM R3: PA DEP, DE DNREC, DRBC, WV DEPR3: PA DEP, DE DNREC, DRBC, WV DEP R4: GA EPDR4: GA EPD R5: WI DNR, MI DEQR5: WI DNR, MI DEQ R6: TX CEQR6: TX CEQ R7: EPA R7 monitoring programR7: EPA R7 monitoring program R8: Wind River TribesR8: Wind River Tribes R9: Yurok Tribe, Big Valley Rancheria, HualapaiR9: Yurok Tribe, Big Valley Rancheria, Hualapai R10: Stillaguamish TribeR10: Stillaguamish Tribe BEACHES programs across many statesBEACHES programs across many states

Data Coverage: 2004Data Coverage: 2004

20082008

A new tool that is easy to use for submitting data to EPAA new tool that is easy to use for submitting data to EPA Accepts basic input formats (i.e. Excel Spreadsheets)Accepts basic input formats (i.e. Excel Spreadsheets) Tool will have translations for mapping data to WQX Tool will have translations for mapping data to WQX

domain values or defaultsdomain values or defaults Tool creates WQX XML that a user can send through the Tool creates WQX XML that a user can send through the

WQX frameworkWQX framework

WQX WebWQX Web

Accessing DataAccessing DataThe National STORET Data Warehouse serves as the national repository for Modern STORET data as well as WQX data. Users may obtain data from the warehouse through the STORET home page : www.epa.gov/storet

Web services providing direct access to warehouse data will also provide enhanced accessibility to the data.

STORET Warehouse UpdatesSTORET Warehouse Updates

The National STORET Data Warehouse The National STORET Data Warehouse enhancements for improved data enhancements for improved data accessibilityaccessibility New Watershed Summary – Available NowNew Watershed Summary – Available Now New Web Services – Available NowNew Web Services – Available Now

Please visit the STORET website for more Please visit the STORET website for more information : www.epa.gov/storetinformation : www.epa.gov/storet

Watershed Summary ExamplesWatershed Summary Examples