Hydrologic Information System
GIS – the water environment
Water Resources – the water itself
CUAHSI HIS: NSF-supported collaborative project: UT Austin + SDSC + Utah State + Drexel + South Carolina (www.cuahsi.org/his/). PI: David R. Maidment (UT-Austin) Goals:. provide rapid uniform access to heterogeneous hydrologic data, and facilities for data publishing;. develop a framework for synthesizing data and models in a region (support for observatories); . strengthen place-based hydrologic science. quantify and visualize the movement of water and chemicals continuously in space and time. hydrologic education CyberInfrastructure project
Point Observations Information Model
Data Source
Network
Sites
Variables
Values
{Value, Time, Qualifier, Offset}
USGS
Streamflow gages
Neuse River near Clayton, NC
Discharge, stage (Daily or instantaneous)
206 cfs, 13 August 2006
• A data source operates an observation network• A network is a set of observation sites• A site is a point location where one or more variables are measured• A variable is a property describing the flow or quality of water• A value is an observation of a variable at a particular time• A qualifier is a symbol that provides additional information about the value• An offset allows specification of measurements at various depths in water
http://www.cuahsi.org/his/webservices.html
GetSites
GetSiteInfo
GetVariables
GetVariableInfo
GetValues
Locations
Variable Codes
Date Ranges
WaterML and WaterOneFlow
GetSiteInfoGetVariableInfoGetValues
WaterOneFlowWeb Service
Client
STORET
NAMNWIS
DataRepositories
Data
DataData
EXTRACTTRANSFORMLOAD
WaterML
WaterML is an XML language for communicating water dataWaterOneFlow is a set of web services based on WaterML
WaterOneFlow• Set of query functions • Returns data in WaterML
NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, ODM (multiple sites)
Observation Stations
Ameriflux Towers (NASA & DOE) NOAA Automated Surface Observing System
USGS National Water Information System NOAA Climate Reference Network
Map for the US
http://river.sdsc.edu/DASH
Multiscale Information System
• Global data• National data• State data
• Project in region ….
• Principal investigator data
HISServers
WATERS Network Information System
NSF has funded work at 11 testbed sites, each with its own science agenda. A CUAHSI
Hydrologic Information Server is installed at each site.
Utah State University
Texas A&M Corpus Christi
National HIS Server atSan Diego SuperComputer Center
Corpus Christi Bay WATERS Testbed site
Montagna stations
SERF stations
TCOON stations
USGS gages
TCEQ stations
Hypoxic Regions
NCDC station
National Datasets (National HIS) Regional Datasets (Testbed HIS)
USGS NCDC TCOON Dr. Paul Montagna TCEQ SERF
Hydrologic Information Server
• Supports data discovery, delivery and publication– Data discovery – how do I
find the data I want?• Map interface and
observations catalogs• Metadata based Search
– Data delivery – how do I acquire the data I want?
• Use web services or retrieve from local database
– Data Publication – how do I publish my observation data?
• Use Observations Data Model
Hydrologic Information Server
Microsoft SQLServer Relational Database
Observations Data & Catalogs Geospatial Data
GetSites
GetSiteInfo
GetVariables
GetVariableInfo
GetValues
DASH – data access system for hydrologyWaterOneFlow services
ArcGIS Server
SQL Server
ODMs and catalogs. All instancesexposed as ODM (i.e. have standard ODM tables or views: Sites, Variables, SeriesCatalog, etc.)
NWIS-IID
NWIS-DV
ASOS
STORET
TCEQ
BearRiver
. . .
Spatial store
Geodatabase or collection of shapefilesor both
NWIS-IID points
NWIS-DV points
ASOS points
STORET points
TCEQ points
BearRiver points
. . .
My new ODM
My new points
More databases
More synced layers
DASH Web Application
Background layers
(can be in the same or separate spatial store)
WOF services
Web services from a common template
NWIS-IID WS
NWIS-DV WS
ASOS WS
STORET WS
TCEQ WS
BearRiver WS
. . .My new WS
More WS fromODM-WS template
USGS
NCDC
EPA
TCEQ
Web Configuration fileStores information about registered networks
MXDStores information about layers
WSDLs
, web
serv
ice U
RLs Connection
strings
Layer info,
symbology, etc.
ODMDataLoader
2
6
5
3
1
4
WORKGROUPHISSERVERORGANIZATION
STEPS FORREGISTERINGOBSERVATIO
NDATA
Data Heterogeneity
• Syntactic mediation– Heterogeneity of format– Use WaterML to get data
into the same format
• Semantic mediation– Heterogeneity of meaning– Each water data source
uses its own vocabulary– Match these up with a
common controlled vocabulary
– Make standard scientific data queries and have these automatically translated into specific queries on each data source
• Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them
Objective
NWIS
NARR
NAWQANAM-12
request
request
request
request
request
requestrequest
request
request
return
return
return
return
return
returnreturn
return
return
What we are doing now …..
Michael PiaseckiDrexel University
Semantic MediatorWhat we would like to do …..
NWIS
NAWQA
NARR
generic
request
GetValues
GetValues
GetValues
GetValues
GetValues
GetValuesGetValues
GetValues
GetValues HODM
Michael PiaseckiDrexel University
HydroSeek: http://www.hydroseek.org
HydroseekDemo
What’s coming• Integrated real time data management
– SDL (Utah State)– DataTurbine (SDSC)
• Creating a community vocabulary for parameters, and tagging your variables
• More agency data sources• Analysis of catalogs: towards spatial history of
hydrologic observations• Standards compliance• A flexible modeling framework• Integration with gridded data, and with other CI
projects: LTER, GEON, NEON, etc.• Towards digital watershed management
TaggerDemo
• Scalable, secure, programmable, versatile for different data types and vendor interfaces,developer community, with many applications written (e.g. data viewers and plug-ins), open source, high performancestreaming (10mb/s, 1000 frames/s)
• Typical scenarios:
DBMS
Monitoring and
management apps
CS loggers
NI loggers
Other proprietary or in-house
CS loggersLoggernet
RBNB DataTurbine (Ring Buffered Network Bus)
UCSD-DASHDemo
Work with us• Building a larger network of hydrologic data
servers– Install a HIS server at your site– Contribute data and services– Join development team– Create hydrologic mashups– Provide feedback
• Web sites:– www.cuahsi.org/his/ project info, downloadable
software, manuals, workbook– river.sdsc.edu/wiki/ developer notes, issues/bugs
tracking, CVS instructions, etc.