SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky

SAN DIEGO SUPERCOMPUTER CENTER

Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the

Hydrologic Sciences

David ValentineIlya Zaslavsky

David R. Maidment


Overview

• Introduction• Technology• Present• Screenshots• Near Term• Future


Hydrologic Science

Hydrologic conditions(Fluxes, flows, concentrations)

Hydrologic Process Science(Equations, simulation models, prediction)

Hydrologic Information Science(Observations, data models, visualization

Hydrologic environment(Dynamic earth)

Physical laws and principles(Mass, momentum, energy, chemistry)

It is as important to represent hydrologic environments precisely with

data as it is to represent hydrologic processes with equations


Consortium of Universities for the Advancement of Hydrologic Science, Inc

(CUAHSI)

• Supported by the National Science Foundation

• Develops cyberinfrastructure and services for hydrologic science in US universities

• Legally independent organization based in Washington DC

• SDSC is the cyberinfrastructure partner

CUAHSI HydroView Components

HydrologicSynthesis

HydrologicObservatories

HydrologicInformation

Systems

MeasurementTechnology


Operating Systems and Software Use


Water OneFlow Web Services

• Like Geospatial OneStop, we need a “Water OneStop” – a common window for water data and models

• Advancement of water science is critically dependent on integration of water information


Technology

• Commercial of the shelf (COTS) software• Leverage ongoing cyberinfrastructure projects

• Geosciences Network (GEON)• Share data between Earth Science disciplines• Grid computing capabilities

• Web Services


Operating Systems

• ESRI ArcGIS • Microsoft SQL Server

• Custom Models• ArcHydro • Hydrologic Observations

Database

• ASP.NET• Web services• Web interfaces

• Provides • a platform that scientists are

familiar with, and have developed, and a presently using to develop, software.

• GEON Stack• Java Portlets (Gridsphere)• Grid Authentication (GAMA)• Distributed Storage (SRB)• Grid Processing Capabilities• Workflow Capabilities

• Provides • data registration• searching• an archive• Shared architecture for

Geosciences

Multi-platform Design Central CUAHSI HIS Node (Windows) GEON Data Node (Linux)

Data

Apache TomcatIIS Web Server

ASP . Net

Geon Software Stack

SQL Server

Proxy

ArcGIS

Technologies

HDASHODM

Web

ServiceWeb

Services

Web Serviceproxies

Data

Remote CUAHSI HIS Node (Windows)

Data

IIS Web ServerASP . Net

SQL ServerArcGIS

Technologies

HDASHODM

Web

ServiceWeb

Services

Web Serviceproxies


Data


SQL ServerArcGIS

Technologies

HDASHODM

Web

ServiceWeb

Services

Web Serviceproxies


Data


SQL ServerArcGIS

Technologies

HDASHODM

Web

ServiceWeb

Services

Web Serviceproxies


Data


SQL ServerArcGIS

Technologies

HDASHODM

Web

ServiceWeb

Services

Web Serviceproxies

Remote CUAHSI

HIS Nodes (Windows)


Present (1/2)

• Water OneFlow Web Services• NWIS, AmeriFlux, DAYMET, MODIS

• Databases• Hydrologic Observations Data Model

• HDAS - Hydrologic Data Access System• A map-based access system to hydrologic data

• We provide production access to data sources via webservices, and access via a map-based interface


Present (2/2)

• Problems• Occasionally, Geon Services do not work in proxy• CUAHSI ArcGIS server interfaces (eg HDAS) have

problems being wrapped in a portlet, and were not designed to be wrapped.

• Producing a node distribution with COTS








Demo-Data Registration


Near Future

• Water OneFlow web services • Standardize methods• Refactor present services• Provide codebase for community development• Dataset specific methods

• ESRI ArcHydro server extension• Point of presence distribution• Documentation


Future

• Make it easier• URL-Based access methods

• Data

• Non-Map access methods• Ontology search• Site browse• Attribute browse (by HUC, State, County)• Others (tell us)

• Tools

• Documentation

http://ws.cuahsi.org/station/ameriflux/stationID/Variable/xmlhttp://ws.cuahsi.org/station/ameriflux/stationID/Variable/excel


Summary

• CUAHSI HIS is a community driven effort.• COTS or open source• CUAHSI cyberinfrastructure will be a multi-

platform infrastructure that leverages the GEON Infrastructure, and commercial software.

• Web services will allow for flexible development• Community-developed implementations can replace

commercial implementations. • MapWindows group is developing an OpenHydro data model to

provide an open source implementation of the ArcHydro datamodel.

best tool for the job.


Questions

• Sites• http://www.cuahsi.org/his/

• Listing of web services

• http://river.sdsc.edu/HDAS/• Map interface to National Water Information System

• HIS Contacts• [email protected]• [email protected]




WaterOneFlow Web Services

Data access through web

services

Data storage through web

services

Dow

nlo

ads

Upl

oa

ds

Observatory servers

SDSC HIS servers

3rd party servers

e.g. USGS, NCDC

GIS

Matlab

IDL

Splus, R

D2K, I2K

Programming (Fortran, C, VB)

Web services interface

Web portal Interface (HDAS)

Information input, display, query and output services

Preliminary data exploration and discovery. See what is available and perform exploratory analyses

HTML -XML WS

DL

- SO

AP

Hydrologic Information System Service Oriented Architecture


WaterOneFlow Web Services

Data access through web

services

Data storage through web

services

Dow

nlo

ads

Upl

oa

ds

Observatory servers

SDSC HIS servers

3rd party servers

e.g. USGS, NCDC

GIS

Matlab

IDL

Splus, R

D2K, I2K

Programming (Fortran, C, VB)

Web services interface

Web portal Interface (HDAS)

Information input, display, query and output services

Preliminary data exploration and discovery. See what is available and perform exploratory analyses

HTML -XML WS

DL

- SO

AP

Hydrologic Information System Service Oriented Architecture

Documents

SAN DIEGO SUPERCOMPUTER CENTER Developing a CUAHSI HIS Data Node, as part of Cyberinfrastructure for the Hydrologic Sciences David Valentine Ilya Zaslavsky