WSC Hydrometric Workstation Business Processes Guidance

WSC Hydrometric Workstation

Business Processes Guidance

www.aquaticinformatics.com | 2

Introduction

The role of CIOBData publication in a continuous approval processReview of the detailed data production work flowDescription of WSC business rules, standards and best practices AQUARIUS data structures and hard-coded constraints

Automated approvals and approval overridesFlags and gradesNotes and data documentation

www.aquaticinformatics.com | 3

System Architecture

System Failsafe

Data Acquisition System

Standards• National QMS requirements – a commitment to clients

Business rules• National, Regional, Local: to optimize program

efficiency and effectiveness

Best Practices• The best possible data under the circumstances

Hard-coded constraints• By omission or commission

Overview

Business Process Diagram

Data Publication

ClearSCADADCS Toolkit

User application

Modem

User

Real Time Hydrometric Data Integration with the DMSAndré Bouchard, 2009-11-30

DMS

When DMS is ready

Up until DMS is ready

Either through XML or middleware

GOES RelayAquarius Application Server

Aquarius RDBMSAquarius DB, Hydex 3, Hydat

Water Web Site Datamart

RT-DMS MSC National Archive Metadata Repository

FTP Servers

Approval levels

‘Unprocessed’ data is what you see in the gauge house – by the time data gets into AQUARIUS it should already be ‘Preliminary’‘Preliminary’ data needs to be examined :

• a) To ensure that auto-processes are working correctly

• b) To correct deficiencies that auto-processes cannot handle

The manual corrections applied to the data need to undergo scrutiny to ensure that they are complete, appropriate, and correctly appliedCompliance with QMS objectives must be affirmed by a qualified individual before the data is ready for archive

Unprocessed to preliminary

Preliminary to Approved

Processes by activity

Primary Signal (e.g. HG Telemetry @ StationID)

Working Signal (e.g. HG Working @ StationID)• Contains both telemetry and logger if available,

telemetry is, by design, the default RAW signal

Derived Signal (e.g. QR Working @ StationID)• Combines a time-series with a HydroML

Discrete Signal (e.g. HG Field Visit @ StationID)HydroML (e.g. HG QR rating curve @ Station ID)

AQUARIUS data concepts

Every time-series is an AQUARIUS Optimized Package (AOP) which has these attributes:• Raw• Corrected• Interpolation type• Grades• Flags• Approvals• Notes

AQUARIUS data attributes

The raw signal is sacred - it cannot be edited or deletedThe raw signal is the original input - regardless of where the input came from The RAW input to a ‘working’ signal is the CORRECTED primary signal

Raw

The CORRECTED signal in an AOP is the RAW signal with all corrections applied to itThe corrections are all date-stamped hence corrections can be turned on or off in any orderCorrections are applied in sequence according to the date-stamp

Corrected

Type 1 – Instantaneous value (e.g. HG)Type 2,3,4,5 – Value in preceding interval (e.g. mean, max, min or total for an aggregation interval)Type 6 - Instantaneous total(e.g. TBRG)Type 7 – discrete value – no interpolationType 8 – Value in succeeding interval (e.g. Gate opening)Type 9 – Direction in preceding interval (e.g. Wind direction)Type 10 – Total in succeeding interval (e.g. Flow volume)

Interpolation Type

Are agency specific and controlled with the admin tool as a definition tableIn WSC – BEAD - in that order.A is only relevant to daily aggregated values which, in HWS, is a reporting function.

Grades

Threshold or Rate of Change detection based on: >, >=, <, <=, >< and <>.By design, flags on auto-processes apply to the CORRECTED signal

Flags

Are agency specific and controlled with the admin tool as a definition tableIn HWS the approval states are:• Unprocessed – data upstream of AQUARIUS• Preliminary – have been auto-processed on append into an

AOP• Reviewed – have been scrutinized for validity and invalid data

has been manually corrected or deleted• Checked – the data have been peer reviewed• Approved – the data have been assured according to national

standards by a qualified expert

Approvals

Notes are attached to an episode of dataComments are attached to any action taken on the dataThe default comment for any correction includes all details needed for reproducibilityFree-form editing • Advantage – you can be specific• Disadvantage – sorting or searching by free-form may be

unproductive• Comment list can reduced typing

Notes and Comments

AQUARIUS Propagation and Aggregation rules

Approvals Grades Flags Notes Interpolation types

Propagates to derived signal Y Y N N Y

Aggregates in calculations Y Y N N Y

Persists in signal if manual if manual if manual Y n/a

Allows gaps N N Y Y N

Allows overlaps N N Y Y N

Bench Mark Analysis – no ApprovalField Visit Measurements – Approval but no PropagationRating Curves – Approval and PropagationRating Periods of Applicability – Approval and PropagationShift Corrections – Approval and Propagation

Approvals: mules and donkeys

Log tab in SBLog node in FVTChange history in DCT• Corrections can be undone without affecting

history• Undone corrections can be deleted - then they are

gone from history

Log

Every action is attributed to the logged in userChange your passwordActions can be sorted by creator

User authentication

Pictures, scanned field notes etc.Original measurement files, logger files

Attaching supporting documentation

Recalculate in FVT• Default = do not calculate – current meter rating

tables are not stored in HWS!

Override of date in imported measurement – possible - but comment requiredOverride of values, comments – not possible

Other data modifications

The HWS is designed to support compliance with Standard Operating Procedures and Business RulesThe SOPs and business rules will be in a state of flux for the next little while.

Training Trial Implementation National Implementation

Thank you from the AI TeamWe hope that you enjoy AQUARIUS!

www.aquaticinformatics.com | 29