Embed Size (px)
DESCRIPTION
California’s Surface Water Ambient Monitoring Program Data Management Systems. Cassandra Lamerdin SWAMP Data Management Team Marine Pollution Studies Laboratory Moss Landing Marine Laboratories Moss Landing, California. Presentation Outline. SWAMP Database Goals Start Up Principles - PowerPoint PPT Presentation
Citation preview
California’s Surface Water Ambient Monitoring Program
Data Management Systems
Cassandra Lamerdin SWAMP Data Management Team
Marine Pollution Studies Laboratory
Moss Landing Marine Laboratories
Moss Landing, California
Presentation Outline
SWAMP Database Goals
Start Up Principles
Data Elements
Database Systems
Questions
SWAMPData Management Vision and Goals
Provide data of known & documented quality
Create & document systems which ensure data comparability
Make information available to all stakeholders in a timely manner
Facilitate the use of data for decision making processes
Guiding Principles
Capture analytical QC information in the SWAMP database
Do not store calculated values where possible
All samples will have unique geo-references and information about how samples were collected
Data enters database as “draft” and becomes public after SWAMP procedures are completed
Challenges We Faced
Varied study designs
Varied waterbody types
Multiple external sources of data
Analytical laboratories use performance-based methods
Multiple end-user groups and purposes
“SWAMP”
Time Series
Tissue
BiologicalAssessment
Discrete Field
Measures Chemistry Toxicity
SWAMP Data Elements
Responsibilities of SWAMP Database Management Team
Data Entry Training/Facilitation Field data Analytical data
Database Management/Quality AssuranceWork with each Regional Board individuallyComparability checkingVerification of Data Quality Indicators (QAMP) Compliance Coding Transfer data from Temporary to Permanent
Data Training/Accessibility Regional boards State board Outside SWAMP groups
Logistics Coordination
Contracts/Work OrdersRegional Water Boards
State Water Boards
Sampling CrewsDFG/Contractors
Regional Water Boards
Laboratories
Data ManagementReporting/QC
Analyte/Stations Maintenance
Data Facilitation
Data Flow Overview
Data Entry Forms
Lab Lab Lab
Batch Loaded
Batch Loaded
Lab
Field DataSubmission
Analytical DataSubmission
Toxicity DataSubmission
Samples Createdin Field
Database(Temp side)
Example SWAMP Data Sheet
SWAMP Data Entry Forms
Analytical Data Facilitation Use Standard Formats/Training Manual
Lab Liaison develops a rapport with labs Results in data being reported more efficiently Ongoing training
Many labs do not have LIMS systems Provide converters to assist with formatting SWAMP
data
Upload to Database using Data Loading Program
Data Checkers (Batch Level and Global level)
More Automation of SWAMP Systems
Online Templates and Documentation
http://mpsl.mlml.calstate.edu/swamp.htm
SWAMP Data Systems SOPs
Data Flow Overview
Data Entry Forms
Lab Lab Lab
Batch Loaded
Batch Loaded
Lab
Field DataSubmission
Analytical DataSubmission
Toxicity DataSubmission
DataVerification
by Field Crew
DataVerification
by Lab
Samples Createdin Field
PreliminaryVerification
by DMT
Database(Temp side)
Training/Facilitate Data EntryField DataAnalytical Data
Database Management/Quality AssuranceWork with each Regional Board individuallyComparability checkingVerification of Data Quality Indicators (QAMP) Compliance Coding Transfer data from Temporary to Permanent
Data Training/Accessibility
Regional boards State board Groups outside of SWAMP
Responsibilities of SWAMP Database Management Team
Regional Board Liaisons
Consult on integration of sampling designs into information management Modify field data sheets
Assist with data entry training
Completeness checking Follow-up/track down any missing data
Coordinate database distribution
Data access training
Status of data reporting
DMT Data/QA Process Overview
Exp
ort t o
CE
DE
N
TemporarySide
PermanentSide
Data availableto the public
(Web)
Transfer to
Exp
ort to
CE
DE
N
DMT Data/QA Process OverviewE
xpo
rt t o C
ED
EN
TemporarySide
PermanentSide
Data availableto the public
(Web)
Transfer to
Exp
ort to
CE
DE
N
Contractual Project CompletenessVerify MQOs
Compliance Codes
GlobalChecks
Verify Export
VerifyTransfer
SWAMP Data Verification Process Verification against project MQO’s per batch per Project
Analytical data Toxicity data Field data
Verification of QA codes applied on both a batch and result level Original codes applied appropriately Apply any additional codes if necessary
Compliance codes applied based on QA code combinations Compliant, Estimated, Historical, Rejected
Global verification performed on both permanent and temporary side Business rules Completeness Consistency
Verified batches transferred from temporary side to permanent side
SWAMP Data Comparability ExamplesAnalytes, Matrices and Units
SWAMP Business Rules Examples
Responsibilities of SWAMP Database Management Team
Data Entry Training/Facilitation Field data Analytical data
Database Management/Quality AssuranceWork with each Regional Board individuallyComparability checkingVerification of Data Quality Indicators (QAMP) Compliance Coding Transfer data from Temporary to Permanent
Data Training/Accessibility Regional boards State board Groups outside of SWAMP
Data Training / Communication
Creation and maintenance of documentation Field crews Laboratories Data users Agencies required to be SWAMP comparable
Initial and ongoing training 1st Priority: SWAMP Participants 2nd “Non-SWAMP” parties required to be comparable
SWAMP User Group Information exchange Maintain comparability in data reporting
Data access on temporary and permanent side User has ability to build new queries
Data Accessibility
Data Distribution on WWW
http://baydelta.ca.gov/
Successes SWAMP has created information management
standards and documented processes to meet our goals
All 9 Regional Boards are using SWAMP Database, although RB use varies: simple data access to data loading
Continue to collaborate with other agencies (SCCWRP, Bay Foundation, DWR) for system automation
Partnership with DWR allows more time and effort spent on science and less time on technology development
Questions?
