1
The option exists to display the waveform in geotool for an hour by clicking on the cell for that hour. NetCDF binary data files containing: hourly raw PSD’s monthly-averaged PSD’s day/night monthly averaged PSD’’s monthly-averaged PDF percentiles ranging from 0 to 100 percent in 5 percent bins. standard 1/9 th octave frequencies are used where possible. A web-based graphical user interface has been developed that provides the user with the capability of determining processing-end station state of health information for seismic, hydroacoustic and infrasound stations. The main visual feature is a station x time matrix with coloured cells that provide information on the health of a selected parameter for that time interval, which is usually set to be one hour. Presently three parameters are being displayed, viz: station noise determined each hour for all Seismic, Hydroacoustic and Infrasound stations; the health of the QC mask used in DFX processing; and Event Quality information that plots information like event station magnitude residual as a function of time. Processed data in various formats is available to the user who can display waveforms for selected intervals. Abstract Waveform QC tool A java-based application accessible via the web that: presents to the user various processing-end QC-related info performs the nuts-and-bolts numerical work by several new gbase (ie geotool) functions Outputs 4 QC parameters: a. Station Noise estimation via Power Spectral Density (PSD) (Brown, Pageoph, 2012) b. QC mask (the DFX qc library) c. Event Quality (i.e. output of SQL event quality queries) d. Standard Sensor, ie sensor data reconvolved to a standard sensor response. A separate process assesses the health of the data in each cell and assigns a ranking from 1 to 10 e.g: I34MN -storms moving across the array. PSD above high noise curve: Station Noise PSD’s are determined each hour and contribute to cumulative Probability Density Function (PDF). Hourly plots, or summary plots over the previous 30 days can be used to highlight instrumentation problems Event Quality Seismic station event residuals are collected. Implements SQL event quality queries: mb residual Versus time; nsta > 4 magnitude > 4 Ms residual Versus time; nsta > 4 magnitude > 4 LR az residual Versus time; nsta > 4 magnitude > 4 P az residual Versus time; nsta > 8 magnitude > 4 station residuals are plotted as a function of time in each case a straight line of best fit: is calculated and is characterized by two numbers: slope = m y-intercept = c these linear regressions are performed for each station, typically over a 3 month time interval and an ascii output generated: Standard Sensor A seismic data stream convolved to a standard response can be output: Example: large event with all recording stations convolved to Conclusions A java web-based gui has been developed that provides access to: state of health information via station noise estimation. QC mask information Event Quality information, via SQL database queries The information should be useful to station maintenance personnel, operational quality control personnel, NDC’s All numerical work is performed using the geotool-gbase library. (m,c) should be zero for healthy data c mx y + = various QC tabs SHI Stations (CSS affiliation table) Time cells (1 hr / 1 month) DB PLOTS: LINEAR REGRESSION: A + BX ------------------------------------ Station: DBIC start time: 1317168000.000 end time: 1324944000.000 db: development account: leb key: Version 1 TYPE A B POINTS PLOT ----------------------------------------------------------------- 1 0.077 -0.000 117 Ms resid Versus time 2 0.276 -0.002 279 mb resid Versus time 3 -15.714 -0.089 117 LR azim resid Versus time 4 -15.270 -0.054 279 P azim resid Versus time 1 2 3 4 5 6 7 8 9 10 -100 -200 -300 queued for processing finished processing, queued for “goodness” testing CPUP_sp_response_20030528 The Waveform QCtool: A Web-Based GUI for Examining Processing- End Station State of Health David Brown, International Data Centre, Comprehensive Test Ban Treaty Organization T3-P133 QC Mask QC mask records areas of ‘affected data’: spikes, dropouts, repeating values, etc... is used by DFX to avoid affected areas of data is not being recorded externally to DFX 3 database tables are used to record qcmask information qcmaskdef qcmaskinfo qcmaskseg Table: qcmaskdef Primary key: qcdefid qcdefid NUMBER(10) perform_qc NUMBER(1) max_mask_fraction FLOAT(53) type_multi_component VARCHAR2(16) min_multi_component NUMBER(10) apply_extended NUMBER(1) demean NUMBER(1) fix NUMBER(1) prefilter NUMBER(1) fhigh FLOAR(53) gap_samples NUMBER(10) gap_taper_fraction FLOAT(53) interval_samples NUMBER(10) interval_overlap_fraction FLOAT(53) niter NUMBER(10) single_trace_spike_thresh FLOAT(53) spike_thresh FLOAT(53) spike_statistic VARCHAR2(16) spike_statistic_value FLOAT(53) spike_dataset V ARCHAR2(16) spike_window_samples NUMBER(10 ondate NUMBER(8) offdate NUMBER(8) auth VARCHAR2(32) lddate DATE Table: qcmaskinfo Primary Key: qcmaskid Foreign Key: qcdefid qcmaskid NUMBER(10) sta VARCHAR2(6) chan VARCHAR2(8) time FLOAT(53) endtime FLOAT(53) samprate FLOAT(53) nseg NUMBER(10) qcdefid NUMBER(10) auth VARCHAR2(32) lddate DATE Table: qcmaskseg Primary Key: qcmaskid Forein Key: qcmaskid qcmaskid NUMBER(10) startsample NUMBER(10) endsample NUMBER(10) masktype VARCHAR2(32) auth VARCHAR2(32) lddate DATE qcmaskdef qcmaskinfo qcmaskseg Each cell corresponds to 3 months mb resid V time for 2012 < 0.2 mag: green > 2.0 mag: red

The Waveform QCtool: A Web-Based GUI for Examining ... · A java web-based gui has been developed that provides ... 1 0.077 -0.000 117 Ms resid Versus time 2 0.276 -0.002 279 mb resid

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Waveform QCtool: A Web-Based GUI for Examining ... · A java web-based gui has been developed that provides ... 1 0.077 -0.000 117 Ms resid Versus time 2 0.276 -0.002 279 mb resid

� The option exists to display the waveform in geotool for an hour by clicking on the cell for that hour.

� NetCDF binary data files containing:� hourly raw PSD’s � monthly-averaged PSD’s� day/night monthly averaged PSD’’s

� monthly-averaged PDF percentiles ranging from 0 to 100 percent in 5 percent bins.� standard 1/9th octave frequencies are used where possible.

A web-based graphical user interface has been developed that provides the user with the capability of

determining processing-end station state of health information for seismic, hydroacoustic and infrasound

stations. The main visual feature is a stationx time matrix with coloured cells that provide information onthe

health of a selected parameter for that time interval, whichis usually set to be one hour. Presently three

parameters are being displayed, viz: station noise determined each hour for all Seismic, Hydroacoustic and

Infrasound stations; the health of the QC mask used in DFX processing; and Event Quality information that

plots information like event station magnitude residual asa function of time. Processed data in various formats

is available to the user who can display waveforms for selected intervals.

Abstract

Waveform QC tool

� A java-based application accessible via the web that:� presents to the user various processing-end QC-related info� performs the nuts-and-bolts numerical work by several new gbase (ie geotool) functions� Outputs 4 QC parameters:

a. Station Noise estimation via Power Spectral Density (PSD) (Brown, Pageoph, 2012)b. QC mask (the DFX qc library)c. Event Quality (i.e. output of SQL event quality queries)d. Standard Sensor, ie sensor data reconvolved to a standard sensor response.

� A separate process assesses the health of the data in each cell and assigns a ranking from 1 to 10

� e.g: I34MN -storms moving across the array. PSD abovehigh noisecurve:

Station Noise

� PSD’s are determined each hour and contribute to cumulative Probability Density Function (PDF).� Hourly plots, or summary plots over the previous 30 days can be used to highlight instrumentation problems

Event Quality

�Seismic station event residuals are collected.

� Implements SQL event quality queries:

� mb residual Versus time; nsta > 4 magnitude > 4

� Ms residual Versus time; nsta > 4 magnitude > 4

� LR az residual Versus time; nsta > 4 magnitude > 4

� P az residual Versus time; nsta > 8 magnitude > 4

� station residuals are plotted as a function of time

� in each case a straight line of best fit: is calculated and is characterized by two numbers:

�slope = m

�y-intercept = c

� these linear regressions are performed for each station, typically over a 3 month time interval and an ascii output generated:

Standard Sensor� A seismic data stream convolved to a standard response can be output:

� Example: large event with all recording stations convolved to

Conclusions

�A java web-based gui has been developed that provides access to:

� state of health information via station noise estimation.� QC mask information� Event Quality information, via SQL database queries

� The information should be useful to station maintenance personnel, operational quality control personnel, NDC’s

�All numerical work is performed using the geotool-gbase library.

(m,c) should be zero for healthy data

cmxy +=

various QC tabs

SHI Stations (CSS affiliation table)

Time cells(1 hr / 1 month)

DB PLOTS: LINEAR REGRESSION: A + BX------------------------------------Station: DBICstart time: 1317168000.000end time: 1324944000.000db: developmentaccount: lebkey: Version 1

TYPE A B POINTS PLOT-----------------------------------------------------------------

1 0.077 -0.000 117 Ms resid Versus time2 0.276 -0.002 279 mb resid Versus time3 -15.714 -0.089 117 LR azim resid Versus time4 -15.270 -0.054 279 P azim resid Versus time

1 2 3 4 5 6 7 8 9 10-100 -200 -300queued for processing finished processing,

queued for “goodness”testing

CPUP_sp_response_20030528

The Waveform QCtool: A Web-Based GUI for Examining Processing-

End Station State of HealthDavid Brown, International Data Centre, Comprehensive Test Ban Treaty Organization T3-P133

QC Mask

� QC mask records areas of ‘affected data’:

� spikes, dropouts, repeating values, etc...

� is used by DFX to avoid affected areas of data

� is not being recorded externally to DFX

� 3 database tables are used to record qcmask information

� qcmaskdef

� qcmaskinfo

� qcmasksegTable: qcmaskdefPrimary key: qcdefidqcdefid NUMBER(10)perform_qc NUMBER(1)max_mask_fraction FLOAT(53)

type_multi_component VARCHAR2(16)min_multi_component NUMBER(10)apply_extended NUMBER(1)demean NUMBER(1)fix NUMBER(1)prefilter NUMBER(1)fhigh FLOAR(53)gap_samples NUMBER(10)gap_taper_fraction FLOAT(53)interval_samples NUMBER(10)interval_overlap_fraction FLOAT(53)niter NUMBER(10)single_trace_spike_thresh FLOAT(53)spike_thresh FLOAT(53)spike_statistic VARCHAR2(16)spike_statistic_value FLOAT(53)spike_dataset V ARCHAR2(16)spike_window_samples NUMBER(10ondate NUMBER(8)offdate NUMBER(8)auth VARCHAR2(32)lddate DATE

Table: qcmaskinfoPrimary Key: qcmaskidForeign Key: qcdefid

qcmaskid NUMBER(10)sta VARCHAR2(6)chan VARCHAR2(8)time FLOAT(53)endtime FLOAT(53)samprate FLOAT(53)nseg NUMBER(10)qcdefid NUMBER(10)auth VARCHAR2(32)lddate DATE

Table: qcmasksegPrimary Key: qcmaskidForein Key: qcmaskidqcmaskid NUMBER(10)startsample NUMBER(10)endsample NUMBER(10)

masktype VARCHAR2(32)auth VARCHAR2(32)lddate DATE

qcmaskdef qcmaskinfo qcmaskseg � Each cell corresponds to 3 months

� mb resid V time for 2012

� < 0.2 mag: green

� > 2.0 mag: red