AWIPS Continuous Technology Refresh (CTR) AWIPS Software CTR

This document includes data that shall not be duplicated, used, or disclosed – in whole or in part – outside the Government for any purpose other than to the extent provided in contract DG133W-05-CQ-1067. However, the Government shall have the right to duplicate, use, or disclose the data to the extent provided in the contract. This restriction does not limit the Government’s right to use information contained in this data if it is obtained from another source without restriction. The data subject to this restriction are contained in all sheets.

AWIPS Continuous Technology Refresh (CTR)

AWIPS Software CTRAWIPS TO11-Slice 6 ReadMeOct 21, 2009

04/19/23 Page 2

AWIPS TO11-D6 ReadMe Install and minimum hardware requirements (Supported System Configs) “How To” configure information - Draft Site Localization instructions Additional Information – GFE Autotest, Shapefile Compatibility Architecture and Software Design Update Programmer’s Update Build Status DR status

04/19/23 Page 3

AWIPS Installers: Standalone Workstation Simplest, Complete AWIPS environment (limited dataflow)

/RadarServer

/awips/edex

/awips/edex-grib

/awips/fxa/bin

/home/awips/workspace

/home/awips/gfe-client

/home/awips/cave

/home/awips/caveData

Developers Standalone Workstation

• 2G minimum memory (4G recom.)

• Graphics OpenGL 2.0 or better with 256Mb RAM

• 80G Disk Space

ade-installer.jar

cave-installer.jar

PostgreSQl

gfe-clientCAVE

Eclipse IDE

Install Flow Tags

AWIPS_Standalone_Deployment_FlowTag_RevTO11d6.doc

Install

Edex Logs

/awips/edex/logs

Note: Assumes Standard AWIPS Workstation running RHEL 5u2 with RPMs and configuration as per OB9.1

EDEX_esb

ade-lib-installer.jar

radarserver-installer.jar

edex-installer.jar

cli-installer.jar

gfe-client-installer.jar

Updated

T011-D6

EDEX_grib

04/19/23 Page 4

AWIPS Installers: Servers Minimum to support continuous WFO data flow

Server (AWIPS PX equivalent)

• 4G minimum memory (4G recom.)

• 200G Disk Space

PostgreSQl EDEX_esb

Install Flow Tags

AWIPS_Standalone_Deployment_FlowTag_RevTO11d6.doc

AWIPS_Cluster_Deployment_FlowTag_RevTO11d6.doc

TO11d6_Install.pdf

Disk Partitions

Install

Note: Assumes Standard AWIPS Server running RHEL 5u2 with RPMs and configuration as per OB9.1

cli-installer.jar

edex-installer.jar

radarserver-installer.jar

EDEX_grib

/RadarServer

/awips/edex

/awips/edex-grib

/awips/fxa/bin

Edex Logs

/awips/edex/logs

Updated

T011-D6

04/19/23 Page 5

T011-D6 How To Configure UpdatedDraft Site Localization Documentation

Instructions on how to localize AWIPS II Document included on Resources Disk:

– “AWIPS II Localization, 21 October 2009”, AWIPS2-localization-v7.doc Incorporated comments Added FFMP section Added SCAN section Added AvnFPS Added Text Workstation localization Added Radar section, including new capability to auto generate radar menus from a

simple text file containing lists of locations

How To Configure

04/19/23 Page 6

T011-D6 Additional Information Documents included on Resources Disk:

– “Overview of GFE Autotest in AWIPS II”, Overview of GFE Autotest in AWIPS II v2.doc

– “Running GFE Autotest in AWIPS II”, Running GFE Autotest in AWIPS II v2.doc

– “Shapefile Compatibility Issues AWIPS I - AWIPS II”, Shapefile_Compatibility_Issues v2.doc

More GFE sites can be localized (fixing TTR812) – Shape Files maps edited to remove points that cause errors during automatic

edit area creation Achieves compliance with ESRI standard Updated shape files provided with D6 delivery (4 sites corrected after delivery prep)

Additional

Information

04/19/23 Page 7

AWIPS-II: Reference ArchitectureBased on Plug In extensible services

<<Service Framework >>

EDEX

Data Types

Libraries

Scripts

VIZ Plugins

<<Visualization Framework >>

CAVE

Meta

DataData

+Ingest Service +Persist Service

+Metadata Service +Subscription Service

+Request/Transform Service +Adapter Service

+Collaboration Service +Disseminate

Core Generic Services

Core Libraries

+Eclipse RCP PlugIns +Data Animation

+GIS Raster Rendering +Data Editing

+GIS Vector Rendering +Data Analysis

+GIS Point Rendering +Drawing

Enterprise Service Bus (ESB)

Plug In

PatternVIZ Scipts

AWIPS-II Reference Architecture

Custom Displays

Libraries

Scripts

Architecture / SWDesign Update

Headless

CAVE

04/19/23 Page 8

AWIPS Services and Plug InsESB SOA Plug In Adaptable TO11-D6 Set

Index

purge

AutoBldUtility

Proxy

Camel-Spring

AWIPS Services

Persist VTEC

GfeSrvNotify

Product

SOA Data Type Plug Ins

Eclipse RCP Visualization Plug Ins

CAVE

Enterprise Service Bus

HdfHttp

py

SmartInit

GFE

Dissemination

TextDB

Subsribe

ScriptRun

FutureArchitecture / SW

Design Update

New for

T011-D6

45 Plug Ins Total

Extended to support multi-sites for Service

Backup

Headless

CAVE

EDEX

Autotest

ifpImage

runProcedure

Thick /Light Client Mode/Light

Removed, Replaced

With Active Table in

PostgreSQL

Greatly Reduced Latency for menu

updates

04/19/23 Page 9

Architecture Improvements Separate EDEX into two processes

– EDEX

– EDEX_grib Added localizable subgridding to GRIB plugin

– Improves performance on limited hardware Fixed JMS reconnect for clustered configuration Point Data Pattern (HDF5) applied to appropriate plugins Memory leak fixes (HDF5) Implemented “lzf” compression for HDF5 improving CPU performance Bufrua uses new file format Reduced latency of menu updates GFE procedures run in own thread and can use Tcl/TK inter GFE text formatter performance improvements


04/19/23 Page 10

Decision Aid Patterni.e. FFMP SCAN, SAFESEAS, SNOW, FOG


<uf..java>

ProductAlertObserver

FogMonitor

<JMS>

topic:edex.alerts

ScanMonitor SafeSeasMonitor SnowMonitor

Simplifies Data Alerting and

Monitoring Design by

Leveraging URI topic

FFMPGenerator

Radar DHR

scans

EDEX

dataURIs

<abstract>

Monitor

04/19/23 Page 11

AWIPS-II GFE Service BackupPreserve the netCDF3 interface for Published data

NDFD

NCF

AWIPS-II Site

R /Synch, Query

Uses AWIPS-1 netcdf3 format to

transfer data

NCF works

Unchanged with

AWIPS-II


Support for a key DTP objective: AWIPS I – AWIPS II Interoperability

Service backup (multi-site) in place DR2590 (with test steps) Next step - testing with R/Synch server

netcdf3

GFE

Big File

MHSConfiguration Data

Web Based

GUI

04/19/23 Page 12

T011-D6 Ingest Design ChangesLDM message interface, Radar Server, LDAD Design


LDMRaw

Archive Data Files

IPC

Shared

Memory

Queue

notifications

JMS Message

Sender

EDEX Plug In

EDEX

File EndpointsJMS

Queue Endpoints

./sbn/.

Radar ServerData Files

JMS Sender

LDADData Files

JMS Sender

File & Queue

Endpoints

Routed Together

Increased Flexibility

04/19/23 Page 13

AWIPS SkewT RefactorAWIPS-1 Graphics with parameters in separate window

com.raytheon.viz.skewt

GOESSoundingAdapter

GribAdapter

POESSoundingAdapter

UAObsAdapter

meteolib

Uses AWIPS-1 algorithms for

stability parameters


04/19/23 Page 14

Application Integrations

AvnFPS – Climate, and rest of monitoring MHS – Java send API included in ADE TMCP – integrated into workstation, CAVE calls on startup Alarm/Alert into TextWS Derived Satellite Level Framework (infrastructure for Snap Up)


04/19/23 Page 15

AWIPS SOA Datatype Plug InsPlug In Name Metoc Data Types Comment

plugin-acars.jar acars parsed aircraft Complete

plugin-acarssounding.jar acars sounding Complete

plugin-airep.jar airep parsed aircraft Complete

plugin-binlightning.jar bin lighting Complete

Plugin-bufrascat wind Europe Complete

Plugin-bufrhdw high density wind Complete

plugin-bufrmos.jar bufr MOS Complete

Plugin-ncwf national convective Complete

Plugin-bufrquikscat wind US Complete

Plugin-bufrssmi ssmi satellite Complete

plugin-bufrua.jar bufr RAOB Complete

plugin-ccfp.jar ccfp text Complete

Plugin-cwat county water threat Complete

Plugin-ffmp flash flood monitor Complete

plugin-gfe.jar gfe gribs Complete

plugin-goessounding.jar goes sounding Complete

Build Status

04/19/23 Page 16

AWIPS SOA Datatype Plug Ins (Continued)Plug In Name Metoc Data Types Comment

plugin-grib.jar grib models Complete

plugin-mesowest.jar meso net Complete

plugin-modelsounding.jar model soundings Complete

plugin-obs.jar metars parsed Complete

plugin-pirep.jar pirep parsed aircraft Complete

plugin-poessounding.jar poes sounding Complete

plugin-profiler.jar profiler Complete

plugin-qpf.jar quantitative precip forecast

Complete

plugin-radar.jar Radar Complete

plugin-recco.jar recco Complete

plugin-redbook.jar redbook graphics Complete

plugin-satellite.jar satellite Complete

plugin-sfobs.jar synoptic, maritime Complete

plugin-shef.jar shef hydro Complete

plugin-taf.jar taf parsed Complete

plugin-text.jar raw text Complete

plugin-warning.jar warnings Complete

Build Status

04/19/23 Page 17

AWIPS SOA Datatype Plug Ins (Continued)

Plug In Name Metoc Data Types Comment

Plugin-sigmet Convective Sigmets Complete

Plugin-sigwx Significant Weather Complete

Plugin-ldadQC Mesonet QC netcdf Interface to AWIPS-1 netcdf3 file on LDAD; with DR

Build Status

04/19/23 Page 18

T011-D6 AWIPS RadarL3 products decoded and renderable from CAVE

Radar Product Name (Mnemonic, Code) TO11 Slice Delivered

Comment

Reflectivity (Z, 19) D1 Complete

Velocity (V, 27) D1 Complete

Storm Rel Velocity (SRM, 56) D1 Complete

Composite Ref (CZ, 37, 38) D1 Complete

Lyr Comp Ref Max (LRM, 65) Level 1 D1 Complete



Lyr Comp Ref MAX (APR, 67) D1 Complete

Echo Tops (ET,41) D1 Complete

Vert Integ Liq (VIL, 57) D1 Complete

One Hour Precip (OHP, 78) D1 Complete

Storm Total Precip (STP, 80) D1 Complete

VAD Wind Profile (VWP, 48) D1 Complete

Digital Precip Array (DPA, 81) D1 Complete


Base Spectrum Width (SW, 28, 30) D1 Complete

Severe Weather Probability (SWP, 47) D2 Complete

Build Status

04/19/23 Page 19


Comment

Storm Tracking Information (STI, 58) D1 Complete

Hail Index (HI, 59) D1 Complete

Mesocyclone (M, 60) D1 Complete

Mesocyclone (MD, 41) D1 Complete

Tornadic Vortex Signature (TVS, 61) D1 Complete

Storm Structure (SS, 62) D2 Complete

Supplemental Precipitation Data (SPD, 82) D5 Complete

Reflectivity (Z, 94) D1 Complete


Super Res Reflectivity (Z, 53) D3 Complete

Super Res Velocity (V, 54) D3 Complete

Super Res Spec Width (SW, 55) D3 Complete

Spectrum Width (SW, 30) D5 Complete

Digital Vert Integ Liq (DVL, 34) D1 Complete

Digital Hybrid Scan Refl (DHR, 32) D5 Complete

Enhanced Echo Tops (EET, 35) D2 Complete

Digital Meso Detection (DMD, 49) D2 Complete

Build Status

T011-D6 AWIPS Radar – ContinuedL3 products decoded and renderable from CAVE

04/19/23 Page 20

T011-D6 AWIPS Radar – ContinuedL3 products decoded and renderable from CAVE


Comment

TVS Rapid Update (TRU, 43) D2 Complete

User Selectable Lyr Refl (ULR, 37) D1 Complete

Storm Total Precip (STP, 38) D2 Complete

1-Hour Snow Water Equiv (OSW, 44) D2 Complete

1-Hour Snow Depth (OSD, 45) D2 Complete

Storm Tot Snow Depth (SSD, 47) D1 Complete

Storm Tot Snow-Water Equiv (SSW, 46) D5 Complete

Text Products to TextDB D5 Complete

Status Message to AlertViz D5 Complete

Radar Mosaic D5 Complete

Radar Menu Hook Up D3…D5 Complete

Build Status

04/19/23 Page 21

AWIPS-1 RehostingAWIPS-1 Rehosted Application T011-D6 Status

Climate Complete

NWRWAVES Complete

HazCollect Complete

NWWS Interface Complete

Asynchronous Product Scheduler Subscription working; DR for CLI

Hourly Weather Roundup (HWR) Complete with DRs

WAN integration – MHS Java API Java API complete, DR incorporated in OB9.2, Integration and testing in progress

LDAD Design Complete, Plug-Ins created for Mesonet, Hydro, Profiler, “Manual”; Mesonet ready for test, others with DRs

SBN Retransmission LDM modifications complete; WAN integration testing to be completed after OB9.2

RiverPro Complete

RFC Applications Complete (DRs)

RFC Historical Data Browser Complete

Hydro – HPE, HPN Working with FFMP; DR for ingest

Local Storm Reporting LSR GUI and Ingest / Decoder complete; DR for rendering

4-D Storm Investigator (FSI) WFO archive complete, DR for notification interface

Legal Archiver, Data Archiver Complete

AWIPS System Monitor Complete – possible DR to merge JMX with AWIPS System Monitor

Build Status

04/19/23 Page 22

Deliverables Checklist Update Build Status

See Separate Spreadsheet “TO11 Deliverables Checklist v29.xls” included on RESOURCES disk

04/19/23 Page 23

Update to ADE / EDEX / CAVE Programmers

Update

ADE delivered in 2 parts (as of D4/5):– ADE– ADE-Lib– Installation instructions in Flow Tags

Additional JVM (as of D6) for GRIB Decoding– Extra process running– Extra log file generated– Transparent to Developer / SW Programmer

04/19/23 Page 24

DRsOpen and Closed Open DRs Against D6 Delivery

– See document: AWIPS Slice 6 Open Tickets.pdf *

DRs Closed during D6 – ready for NWS verification– See document: AWIPS Slice 6 Completed Tickets.pdf *

280 DRs Resolved and Included in D6– Combination of Task (new capability) and Defect DRs

– 75 TTRs Resolved

– 25 FBSO DRs Resolved

– 5 Special Handling DRs Resolved, including GFE Localization Issue

* Note: Document provided on Resources Disk. DR descriptions and test procedures are included in the daily DR report