13
Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 [email protected]

Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 [email protected]

Embed Size (px)

Citation preview

Page 1: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beaches Data Flow

Getting Notification Data Into PRAWNSDennis MurphyDelaware DNREC(302) [email protected]

Page 2: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Types• Notifications & Advisories

– Feeds PRAWNS– Supports Node Submission &

XML

• Water Quality Monitoring– Feeds STORET– Supports XML file uploads but

not Node submissions– Requires Post Processing

Page 3: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Steps to Production

• Consolidate Beach Data

• Get Flow Working in Test– Get Test UserIDs– Prepare EPA Test Database– Produce XML Document– Submit XML to CDX– Check Log For Errors– Debug

• Move into Production– Repeat above steps

Page 4: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Consolidate Data

• Develop procedures for consolidating all data in one database

Page 5: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Get UserID’s

• ID’s Needed For– NAAS– CDX– STORET

• Each ID needs appropriate permissions

• Key Contacts– CDX Help Desk– Charles Kovatch

Page 6: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Prepare EPA Databases• Get Agency ID from EPA• Verify that all stations are

registered with STORET– Add with Web Registration

application if needed– Beaches must be in both Test &

Production STORET

Page 7: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Produce XML Document

• Get Schema From EN websitewww.exchangenetwork.net click on Network Registry button

• Map data to schema• Generate XML Instance

Document• Validate versus schema

Page 8: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Get Data To CDX- Flow Patterns -

• Passive (EPA come and get it)– Uses Solicit method– Needs CDX to set up program

to request data on periodic basis

• Active (EPA here it comes)– Uses Submit Method– Submitter controls timing of

submissions

Page 9: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Active Flow Patterns

- Flavors -

• Automatic

– Data submitted “as it is entered”

• User Controlled

– User selects what data and when to do submittal

Page 10: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Active Flow Patterns

- Automatic -• Data entered into Production DB

behind Agency firewall• Data Replicated to DMZ DB • Watcher Program (Node client)

on DMZ Node server polls DMZ DB for new data

• When found Watcher – Generates XML – Does submittal to CDX

Page 11: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Active Flow Patterns

- User Controlled -• Data entered into Production DB

behind Agency firewall• User selects what data & when

to submit• XML file generated & saved to

text field in DMZ DB• Watcher Program (Node client)

on Node server polls DMZ DB for new files

• When found Watcher submits to CDX

Page 12: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Beach Data Flow Useful Contacts

• Charles Kovatch - EPA– (202) 566-0399– [email protected]

• CDX Helpdesk & EN Website– (888) 890-1995– www.exchangenetwork.net

• Dennis Murphy - DE DNREC– (302) 739-3490– [email protected]

Page 13: Beaches Data Flow Getting Notification Data Into PRAWNS Dennis Murphy Delaware DNREC (302) 739-3490 Dennis.murphy@state.de.us

Evil!Evil!

Paper Forms & Flat Files

Are