COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, e-mail: [email protected] NDE Operational Status

COPC Meeting, May 27 – 28th 2015NDE Operational Status and PDA Update

Prepared by: Chris Sisko, e-mail: [email protected]

NDE Operational Status PDA Update

Presented by: Keith Amburgey

Prepared by: Chris Sisko

NESDIS/OSPOTelephone: 301-817-4783

eMail: [email protected]



Presentation Outline

NPP Data Exploitation (NDE) System Latest Status Operational Products

PDA Status PDA Overview PDA / DAPE Note on schedule Operational Prioritization Final notes

2



NDE (Current Ops System) Status

3



NDE Operational StatusNDE Operational System (PE1) is functioning as intended.

NDE Operational System (PE1) is the largest single distribution system within ESPC – SNPP daily data volumes are 100 times larger than all our other supported missions combined.

NDE I&T system (PE2) is highly utilized and fully supports numerous activities: ground system maintenance releases, algorithm changes, bug fixes, production rule updates, tailoring functions, improvements to data handling and database updates/optimization.

4

Sep 2013(initial operations)

Today

Number of users (subscriptions) 3 (12) 29 (310)

Average Data Ingest* ~70 TB ~130 TB

Production Success* > 99.9% > 99.9%

Distribution Success* > 99.5% > 99.9%

Average Data Distributed* ~10 TB ~40 TB

NDE Operational Products

5

Application Short Name

Application Name Product Name Format Satellite

ACSPO SSTAdvanced Clear Sky Processor for Oceans (NDE) - SST

SST, Clear Sky Mask netCDF SNPP

AOT Aerosol Optical Thickness VIIRS Aerosol Optical Thickness (NDE) BUFR SNPP

ATMS-SDR ATMS SDR radiances ATMS SDR radiances 22 channels (NDE) [BUFR] SNPP

CRIS-SDR-399 CrIS SDR radiances 399CrIS IR sounder SDR radiances 399 channels for NWP data assimilation (NDE)

[BUFR] SNPP


BUFR SNPP

NUCAPS Level 2NOAA Unique CrIS ATMS product System Level 2

CrIS/ATMS Atmos Temp Profile CrIS/ATMS Atmospheric Moisture Profile

[netCDF] SNPP

MIRS ATMSMicrowave Integrated Retrieval System (NDE) - ATMS

MIRS ATMS image products MIRS ATMS SND products

[netCDF] SNPP

OMPS-NP OMPS nadir profile Ozone nadir profile (NDE) BUFR SNPP

OMPS-TC OMPS total column Ozone total column (NDE) BUFR SNPP

VIIRS-EDR VIIRS EDR VIIRS EDR (NDE) netCDF SNPPVIIRS-SDR VIIRS SDR VIIRS SDR (NDE) netCDF SNPPVIIRS Binary Snow Cover

VIIRS Binary Snow Cover VIIRS Binary Snow Map netCDF SNPP

VPW VIIRS Polar Winds VIIRS Polar Winds[BUFR], netCDF

SNPP

Products for DoD currently sent from the NDE system to DAPE

Products in the queue for DoD; will eventually be sent from the NDE system to DAPE

Upcoming Operational Products (SPSRB schedule)• Vegetation Health (June 2015)• GCOM NDE 1.0 (TBD)

6

Application Short Name

Application Name Product Name Format Satellite

ACSPO SSTAdvanced Clear Sky Processor for Oceans (NDE) - SST

SST, Clear Sky Mask netCDF SNPP

AOT Aerosol Optical Thickness VIIRS Aerosol Optical Thickness (NDE) BUFR SNPP

ATMS-SDR ATMS SDR radiances ATMS SDR radiances 22 channels (NDE) BUFR SNPP


BUFR SNPP


BUFR SNPP

GVF GVF Green Vegetation Fraction – 7 day product Grib2 SNPP

NUCAPS Level 2NOAA Unique CrIS ATMS product System Level 2

CrIS/ATMS Atmospheric Temp Profile CrIS/ATMS Atmospheric Moisture Profile

netCDF SNPP

NTCP Tropical Cyclone Products ATMS Microwave Tropical Cyclone ProductATCFAscii

SNPP

MIRS ATMSMicrowave Integrated Retrieval System (NDE) - ATMS

MIRS ATMS image products MIRS ATMS SND products

netCDF SNPP

OMPS-NP OMPS nadir profile Ozone nadir profile (NDE) BUFR SNPP

OMPS-TC OMPS total column Ozone total column (NDE) BUFR SNPP

VIIRS-EDR VIIRS EDR VIIRS EDR (NDE) netCDF SNPPVIIRS-SDR VIIRS SDR VIIRS SDR (NDE) netCDF SNPPVIIRS Binary Snow Cover

VIIRS Binary Snow Cover VIIRS Binary Snow Map netCDF SNPP

VPW VIIRS Polar Winds VIIRS Polar WindsBUFR

netCDFSNPP

NDE Operational Products

Upcoming Operational Products (SPSRB schedule)• Vegetation Health (June 2015)• GCOM NDE 1.0 (TBD)

Products for DoD currently sent from the NDE system to DAPE

Products in the queue for DoD; will eventually be sent from the NDE system to DAPE



Final Operational Notes

Today, the NDE Operational System (PE1) provides operational products to the DAPE.

The 557th receives data directly from the IDPS (JPSS Ground System).

In the future:NDE 2.0 / PDA, will provide new mission data directly to USN and

USAF (557th Weather Wind).DAPE will continue to provide legacy mission data as those missions

fly out.

7



PDA Status

8



PDA Overview Product Distribution and Access (PDA) – NESDIS’s enterprise distribution for real-time

users. Supports only secure transfer protocols (SFTP, FTP-S and HTTPS – pull only) Provides NESDIS with a scalable SOA based architecture that functions as a high

availability and high performance Provides searchable catalog and flexible web interface for users to access the system. Enables users to directly manage their data subscriptions (within their allowed daily data

volume limits) while OSPO can focus more efforts on management of the system. Provides users with the ability to tailor products in order to meet their unique mission

requirements. PDA has three system strings: I&T, NSOF Ops and CBU Ops strings. PDA increment 2.5 provides full user functionality, including the user interface (recently

deployed/integrated). PDA is being deployed into a new ESPC network that will have an initial external

capacity of 28 Gbps; scalable to 40 Gbps. PDA at NSOF will support many missions, but PDA at CBU only supports JPSS.

9



PDA / DAPE Next PDA enhancement priority: core functions for processing and distributing

Himawari-8 data. Access to new datasets will be serviced from PDA while DAPE will maintain data

continuity of its existing product suite to DoD. Current NESDIS position regarding DAPE and PDA:

- continue supporting/sustaining DAPE in terms of legacy data flow- new data requests will be serviced by PDA

This current strategy will eliminate potential disruptions to existing services while the final path forward regarding DAPE functionality is determined; this approach also gives DoD an opportunity to build confidence with PDA distribution.

For current NDE operations (now) – ESPC feeds DAPE for DoD’s additional SNPP data needs.

For future NDE 2.0/PDA operations (upcoming) - ESPC feeds DoD directly any new mission data they require; legacy product distribution will remain on DAPE.

10



PDA ScheduleI&I activities and Qualification Site Test Dry Runs are underway.Remaining PDA schedule is aligning with JPSS Block 2.0

schedule activities.Validation period runs from July 20th, 2015 to October 20th, 2015.Operational Readiness Review (ORR) in the early Dec, 2015 time

frame.

11



User Operational Prioritization – PDA has the ability to shed lower priority users to ensure data continuity is maintained to mission critical users, unlike systems in use today. DoD users are priority 1.

12



SummaryNDE system has been operational for well over a year; ~85% of the new NDE

(product generation system) will be the same when NDE 2.0 and PDA become operational.

PDA utilizes common transfer protocols and the performance of the system is driven by GOES-R requirements to rapidly ingest, process and make available data to meet user’s real-time needs.

Continue to support DAPE for DoD’s existing legacy data flow purposes and to move new data requirements to the PDA enterprise system as the least disruptive approach until subject matter experts can analyze the best path forward.

Latest scheduled information for PDA ORR is mid-Dec 2015 time frame.

13



Questions or Comments?

14

Documents

COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, e-mail: [email protected] NDE Operational Status