We have developed a GUI-based user interface for Chandra data processing automation, data quality evaluation, and control of the system. This system, known as The Telemetry Tracker 9000 (TT9), allows dynamic interaction and monitoring of all operational tasks, including automated data quality evaluation, quicklook generation, submission to archival processing, realtime data flow, and reporting metrics in a single multi-tab GUI. A MySQL database serves as a backend for this system enabling identification of anomalies, unusual acquisition situations, as well as tracking statistics.

New Interactive User Interface for New Interactive User Interface for Spacecraft Data ProcessingSpacecraft Data Processing

C. S. Anderson, D. L. Morgan, P. J. Mendygral, J. S. Nichols

Harvard-Smithsonian Center for Astrophysics

0

100

200

300

400

500

600

700

Number of Raw Telemetry Files

0-6 6-12 12-18 18-24 24-30 30-36 36-42 42-48 >48

Latency (hours)

0

100

200

300

400

500

600

700

Number of Raw Telemetry Files

0-6 6-12 12-18 18-24 24-30 30-36 36-42 42-48 >48

Latency (hours)

0

100

200

300

400

500

600

700

Number of Raw Telemetry Files

0-6 6-12 12-18 18-24 24-30 30-36 36-42 42-48 >48

Latency (hours)

0

100

200

300

400

500

600

700

Number of Raw Telemetry Files

0-6 6-12 12-18 18-24 24-30 30-36 36-42 42-48 >48

Latency (hours)

Epoch 1

2001.1 -> 2002.3

Epoch 4

2004.6 -> 2005.7

Epoch 2

2002.3 -> 2003.5

Epoch 3

2003.5 -> 2004.6

Manual DQ of Raw Telemetry

Manual Submission of Raw Telemetry to Archival Processing

Data operations personnel: 7

Automated DQ of Raw Telemetry (TT9)

Manual Submission of Raw Telemetry to Archival Processing

Data operations personnel: 6

Automated DQ of Raw Telemetry

Automatic Submission of Raw Telemetry to Archival Processing

Data operations personnel: 4

Prior to archival processing raw telemetry must pass a series of data quality (DQ) checks including partial pipeline processing for quicklook data. Initially executed by operators (Epoch 1), TT9 has automated DQ checks and quicklook processing reducing staff requirements and increasing efficiency (Epochs 2&3). Raw telemetry meeting DQ requirements are flagged by TT9 for automatic submission to archival processing which has reduced latency to a few hours (Epoch 4).

TT9 stores information into a database which is viewable in an object oriented GUI written in Perl.The GUI is divided into selectable tabs with each tab customized to organize information on a specific data processing aspect.

The modular design allows new data processing tasks to be automated and interfaced with additional GUI Tabs.The development of new tabs is simplified by a generalized Perl super class.

Observation Tab• Table row for each observation. • Tabulated information includes:

•Estimated time of processing stages i.e. data received, processing completed•Number of events•Quicklook processing status•51 total viewable columns

Statistics Tab• Statistics on raw telemetry files and observations• Instant metrics for management reports• Tracking completion times of data processing stages identifies bottlenecks in the system.• 29 total viewable columns

Raw Telemetry Tab • Table row for each raw telemetry file• Tabulated information includes:

•Observations contained•Data quality measures•Archival processing status•55 total viewable columns

Features of TT9Database backend allows fast, flexible

storage, search, and display of data processing information.

Run time configuration controls including servers available for remote

processing.Text notifications for data processing

events to alert personnel.Single organized source of data processing related information.

Majority of TT9 written in Perl with some C Shell. Code consists of 35,162 lines in 21 scripts and 54 libraries (version 4.3).

Features of TT9 GUICompletely customizable tables allows

users to add, remove, or sort on any column.

Selectable time frame to display.User “profiles” allow storage of each

user’s default settings.Table rows can be color coded based on column values. Raw telemetry files that fail DQ checks are highlighted in red for

example.Row highlighting and right-click menus

for customized user controls.