View
214
Download
0
Category
Tags:
Preview:
Citation preview
MASSACHUSETTS INSTITUTE OF TECHNOLOGY • NASA GODDARD SPACE FLIGHT CENTER • ORBITAL SCIENCES CORPORATION • NASA AMES RESEARCH CENTER •
SPACE TELESCOPE SCIENCE INSTITUTE • SMITHSONIAN ASTROPHYSICAL OBSERVATORY
MAST
Daryl SwadeSTScl
G O D D A R D S P A C E F L I G H T C E N T E R22
Agenda
• Changes Since CSR• Requirements Flow down• MAST Overview• MAST Requirements• Interfaces• Schedule• Risks / Open Issues
G O D D A R D S P A C E F L I G H T C E N T E R33
Changes since CSR
• Full Frame Image (FFI) cadence change from 2 hours to 30 minutes will impact archive data volume.
G O D D A R D S P A C E F L I G H T C E N T E R44
Requirements Flow Down
• Show the requirements flow down and where the MAST fits into the flow.
G O D D A R D S P A C E F L I G H T C E N T E R55
MAST Overview
• 278 TB – Holdings size as of November 1, 2013.• 3 TB – Average Ingest Rate per month.• 19 TB – average data distribution rate per month.• 1,5000,000 – Average number of searches per month.
G O D D A R D S P A C E F L I G H T C E N T E R66
TESS Data Archive Context
G O D D A R D S P A C E F L I G H T C E N T E R77
TESS Archive Data Flow
Archive system monitoring and control
query results
queries
Ingest Archive Catalog
Distribution
Archive User Interface
data files
data files
catalog updates
queriesquery results
data request
quer
ies
quer
y re
sults
Archive user
catalog updates
Archive Catalog (replicated)
data
base
repl
icati
on
data files
Storage Broker
Data Receiptmanifest
Primary data store
Safe store
On-line cache
data files
data files
data request
science metadata
file informationdata files
G O D D A R D S P A C E F L I G H T C E N T E R88
Archive Functional Overview
• Data Receipt– Accept data and generate archive manifest
• Ingest– Store and catalog all data
• Archive Catalog– Provide an on-line science catalog of TESS metadata for searches, data
mining, and data retrieval• Implemented on relational DBMS
– Stage TESS Target Catalog for archival use
• Storage Broker– Maintain all data files on primary archive– Optionally, maintain data files on safe store and on-line cache
G O D D A R D S P A C E F L I G H T C E N T E R99
Archive Functional Overview (cont.)
• Archive User Interface– Make TESS data available to the astronomical community though the MAST
interface at STScI• Web-based query/preview/retrieval interface
– Create and maintain software tools required to search the TESS archive catalog
• This includes user access to target lists.– Create and maintain software tools required to access data
• Data Distribution– Retrieve requested data from storage broker– Ensure proper proprietary access to TESS data in the archive based on the
Science Office defined TESS Data Policy
• Archive Operator Interface– Operator interface for monitoring and control of the system
G O D D A R D S P A C E F L I G H T C E N T E R1010
TESS Science Data Archive Functions from CSR
• Storage of raw, reduced, and calibrated pixel and light curve data, including centroids, for all stars and planet candidates, to be transferred to MAST for public access on a trimester basis. With the ~22 day timeline for data passage through the pipeline, this implies that data will be 2-4 months old at time of public release.
• Storage of image data: raw, reduced, calibrated.• Storage of full-frame images acquired by TESS for validation of instrument
performance.• Storage of some TESS engineering data, as needed, to update science header
keywords.• Lists of Threshold Crossing Events from TPS in XML format will be exported to
MAST (and to the Exoplanet Archive).• Data Validation reports for each target with TCEs processed by DV will be exported
to the MAST as PDFs and with numerical results in XML files. • High Level Science Products provided to STScI from the TESS Science Operations
Center. These include light curves and any compiled catalog data including a TESS Object of Interest catalog (TOI).
• A simple interface based on the Mission supplied FITS files for data search and retrieval.
G O D D A R D S P A C E F L I G H T C E N T E R1111
MAST Requirements
• Discuss the Level 3 requirements
G O D D A R D S P A C E F L I G H T C E N T E R1212
Driving Requirements
• Discuss the driving requirements for MAST development
Data Receipt
The TESS Data Archive shall receive to be specified data from the SPOC.
The TESS Data Archive shall receive to be specified data from the TESS Science Office.
Data Receipt shall generate a manifest for all data received.
Ingest
Ingest shall store all TESS data in the TESS Data Archive.
Ingest shall catalog all TESS data in the TESS Data Archive.
Storage Broker
The Storage Broker shall store all TESS data in the primary archive.
The Storage Broker shall store to be selected TESS data on safe store media.
The Storage Broker shall store to be selected TESS data in the on-line cache.
G O D D A R D S P A C E F L I G H T C E N T E R1313
Driving Requirements (cont.)
• Discuss the driving requirements for MAST development
Archive Catalog
The TESS Data Archive shall provide an on-line science catalog of metadata for searches, data mining, and data retrieval.
The TESS science catalog shall contain metadata extracted from the science dataset keyword values.
The TESS archive database shall track each data set with a field indicating the proprietary status of the corresponding data files.
Data Distribution
TESS data shall be made available to the astronomical community through the MAST interface at STScI under the proprietary rights restrictions defined by the TESS Data Policy.
The TESS Data Archive shall be able to distribute data to archive users via electronic mechanisms or removable media with a user specified preference, but at the discretion of the Archive Operator.
G O D D A R D S P A C E F L I G H T C E N T E R1414
Driving Requirements (cont.)
• Discuss the driving requirements for MAST development
Archive User Interfaces
MAST shall create and maintain software tools required to access data in the TESS Data Archive for at least 10 years after the end of the mission.
Data Security
MAST shall protect all TESS data against unauthorized access per requirements established by NPR 2810.1, Security of Information Technology.
G O D D A R D S P A C E F L I G H T C E N T E R1515
MAST Interfaces
• Discuss the interfaces between the POC, SPOC and MAST.– Talk about the interface including the network and protocols– Talk about the data flow and the latency.
G O D D A R D S P A C E F L I G H T C E N T E R1616
TSO data to MAST
Data product Delivery frequency
Data volume Delivery mechanism
TESS Input Catalog
Targets of Interest List
Archive follow up data
G O D D A R D S P A C E F L I G H T C E N T E R1717
SPOC Data to MAST
Data Product Generation Frequency
Delivery frequency
Data volume Delivery mechanism
Telemetry data
Science pixels - uncalibrated
Collateral pixels - uncalibrated
Science pixels - calibrated
Collateral pixels - calibrated
Calibration reference files
Focal plane geometry model
Calibrated light curves
Centroid time-series
Full frame images - uncalibrated
Full frame images - calibrated
Pixel mapping reference files
Optimal aperture definitions
Pointing profiles
Data validation products
G O D D A R D S P A C E F L I G H T C E N T E R1818
Archive User Interface
G O D D A R D S P A C E F L I G H T C E N T E R1919
Schedule
• Show the MAST Schedule– Include status and path to PDR
G O D D A R D S P A C E F L I G H T C E N T E R2020
Risks / Open Issues
• Failing to involve MAST staff closely and early in Ground Segment activities risks delayed optimization of TESS science archive usage and increased software development costs in phases D and E.
Recommended