Paris, 6-7 mars 2006

Extraction

SGIS loop

A21

Single-transit

analysis

SGIS loop

A22 Calibration

SGIS loop

A23

Extraction

A24 Single-transit

analysis

A25

C2

Auxiliary data:e.g. atomic data,

template, CC-mask

Spectra ofstars V < 12

Spectra ofstars V < 17.5

Extractedraw or calibrated (TBD)cleaned spectra V<12

Vr &v sin i

Extracted calibratedcleaned spectra V < see table 2

Extracted calibratedcleaned spectra V<15

RVScalibrations

Multi-transits

processed

data analysis

A26

Multi-transit

s

spectra

analysis A27

C3

Archived processedspectroscopic data:

CC-peaks, extr. spectra(> 6 months old)

CC-peakslast 6 months

ArchivedCC-peaks

Archivedextractedcalibratedcleanedspectra

O1CU6/OutputResults(n+1)

C1

CU:inputResults(1:n+1)

I1

IDT&CU6/raw(n,n+1)

Functional analysis (CU6)

Mark CropperCeline DelleLucheClaude HucDavid KatzAnne Jean-AntoineThierry LevoirMichel Nonon-LatapieFrédéric Thévenin

Paris, 6-7 mars 2006

Functional Analysis of Gaia

• General purpose : overview of the datareduction chain

• Data flow and time sequence

• Developed with the SADT tool

• First one developed in 2005 cover allCUs with more or less complexities :published on livelink GAIA-C1-TN-OCA-FT-001-1

(First version Mostly developedaround CU6 and CU8 activities)

A new version in preparation for CU4,CU6 and CU8

O1

OBoardCalUpdates

O2

ScResults

I3

IdElemObs do

astrometry

A31

P. 5

do

photometry

A32

P. 7

do

spectrometry

A33

P. 11

do

global

parametrization

A34

P. 13

AtmosParamPh, mag, class

AvSp, detailed abundances

AuxPhFAPAA

ElemPh:BBP+MBP

ElemSp

ElemAs

Vsini

Vr(n+1 iteration)

Vr, Vsini,rest frame spectra,AtmosParamSp

Abund, variability,masses, ...

PhotometryAstrometry Spectrometry Auxiliary data

C2

AuxData

AuxAs

AuxSp

I4

TelDataSolObj

Classification QSOs

SNR &parts of sp useful

C1

ExpHLM

I1

TelDataMultiObj

I2

TelDataVariable

Paris, 6-7 mars 2006

Functional Analysis CU6

• Context diagram : to define theenvironment

Gaia data

reduction

system

A0

P. 2

Gaia catalogs

A-02

Observatories

A-03

Gaia Data

Analysis

Consortium

A-04

other

suppliers

(tbd)

A-05

ScResults

ScAlerts

AuxDataOBoardCalUpdates

FLookResu

ExpHLM

GaiaA06

TelDataBrut

UniversA07

Photons

OnBoardUpdates

MOC

(ESAC)

A-01

TelData

Paris, 6-7 mars 2006

Functional Analysis CU6

• Has to be organized with achronogram

Data

Reduction

epoch 1

A0

P. 2

Data

Base

epoch 0,1A-01

Data

results

epoch 1

A-02

Data

Reduction

epoch n+1

&

End of DPA03

P. 3

Data

Base

epoch 0,n+1A04

Data

results

epoch n+1

A05

IDT/Data(0)

IDT/Data(0,n)

IDT/Data(n+1)

AGIS(1)

mag(1)

First Look Vr(1)

Vr(1)

Class

Var

AGIS(n+1)

mag(n+1)

First Look Vr(N+1)

Vr(n+1)

Spectra(n+1)

CU4

Var

Class

DataResults(1)

DataResults(n)Data

Base

epoch 0,n+1A06

Paris, 6-7 mars 2006

Functional Analysis CU6

• What we have to do?

• To extract from raw data the spectra• To clean the spectra• To calibrate the RVS and the spectra• To derive a Vr and eventually Vrot

Paris, 6-7 mars 2006

The input list per object(with their uncertainties and quality flags)

• Astrometric parameters (CU3) RA and dec, proper motion for SolSYsObj• Photometric parameter (CU5) magnitudes at the time of observation: from IDT CU3 or could be processed

by CU5, variability from CU5/7• Classification parameters with their probabilities (CU8) param for selection of template (Teff, logg, Z) object class: solsysobj,QSO, single star, binary, extended object etc.• CU6 parameters-library inputs previous RVS data (internal CU6), synth data, cross-corelation masks,

external standards (RV, spectro-photometric)• CU6 inputs internal to CU6: what does it means?

Paris, 6-7 mars 2006

CU6 inputs internal to CU6: what does it means?

• Daily processing:1. spectroscopic processing raw data2. IDT/Data associated with spectro like sky mapper data

daily transfer, and CU6 list as above, most recentcalibration files

• Half-yearly processing: same

• Post mission end of processing: same

Paris, 6-7 mars 2006

CU6 output

• Daily : updated calibration (instrumental) updated star calibrators new spectra faint star sanity radial and rotational velocities diagnostics calibration trends, triggers, alerts (from sanity)

• Half-yearly: update the stars calibrator status

• Post mission end processing: update the stars calibratorstatus

Paris, 6-7 mars 2006

Traitments

• Multi-transit Analysis

1. Process data coming from the single transit: cross-correlation products. Skew processing?

2. Multi transit spectral data analysis works on theindividual spectra which could be shifted in wavelengthspace before co-adding.

Paris, 6-7 mars 2006

Traitments• Calibration/SGIS• In daily calibrations, the model is updated.• The SGIS occurs in a loop of 6 months?, the calibration of the

parameters from the instrument are re-derived by refining both thecalibration applied to the calibration of the star observations(reanalysis of the observations) and the model at the same time,iteration.

(doc: GEPI/Gaia-RVS/TN/018.01)

• Size of the sample used by SGIS: affect the frequency of the re-runof the SGIS (Time between to consecutive SGIS run? In order tocorrect model for significant systematic effects)

Paris, 6-7 mars 2006

Functional Analysis CU6

• Proposed chronogram for CU6and related flows

• Periods of 6 months

• Daily and half yearly data treatment

• Relation with CU4, 7, 8 (tbd)

Paris, 6-7 mars 2006

Functional Analysis CU6

• Has to be organized with achronogram

Data

Reduction

epoch 1

A0

P. 2

Data

Base

epoch 0,1A-01

Data

results

epoch 1

A-02

Data

Reduction

epoch n+1

&

End of DPA03

P. 3

Data

Base

epoch 0,n+1A04

Data

results

epoch n+1

A05

IDT/Data(0)

IDT/Data(0,n)

IDT/Data(n+1)

AGIS(1)

mag(1)

First Look Vr(1)

Vr(1)

Class

Var

AGIS(n+1)

mag(n+1)

First Look Vr(N+1)

Vr(n+1)

Spectra(n+1)

CU4

Var

Class

DataResults(1)

DataResults(n)Data

Base

epoch 0,n+1A06

Paris, 6-7 mars 2006

Functional Analysis CU6epoch 1

• Relations with other CUs

I1IDT/Data(0)

O1AGIS(1)

O2mag(1)

O3First Look Vr(1)

O4Vr(1)

O5Class

O6Var

AGIS

A1

CU5

A2

CU6

A3

CU8

A4

CU4

A5

CU7

A6

epoch 1: 0 month - 7 months

Paris, 6-7 mars 2006

I2IDT/Data(0,n)

I3IDT/Data(n+1)

O1AGIS(n+1)

O2mag(n+1)

O3First Look Vr(N+1)

O4Vr(n+1)

O5Spectra(n+1)

O6Class

O7CU4

O8Var

I1DataResults(n)

CU3

A1

CU5

A2

CU6

A3

CU8

A4

CU4

A5

CU7

A6

Class(n),AGIS(n)

mag(n)

mag(n)AGIS(n)Class(n)

7 months - 13 months

Class(n)Var(n)AGIS(n)

Paris, 6-7 mars 2006

Functional Analysis CU6

• The case of CU6

Data

Reduction

epoch 1

A0

P. 2

Data

Base:

raw&IDT

epoch 1

A-01

Data

results

epoch 1

A-02

epoch n+1

&

Post

Mission End

Processing

A03

P. 3

Data

Base

raw&IDT

epoch 1

to

End of

Mission

Data results

1 to end of

mission

A04

Data

results

A05

IDT/AGIS(1) CU5(1) CU6/raw(1) CU4SolObj(1)

DataResults(n)

AGIS(1)

CU5/mag(1)

CU6/First Look Vr(1)

CU6/Vr(1)

CU8/Class(1)

CU7/Var(1)

CU6/OutputResults(n+1)IDT&CU6/raw(n+1)

CU4/SolObj(1)

CU:inputResults(1:n+1)

CU6/OutputResultsPMEP

IDT&CU6/raw(1:end)

RV/SanityResults

RVScienceAlert

Paris, 6-7 mars 2006

Functional Analysis CU6

O2CU6/OutputResults(n+1)

CU6

Daily

processing

n+1

A1

P. 4

CU6

Half-yearly

processing

n+1A2

P. 8

CU6

Post mission

end

processing

A3

epoch n+1: n*6 months - (n+1)6 months

I2IDT&CU6/raw(n+1)

I1CU:inputResults(1:n+1)

IDT/Data associated with thespectro data e.g. sky-mappers data(daily transfer)

CU/InputResultsforCU61:nSpectroRawData(n+1)

O4CU6/OutputResultsPMEP

I4IDT&CU6/raw(1:end)

I3

IDT&CU6/raw(n,n+1)

O1RV/SanityResults

O3RVScienceAlert

Paris, 6-7 mars 2006

Functional Analysis CU6epoch n+1: daily processing

O2CU6/OutputResults(n+1)

CU6

Daily

processing

n+1

A1

P. 4

CU6

Half-yearly

processing

n+1A2

P. 8

CU6

Post mission

end

processing

A3

epoch n+1: n*6 months - (n+1)6 months

I2IDT&CU6/raw(n+1)

I1CU:inputResults(1:n+1)

IDT/Data associated with the

spectro data e.g. sky-mappers data

(daily transfer)

CU/InputResultsforCU6

1:nSpectroRawData(n+1)

O4CU6/OutputResultsPMEP

I4IDT&CU6/raw(1:end)

I3

IDT&CU6/raw(n,n+1)

O1RV/SanityResults

O3RVScienceAlert

Paris, 6-7 mars 2006

Functional Analysis CU6Epoch n+1: daily processing

C3

RVS characteristics:last validated

calibration data

Extraction

A11

P. 5

Single-transit

analysis

A12

P. 6

Calibration

A13

P. 7

Extraction

A14

Faint stars

sanity check

A15

Single-transit

analysis

A16

C4Auxiliary data:

e.g. atomic data,template, CC-mask

SpectroRawDataof stars V < 12

SpectroRawData of stars V < 17.5

Calibrated (TBD)Cleaned Normalisedspectra V<12

Vr Local & Vr barycentricv sin iSpectraRestFrame

Extracted calibratedcleaned spectra 15<V<17.5

Extracted calibratedcleaned spectra V<15

RVS calibration

O3

CU6/OutputResults(n+1)

I1

SpectroRawData(n+1)

C2

IDT/Data associated with thespectro data e.g. sky-mappers data

(daily transfer)C1

CU/InputResultsforCU61:n

O1

RV/SanityResults

O2RVScienceAlert

Paris, 6-7 mars 2006

Functional Analysis CU6 Epoch n+1: daily processing

EXTRACTION

C2

CU/InputResultsforCU6

1:nC3

C3

C4

C4

O1

Calibrated (TBD)

Cleaned Normalised

spectra V<12

I1SpectroRawData

of stars V < 12

C1

IDT/Data associated with the

spectro data e.g. sky-mappers data

(daily transfer)

Cut out

spectra

A111

Apply

calibration

A112

Model

background

A113

Clean spectra

A114

Normalise

spectra

A115

CalibratedSpectra

BackgroundFlux

CleanedSpectra

NormalisedSpectra

extracted Spectra

Paris, 6-7 mars 2006

Functional Analysis CU6 Epoch n+1: daily processing

SINGLE TRANSIT

I1

Calibrated (TBD)Cleaned Normalisedspectra V<12

C1

CU/InputResultsforCU61:n C2

C4

O1 Vr Local & Vr barycentric

v sin i

SpectraRestFrame

Derive

radial

velocities

for single

line systems

and identify

multiple line

systemA121Analysis of

multiple line

system

A122

Detailed

First Look2

A123

Science

Alerte

A124

SpectraOfSingleLinesystem

SpectraOfMultipleLineSystem

SpectraOfNewlyIdentified

MultipleLineSystem

RadialVelocityOfNewMultipleSystem

IdentNewMultipleSystem

O3RV/SanityResults

Coarse

Characterization

of the Sources

A125

O2RVScienceAlert

CoarseCharacterisation

Paris, 6-7 mars 2006

Functional Analysis CU6 Epoch n+1: daily processing

CALIBRATION

O1RVS calibration

C4

CU/InputResultsforCU61:n

C3

C3

C5

C4

C1

Vr Local & Vr barycentricv sin i

SpectraRestFrame

I1

Calibrated (TBD)Cleaned Normalisedspectra V<12

C2

IDT/Data associated with thespectro data e.g. sky-mappers data

(daily transfer)

Update

Calibration

at CCD level

A131

Select Stars

for use in

Calibration

A132

Update

Model for

Calibration

A133

Updated Model Calibration

Updated List of calibration stars

Paris, 6-7 mars 2006

Functional Analysis CU6

O2CU6/OutputResults(n+1)

CU6

Daily

processing

n+1

A1

P. 4

CU6

Half-yearly

processing

n+1A2

P. 8

CU6

Post mission

end

processing

A3

epoch n+1: n*6 months - (n+1)6 months

I2IDT&CU6/raw(n+1)

I1CU:inputResults(1:n+1)

IDT/Data associated with thespectro data e.g. sky-mappers data(daily transfer)

CU/InputResultsforCU61:nSpectroRawData(n+1)

O4CU6/OutputResultsPMEP

I4IDT&CU6/raw(1:end)

I3

IDT&CU6/raw(n,n+1)

O1RV/SanityResults

O3RVScienceAlert

Paris, 6-7 mars 2006

Functional Analysis CU6Half yearly processing

Extraction

SGIS loop

A21

Single-transit

analysis

SGIS loop

A22 Calibration

SGIS loop

A23

Extraction

A24 Single-transit

analysis

A25

C2

Auxiliary data:e.g. atomic data,

template, CC-mask

Spectra ofstars V < 12

Spectra ofstars V < 17.5

Extractedraw or calibrated (TBD)cleaned spectra V<12

Vr &v sin i

Extracted calibratedcleaned spectra V < see table 2

Extracted calibratedcleaned spectra V<15

RVScalibrations

Multi-transits

processed

data analysis

A26

Multi-transit

s

spectra

analysis A27

C3

Archived processedspectroscopic data:

CC-peaks, extr. spectra(> 6 months old)

CC-peakslast 6 months

ArchivedCC-peaks

Archivedextractedcalibratedcleanedspectra

O1CU6/OutputResults(n+1)

C1

CU:inputResults(1:n+1)

I1

IDT&CU6/raw(n,n+1)