VO activities at CfA G. Fabbiano (Harvard-Smithsonian Center for Astrophysics) With contributions...

VO activities at CfA

G. Fabbiano(Harvard-Smithsonian Center for Astrophysics)

With contributions from: Aneta Siemiginowska, Margarita Karovska, Doug Mink, Alyssa Goodman

and the entire CfA NVO Team

Harvard College Observatory

Smithsonian Astrophysical Observatory

Chandra

HubbleMMT

Sub-mm array

VLA

The Harvard-Smithsonian Center for Astrophysics

• A natural place for VO activities• The largest single astrophysical

center in the USA• Radio through gamma-rays

waveband expertise: ground-based and space

• Solar system through cosmology areas of research: observational and theory

Antartica sub-mm Magellan 6.5m

Whipple -ray

SIRTF

Oak Ridge

1.2m CO

• HEAD (The X-ray Group)– Legacy: UHURU, HEAO-1, Einstein, ROSAT– Chandra X-ray Center (CXC)

• Supports all phases of the Chandra mission• Processing, archival, and distribution of data• Chandra user support (http://cxc.harvard.edu/)

– ADS (in collaboration with Optical-IR)• Bibliography search engine

(http://adswww.harvard.edu/)

Data Center & Service Expertise at CfA

CfA and NASA Data Centers

• SAO is a partner in HEASARC with NASA-GSFC• CXC and ADS are members of NASA ADEC (Astro.

Data centers Executive Committee)• ADEC scope is to further VO-like connections

between NASA archives and data services– ADS – data links implemented with MAST (STScI), CXC,

IRSA

– Wider inter-archive operability is in the workssee Tom McGlynn’s talk

• Established– Chandra Data Archive (CDA)– OIR Data Archive (Harvard and SAO ground

based telescopes): Telescope Data Center (TDC)

• Soon to come– Sub-mm– Radio– COMPLETE

Data Archives at CfA

Chandra Data Archive• Contains all Chandra telemetry and processed data

products (proprietary and public)• Current data product volume is 1.3 TB• Mirror site in UK (Leicester)• Access through CXC

S&R interface (ChaSeRand WebChaSeR) and via HEASARC

The CXC/X-ray Community Data Approach leading to VO-ready archives

• Uniform pipeline processing of all data see poster by Evans et al– Aspect correction, filtering (e.g.

hot pix removal), coadding frames, source properties

• Well-defined data product levels– Each level depends only on data

in preceding level• Adoption of standard data

formats– HEASARC FITS conventions;

event files• Separate tracked calibration

information– HEASARC CALDB, expanded

for Chandra

• Chandra L3 processing will produce source-based archival information

X-ray multi-mission analysis software

• Moving towards a VO analysis tool-kit

– FTOOLS (GSFC), CIAO (CXC)

– Mix and match tool-boxes

– FTOOLS operate on FITS files

– CIAO uses Chandra Data Model I/O

– FTOOLS and CIAO tools can be used in single analysis session

• Freely available on the Web

• On line manuals, tutorial and documentation

• CIAO web page ishttp://cxc.harvard.edu/ciao/

The Chandra Data Model (CDM)• CDM was developed (see J. McDowell’s talk)

– To handle different format & multi-mission data

• Different X-ray missions

• Non X-ray data

– Data filtering and extraction

• From user-defined regions in any data hypercube axis

– Data subspace

• Information on what was done to the data is carried by the data

CIAO +CDM• Operate on any data axis or combination (e.g. X, Y, time,

spectrum)– Example: modelling spatial distribution of X-ray cluster (Sherpa)

Data Model

Residuals

Adaptively smoothed residuals

CIAO + CDM

• Multi-mission / multi wave-band analysis– Optical-X-ray

spectrum– Red line is

Sherpa fit

CIAO +CDM+DS9

Eta Car

X-rays: Chandra

• Choose your wavelength band multi-color images

CIAO +CDM+DS9

Eta Car

Radio: VLA

• Choose your wavelength band multi-color images

CIAO +CDM+DS9

Eta Car

Optical: HST

• Choose your wavelength band multi-color images

CIAO +CDM+DS9

Eta Car

• Choose your wavelength band multi-color images

Radio + Optical +X-rays

• The TDC maintains archives of spectroscopic data from SAO telescopes (http://tdc-www.harvard.edu/)

• Uniform pipeline processing is performed before inclusion in TDC

• Public access and proprietary data policy is under discussion

– Z-Machine: all 27,171 spectra (Aug 78 –Sep 93) on line and searchable by position, name, reduced file number(http://tdc-www.harvard.edu/zmach/minkd.html)

– FAST: 5,400/88,166 spectra (Jan 94 – now) public. The rest awaits policy decision (processed)(http://tdc-www.harvard.edu/fast/tokarzs.html)

– 7,026 Z-Machine and 4,488 FAST spectra accessible through Updated Zwicky Catalog search page

– MMT Blue Channel Spectrograph: 8,784 spectra (Oct 80 –Oct 94) archived but not released.

– Echelle data (archived but not released):• Oak Ridge: 120,559 spectra (from Jul 82)

• Whipple: 69,008 spectra (from Dec 88)

• MMT: 24,507 spectra (Ap 81 – Jan 98)

Digitizing the Harvard Plate Collection

•400,000 glass photographic plates

•Northern and Southern emisphere

•104 year coverage: 1885 – 1989

•Trial scanning of 100 plates (8x10 in) this summer (2002)

•Uncompressed data volume ~80 TB

M44

COMPLETE, Part 1A. Goodman

Observations:Mid- and Far-IR SIRTF Legacy Observations: dust temperature and column density maps ~5 degrees mapped with ~15" resolution (at 70 m)

NICER/2MASS Extinction Mapping: dust column density maps, used as target list in HHT & FCRAO observations + reddening information ~5 degrees mapped with ~5' resolution

HHT Observations: dust column density maps, finds all "cold" source ~20" resolution on all AV>2”

FCRAO/SEQUOIA 13CO and 13CO Observations: gas temperature, density and velocity information ~40" resolution on all AV>1

Science:Combined Thermal Emission (SIRTF/HHT) data: dust spectral-energy distributions, giving emissivity, Tdust and Ndust

Extinction/Thermal Emission inter-comparison: unprecedented constraints on dust properties and cloud distances, in addition to high-dynamic range Ndust map

Spectral-line/Ndust Comparisons Systematic censes of inflow, outflow & turbulent motions will be enabled—for regions with independent constraints on their density.

CO maps in conjunction with SIRTF point sources will comprise YSO outflow census

5 degrees (~tens of pc)

SIRTF Legacy Coverage of Perseus

2MASS/NICER Extinction Map of Orion

Un(coordinated) Molecular-Probe Line,

Extinction and Thermal Emission

Observations

5:41:0040 20 40 42:00

2:00

55

50

05

10

15

20

25

30

R.A. (2000)

1 pc

SCUBA

5:40:003041:003042:00

2:00

1:50

10

20

30

40

R.A. (2000)

1 pc

SCUBA

Molecular Line Map

Nagahama et al. 1998 13CO (1-0) Survey

Lombardi & Alves 2001Johnstone et al. 2001 Johnstone et al. 2001

COMPLETE, Part 2

Observations, using target list generated from Part 1:

NICER/8-m/IR camera Observations: best density profiles for dust associated

with "cores". ~10" resolution SCUBA Observations: density and temperature profiles for dust associated with "cores" ~10" resolutionFCRAO+ IRAM N2H+ Observations: gas temperature, density and velocity information for "cores” ~15" resolution

Science:Multiplicity/fragmentation studies

Detailed modeling of pressure structure on <0.3 pc scales

Searches for the "loss" of turbulent energy (coherence)

FCRAO N2H+ map with CS spectra superimposed.

(Le

e,

Mye

rs &

Ta

falla

20

01

).

CfA Participation in theVO •Member of the `Large' NSF proposal team

-SAO leads Data Model effort (J. McDowell)- SAO participates in metadata (A. Rots) and testbed (I. Evans, M. Noble)

•Awarded NSF `medium’ grantCfA team with AAVSO (Janet Mattei) and BU (Tania Szlateva) participation

- CfA collaborators: RG (Alyssa Goodman), OIR (Bob Kirshner, Mike Kurtz), HEAD (Pepi Fabbiano, Arnold Rots, Jonathan McDowell, Ian

Evans, Mike Noble, Janet DePonte Evans, Martin Elvis), SED (Phil Sadler)

•Membership in the NASA-NSF NVO SDT- Roger Brissenden, Pepi Fabbiano

•Membership in the AVO science working group

CfA Participation in theVO •Design Data Model(DM)

•Participate in large NVO testbed (CDA)

•Build a CfA prototype to validate our VO development

•Federate CfA Archives (in order of readiness)- Chandra Data Archive (CDA)- OIR/MMT- TRACE (solar high res. X-ray images)- Radio (COMPLETE, CO galactic plane survey)

•Link Archive with ADS (implemented in CDA)

•Include AAVSO data in the federation

•Implement CfA DM and QM layers

•Build simple User Interface

•Build simple EPO Interface

•CfA prototype will be available to the VO

CfA NVO Focus: the VO Data Model

• Object Oriented model of the sky and of the archives, to support:- query language that translates astronomical queries into

database queries- extraction mechanism allowing user-specified filters and format,

while preserving coordinate information- preservation of calibration- generalized analysis tools, independent of data domain- strongly linked data analysis - archive connection

see Jonathan McDowell’s talk this afternoon

• Chandra Data Model provides starting-point experience

CfA NVO Testbed and Prototype

CfA NVO Testbed and Prototype

1. Query i/f: translates user’s query into QML (Query Model Language) and dispatches grid search

2. Exploders resolve query into subqueries and dispatch them in grid

3. An SSE (Site Specific Translator) at each targeted archive receives and translates query into mission-specific LQM (Local Query Model) to generate request

4. Archival data are retrieved and via SSE pipeline and translated from LDM (Local Data Model format) to DMP (Data Model Protocol) compliant format

5. GDFs (Generic Data Filters) process DMP data from subqueries and Data Fusers concatenate data for return to the DAL (Data Access Layer)

VO: Creating the Future of Astrophysics Data Analysis

Territory covered by CfA VO prototype and testbed

How do we proceed?

CfA multi-wavelength VO team gives input to DM and QM design

Input is shared with entire VO community and vice-versa

Design will be tested via prototypes/demos that will exercise key threads through the CfA testbed

A successive approximation approach will be applied to get to the final working system (this method was used successfully to build the CXC Data System)