42
Astronomical Databases & VOs Astronomical Databases and Virtual Observatories Surfing the Tsunami of Data 28 th  International School for Young Astronomers Instituto Nacional de Astronomía, Óptica y Electrónica Tonantzintla, México Rodolfo H. Barbá Universidad de La Serena - Chile

Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

Astronomical Databases & VOs

Astronomical Databases and Virtual Observatories

Surfing the Tsunami of Data

28th International School for Young Astronomers

Instituto Nacional de Astronomía, Óptica y Electrónica 

Tonantzintla, México

Rodolfo H. Barbá

Universidad de La Serena ­ Chile

Page 2: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 2 Astronomical Databases & VOs

Motivation

We are living an age of very fast changes in the way to do Astronomy

Astronomy is one of the prime sciences of the human being 

Astronomy goals through the centuries:

✔ Registering and recording of heaven events

✔ Developing of methodologies to keep and track such events

✔ SHARING the information and the knowledge

✔ During 20th century: international organization (IAU)

✔ Astronomy is one of the most international organised science. Nobody is “owner” of the heaven.

Page 3: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 3 Astronomical Databases & VOs

Motivation

Astronomy now:

✔ The technology (computers, communications, etc.) is changing the way to access to the information.

✔ Observational facilities based in astronomical satellites, “automated survey telescopes”, and 4­8 meters class telescopes are available everywhere.

✔ The next decade are planned amazing facilities.

✔ The information gathered by these facilities (and their derived products) is organised in huge databases...

Page 4: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 4 Astronomical Databases & VOs

Motivation

Astronomy now:

✔ and also, the services of such databases is being connected through computer grids

✔ “virtual observational astronomy” is coming now

✔ The observations are “there”, in fact, we “don't need” telescopes to do high-quality observational astronomy

✔ beyond the computer, software and internet connection, to use these observations and their products we need “only”....

Page 5: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 5 Astronomical Databases & VOs

Motivation

We need...

IMAGINATION

and

IDEAS

Page 6: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 6 Astronomical Databases & VOs

Page 7: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 7 Astronomical Databases & VOs

Page 8: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 8 Astronomical Databases & VOs

MotivationFor our countries with scarce resources:

✔Opportunity to access to high­quality material.

✔We can do good “observational astrophysics” to relatively very low costs: free scientific software based on LINUX are available through Internet.

✔Training young astronomer in the use of these observations as a “experimental observatory” to apply for observing time in international observatories (ground and space).

✔Participating in the development of astronomical databases and grids.

✔and more...

Page 9: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 9 Astronomical Databases & VOs

Goals to reachThe goals to be reached in this 28th ISYA about the use of astronomical  databases are:

✔To understand how the different elements of an observing proposal (as astrophysical subjects) are related.

✔To learn how the astronomical information is collected and organised on the Internet

✔To get quick looks of several astronomical information systems (data centres, bibliographic severs, image servers, etc.)

✔To learn which kind of information could be retrieved

Page 10: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 10 Astronomical Databases & VOs

Goals to reach

✔To learn about the use of image and catalogue visualisation software

✔To learn about some warnings in the use of catalogues and images

✔Examples how to retrieve scientific observations from data servers

✔Labs about how to access to these systems

✔ Ideas to do...

✔The next future: basic concepts about astrophysical virtual observatories and datamining tools.

Page 11: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 11 Astronomical Databases & VOs

ObservingProposal

Bib

. Ref

eren

ces Science aims

Antecedents

Theor. Backg.

TelescopeInstrumentDetector

Objects

Processing &Analysis

Methodology

ExperimentalDesign

References

Cat

alog

ues

Dupl. Check

Image Servers

Nomenclature

Coordinates

Others:Magnitudes

FluxesEphemeris

Proper motions

Beam

The observing proposal

Page 12: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 12 Astronomical Databases & VOs

Data Centres

They were the first institutions to systematically collect machine readable versions of astronomical catalogues.

All Data Centres offer services (increasing continuously), and they are participating in the creation of virtual observatories.

The access is free through Internet, using different technologies

Some services offered:✔ Images✔ Catalogues✔ Bibliographic resources✔ “Yellow pages”

Page 13: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 13 Astronomical Databases & VOs

Data Centres

There are two general purposes Data Centres:

Resolved object populations in the MW and nearby galaxies:

Extragalactic database

http://cdsweb.u-strasbg.fr

http://nedwww.ipac.caltech.edu

Page 14: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 14 Astronomical Databases & VOs

Page 15: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 15 Astronomical Databases & VOs

Page 16: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 16 Astronomical Databases & VOs

Data Centres

The increasing number of space missions have led to the creation of mission­oriented data centres like:✔ Hubble Space Telescope: STScI http://www.stsci.edu and ST­ECF 

http://ecf.hq.eso.org✔ Infrared missions: IPAC http://www.ipac.caltech.edu✔ High­energy: NASA HEASARC http://heasarc.gsfc.nasa.gov, Harvard 

http://asc.harvard.edu/  and MPE http://wave.xray.mpe.mpg.de✔ ISO, IUE: VILSPA http://www.vilspa.esa.es✔ Multipurpose: CADC http://cadcwww.dao.nrc.ca✔ and many others

Page 17: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 17 Astronomical Databases & VOs

Data Centres

Also several major goundbased observatories have established data centres to manage their past observations:

✔ European Southern Observatory: http://archive.eso.org ✔ NRAO Very Large Array, http://archive.nrao.edu✔ Royal Greenwich Observatory on La Palma http://archive.ast.cam.ac.uk✔ Gemini, CFHT: CADC http://cadcwww.dao.nrc.ca✔ Subaru (NAO­JP): SMOKA Archive Facility http://smoka.nao.ac.jp✔ NOAO (Cerro Tololo, Kitt Peak): http://archive.noao.edu✔ Etc. etc.

Page 18: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 18 Astronomical Databases & VOs

Data Centres

Many Sky Survey Projects are developed sophisticated Data Centres, and the list is growing incredibly fast:

✔ Two­Micron All Sky Survey (2MASS): ✔ Sloan Digital Sky Survey (SDSS):✔ Deep Near Infrared Survey of the Southern Sky (DENIS):✔ Massive Compact Halo Objects (MACHO) http://wwwmacho.anu.edu.au✔ OGLE, http://bulge.princeton.edu/~ogle/✔ ASAS, http://archive.princeton.edu/~asas/✔ Etc. etc., see http://www.cv.nrao.edu/fits/www/yp_survey.html

Page 19: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 19 Astronomical Databases & VOs

AstroWeb

AstroWeb is a collection of astronomical & space science resources on Internet with relevant significance. It is maintained by the AstroWeb Consortium (distributed in several institution worldwide):

✔ CDS, http://cdsweb.u­strasbg.fr/astroweb.html✔ MSSSO, http://msowww.anu.edu.au/~anton/astroweb/astronomy.html✔ NRAO, http://fits.cv.nrao.edu/www/astronomy.html✔ STScI, http://www.stsci.edu/net­resources.html✔ VILSPA, http://www.vilspa.esa.es/astroweb/astronomy.html✔ IoA Cambridge,  http://www.ast.cam.ac.uk/astroweb/yp_astronomy.html 

AstroWeb looks like yellow pages and it is organised in specific items, actualised more or less periodicallyWARNING: it is uncompleted and some URL (links) could be out of date.

Page 20: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 20 Astronomical Databases & VOs

StarPagesIn CDS, André Heck (StarBriefs 2001, Dordretch: Kluwer Acad. Pub.) developed a series of astronomical services on Internet: the StarPages. They are part of Star*s Family resources on WWW), configuring the true astronomical pages.

http://vizier.u­strasbg.fr/starpages.html

✔ StarWorlds: astronomy­related organisations, institutions, associations, companies, and so on: about 6500 entries from more than 100 countries

✔ StarHeads: personal WWW pages of professional astronomers and related scientists: 6000 entries

✔ StarBits: abbreviations, acronyms, contractions, symbols, and so on: about 200,000 entries

Page 21: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 21 Astronomical Databases & VOs

AstroWeb vs StarPages

AstroWeb or StarPages, which is better? Depends what you are finding.

✔ AstroWeb is free, and StarPages is expensive✔ AstroWeb is a compilation of about 3000 URLs, compared with 12000 

offered by StarPages ✔ StarPages offers specific information which is authenticated, regurlarly 

updated, homogenised, and systematically presents✔ AstroWeb is presented as a long­list for visual inspection✔ StarPages is very useful for searching engines (like Google)✔ AstrroWeb includes information of projects that not adjust in StarPages✔ StarWorlds contains data of sites and institutions without presence on 

Internet

Page 22: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 22 Astronomical Databases & VOs

Object databasesObject databases gather both bibliographic references and meansurement quantities on galactic and extragalactic objects. There are many with increasing specialisation and complexity. Three are the prime ones:

✔ SIMBAD, http://simbad.u­strasbg.fr✔ NED, http://nedwww.ipac.caltech.edu✔ LEDA, Lyon­Meudon Extragalactic Database

SIMBAD is specialised in galactic objects, while NED and LEDA are specialised in extragalactic ones.

All three involve the concept of an astronomical object-name resolver, whichaccept and return identifiers; it also permits retrieval of all objects within specific

radius around coordinates.

The nomenclature of “astronomical sources of radiation outside the solar system” is regulated by the IAU Commission 5 Task Group on Designations

Page 23: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 23 Astronomical Databases & VOs

Astronomical cataloguesIt should be in mind that object databases generally do not include the fullinformation contained in CDS/NED catalogues.

We consider “astronomical catalogues” as static, final compilations of data for a given set of cosmic objects.

But (as we´ll see the next week) now are appearing dynamic catalogues

According to Jascheck (1989) they can be classified

1) Observational catalogues2) Compilation catalogues3) Critical compilation catalogues and bibliographical compilation catalogues

In category (1) now are included a new generation of catalogues derived from very specific surveys: 2MASS, HDF, MACHO, etc.

Page 24: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 24 Astronomical Databases & VOs

Astronomical cataloguesCDS maintain the most complete set of astronomical catalogues in the Astronomer's Bazaar, cdsweb.u­strasbg.fr/Cats.html

✔ 6060 catalogues available from CDS...✔ ... of which 5150 available on-line (as full ASCII or FITS tables)...✔ ... of which 4815 are also available through de VizieR browser

VizieR is a powerful tool to search and retrieve information from cataloguesA query in VizieR can be achieved: ✔ either in the traditional way of stepping through the following actions: 1.select one or a few catalogues to be queried 2.define your constraints (selection on columns) and the result layout 3. Get the results in a tabular form. Correlated data may be found. 4.Full Display of individual rows if wished;

This traditional way accepts lists of constraints or targets saved in a file. ✔ or as a global search around a position on the sky addressed to all or to a subset of catalogues existing in VizieR

Page 25: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 25 Astronomical Databases & VOs

Page 26: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 26 Astronomical Databases & VOs

Page 27: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 27 Astronomical Databases & VOs

Page 28: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 28 Astronomical Databases & VOs

Page 29: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 29 Astronomical Databases & VOs

Bibliographical servicesAstronomischer Jahresbericht was the first astronomical abstract service (1899-1968)

Astronomy & Astrophysics Abstracts - AAA (1969-2000)

Internet age: NASA's Astrophysics Data System http://adsabs.harvard.edu Abstract and Paper Service - ADS (1993)

➢ Mirrors world-wide ➢ Access using web browsers and shell commands➢ ADS provides sophisticated search facilities➢ Access to scanned and electronic papers➢ Links to references, object databases and other resources➢ Refcode or Bibcode: 19-characters reference code unique for each paper,

e.g. 2002ApJ...578..464S➢ myADS: E-mail notification service configurable by the user (through

cookies)

Internet age: e-Prrint Services ArXiv http://arxiv.org including astro-ph, the most important preprint server for Astrophysics (since 4/1992), in Cornell Univ.

➢ linked to ADS and fully referenced➢ Service integrated to myADS

Page 30: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 30 Astronomical Databases & VOs

Page 31: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 31 Astronomical Databases & VOs

Page 32: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 32 Astronomical Databases & VOs

Page 33: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 33 Astronomical Databases & VOs

Page 34: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 34 Astronomical Databases & VOs

Page 35: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 35 Astronomical Databases & VOs

Page 36: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 36 Astronomical Databases & VOs

Page 37: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 37 Astronomical Databases & VOs

Miscellaneous servicesNED hosts the LEVEL5 project. This is an on­going and developing experimental service sponsored by NASA and the Carnegie Institution ofWashington, in conjunction with NED

The purpose of LEVEL5 is to bring together in a single gateway WEB site (where copyrights allow) "original" documents and reviews and/or electronic links to articles of current and lasting interest to cosmologists, particle physicists and extragalactic astronomers. 

Page 38: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 38 Astronomical Databases & VOs

Page 39: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 39 Astronomical Databases & VOs

Page 40: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 40 Astronomical Databases & VOs

Page 41: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 41 Astronomical Databases & VOs

Page 42: Astronomical Databases and Virtual Observatories …isya28/lecciones/rodolfo_1.pdfISYA 28th - 2005 4 Astronomical Databases & VOs Motivation Astronomy now: and also, the services of

ISYA 28th - 2005 Astronomical Databases & VOs

AcknowledgementsI am grateful to the ISYA organizers for the opportunity to give this lectures and for their financial support.

The material presented in this talk is based on information collected from CDS, ADS, NED Data Centres and The New York Times. 

This talk was prepared using Open Office 2.0 running in a LINUX SuSe 9.3 box.