26
AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud, on behalf of: The CDPP / IRAP team: (C. Jacquey, V. Génot, E. Budnik, N. André, M. Bouchemit, M. Gangloff, B. Lavraud) The SWEA / IRAP team: (J.-A. Sauvaud, E. Penou, A. Opitz, A. Fedorov, P. Louarn, B. Lavraud ) CESR, Toulouse, France

AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Embed Size (px)

Citation preview

Page 1: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

AMDA and CLweb

Two complementary web-based services for spacecraft data exploitation

with help from LESIA and support from CNES and CNRS

Benoit Lavraud, on behalf of:

The CDPP / IRAP team:(C. Jacquey, V. Génot, E. Budnik, N. André, M. Bouchemit, M. Gangloff, B. Lavraud)

The SWEA / IRAP team:(J.-A. Sauvaud, E. Penou, A. Opitz, A. Fedorov, P. Louarn, B. Lavraud )

CESR, Toulouse, France

Page 2: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Why complementary?

AMDA:- Mainly uses basic datasets for given mission- Allows statistical analyses (searches)- Creates Time-Tables (event lists)

CLWeb:- Uses all products from instruments/missions- Allows detailed data analysis (distribution functions, HKP data, modes, etc.)

- Uses Time-Tables

Link: Time-Tables

Page 3: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

CDPP : http://cdpp.cesr.fr

French national centre (CNRS-CNES) > 10 years

Hosted at CESR, Toulouse, France

Missions:- Archiving data for long-term preservation- Data valorisation

Making data easy to use Providing tools and services

- Participation to Virtual Observatories

Page 4: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

• Web-based public service (in operation for ~3 years)

• Registered or “guest” access

• Transparent (automated) access to data users play with parameters, not files

• AMDA local database : STEREO, CLUSTER, ACE, THEMIS, GEOTAIL, WIND, …, VEX, MEX, …, IMP-8, ISEE, … geo. indices

• External databases : CDAWeb, CASSINI, VEX-MAG, THEMIS/CESR, …

• Produces and exploits Time-Tables (event lists)

Helps to make science !

AMDA : http://cdpp-amda.cesr.fr

Visualisation editor

Parameter editor

Download data

Visual search

External data

Conditional search

Time-Table manager

Page 5: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

AMDA basics

- Parameters (scalar, vector, …)• Density• Indices• Magnetic/velocity vector• Flux in a given energy band

- … stored as xml files with• Resolution• Start-Stop times

- … which the user manipulates :• New parameters• Plots/visualizations• Searches & Time-Tables• Downloads

- File architecture hidden to the user

17/11/199431/12/2005Sampling 4s

Page 6: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

AMDA time tables

- Lists of time intervals : Start – Stop

- Obtained :• Visually : the user selects intervals by mouse click on a plot• From a mathematical condition imposed on data content• Up-loaded from user disk or from URL

- Stored in txt or xml VOTable format

- SPASE descriptor can also be provided

- Time tables are also used in QSAS (Imperial College, UK) and CLWeb (CESR, France)

Page 7: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

AMDA:

HCS detection use-case

Page 8: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
Page 9: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Build new parameters

Page 10: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Save and re-use them

Page 11: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
Page 12: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

HCS:Param<0

Page 13: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

ConditionalSearch

Page 14: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Manipulate Time-Tables

Page 15: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Plot onlyfor TTs

Page 16: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Refine orcreate newTime-Tables

True sector boundary

Magneticsector boundary

Page 17: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

My own Time-Tables

Operations on TTs

Share TTs

Download TTs

Upload TTs

All shared TTs

Page 18: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

CLweb:

Detailed data analysis

Page 19: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
Page 20: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
Page 21: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Various menus

Electron PAD

Page 22: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

May use HCS TT from AMDA and study

details of PADs or BURST mode data

Page 23: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Detailed BURST data analysis with CLweb

2 minutes

Reconnectionexhaust

at an HCS

Page 24: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

Using time-tables

Time-TableStart Time – Stop Time – numberStart Time – Stop Time – numberStart Time – Stop Time – numberStart Time – Stop Time – number

….

CLQSAS

CAATools

CDAWeb

SUPERDARNAPL serverDARTSRequirements:

A Time-Table format standardCollaboration CDPP/CAA/QSAS/CL: VOtablehttp://cdpp2.cesr.fr/twiki/bin/view/AMDA/AmdaTimeTableFormat

An interface for reading the standardised Time-Tables A web interface module to skip from one time interval to another one

Load Time-Table >>>

>>>

Further notes on AMDA: IDL/Matlab routines for reading TTs available on web site The site explains how to access data through web-services To register, just send an email to [email protected] Free CDPP stickers for the first, next 10 to register !!!

Page 25: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

ConclusionsConclusions

• From the above, the scientific interest for such tools is evidenced

• Complementarities of tools is important : it mutually enhances efficiency and usefulness

• Would take much more time to scientists to produce such results on their own

• It creates a community of user (ex: Time-Tables sharing)

• User feedback is needed and encouraged!

Page 26: AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,

PerspectivesPerspectives

• Need for more standardization (including simulation databases)

• Need for more implication of scientists : Virtual Observatories subject is not a sole “technical” thing. New tools and services must be science-triggered and tested by scientists

• Need for diversification : time series are not the only class of objects which could be manipulated (images, maps, …)

• Need for conferences/places to disseminate these activities

Messenger cruise B-field cruise data will be in AMDA in April

Heliophysics studies: STEREO, VEX, MESSENGER, CASSINI, Earth, remote access to CDAWEB, and more in future…