26
The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

Embed Size (px)

Citation preview

Page 1: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

The CDPP

Centre de Données de la Physique des Plasmas

Plasma Physics Data Centre

Page 2: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

French national centre (CNRS-CNES) > 10 years

Hosted at CESR, Toulouse, France

Missions:-Archiving the data for long-term preservation-Valorisation of the data

Making data easy to useProviding tools and services

-Participation to Virtual Observatories

http://cdpp.cesr.fr

-HELIO

- EuroPLANET

Page 3: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

The CDPP Team

CESRToulouse

CNESToulouse

LESIAMeudon

LPCEOrléans

CESRToulouseCETP

Paris

LPGGrenoble

AKKA

GFI

NOVELTIS

Associatedscientists/engineers

Industrial support

CDPP

Co-libri

Page 4: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

The CDPP teamExecutive Director, Project Scientist: Christian Jacquey (CESR)

Project Manager: Dominique Heulet (CNES)

Science team (~3 EFT):

Vincent Génot, (CESR), Lead Scientist for Added Value Service development Baptiste Cecconi, (LESIA), Lead Scientist for Wave/Radio data and services Carine Briand, (LESIA), Lead Scientist for Wave Form data and services Nicolas André, (CESR), Lead Scientist for CDPP activities in planetogyChristian Jacquey, Particle data, Added Value Service development and VO activities

Associated scientists:Benoit Lavraud, (CESR), Heliophysics, Solar-Terrestrial relationshipChristian Mazelle, (CESR), GIOTTO, Cometary dataGérard Belmont, Patrick Robert, (CETP), Analysis toolsPhilippe Louarn, (CESR), magnetotail, shocksAurélie Marchaudon, (LPCE), Ground-Space observationsFrédéric Pitout, (LPG), EISCAT

Technical team (~7 EFT):

Dominique Heulet, (CNES), Lead engineer for Archive SystemFrançoise Dériot, (CNES), Lead Engineer for ArchivingMichel Gangloff, (CESR) Lead Engineer for Interoperability, Standards and VO activitiesMyriam Bouchemit, (CESR), Lead Engineer for servers and Added Value Service development

Industrial support:Eléna Budnik, (NOVELTIS), Added Value Service development, Data ingestionThomas Moreau, (GFI), THEMIS dataGFI, 3D-view multi-mission serviceAKKA, data archiving, CDPP data format

Associated Engineers:Etienne Pallier, (CESR), MAPSKP, EuroPLANETAndrei Fedorov, (CESR), AMDA system, ASPERA dataEmmanuel Penou, (CESR), THEMIS data, CL-AMDA connections

Page 5: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

1 0 1 0 0 1 1 1 1 1 1 1 1 0 1 0 1 1 0 0 1 1 0 0 1 1 0 0 0 1 0 1 0 1 1 0 1 0 1 1 1 0 0 0 1 0 1 1 0 0 1 0 1 1 1 1 1 0 1 1 1 0 0 0 1 0 0 0 1 0 1 1 1 0 1 0 1 0 1 1 1 0 1 1 0 0 0 1 1 1 0 1 1 0 1 1 1 0 0 1 1 1 0 0 0 1 0 0 0 0 1 0 1 1 0 0 0 1 0 0 1 1 1 1 0 0 1 0 0 1 1 1 1 0 0 1 1 0 1 0 0 0 1 1 0 0 0 0 0 1 0 0 0 0 0 1 1 1 1 1 0 0 0 1 1 0 1 1 0 1 0 1 0 1 1 1 1 1 1 0 0 1 0 0 1 0 1 1 1 0 0 1 0 0 1 0 1 0 0 0 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 1 0 1 0 1 1 0 1 1 1 0 1 0 1 0 0 1 1 1 1 0 1 1 0 1 1 0 0 1 1 1 0 1 0 1 1 1 0 1 1 1 1 1 0 1 1 1 0 1 1 1 1 1 0 0 0 1 1 0 0 1 0 1 1 0 1 0 0 1 0 0 0 0 1 1 0 1 1 1 0 0 1 1 1 1 0 0 1 1 0 1 1 0 1 1 1 1 1 0 0 1 0 1 1 0 0 1 1 0 1 0 1 0 0 1 0 0 0 1 1 1 1 1 1 0 0 0 1 0 1 0 0 1 1 1 0 0 0 0 1 1 1 0 1 0 1 1 1 1 0 0 1 1 1 1 1 0 0 1 0 1 0 0 1 1 1 0 0 1 1 1 1 1 1 0 0 1 0 0 0 1 1 0 0 1 0 1 1 1 1 0 0 1 0 0 1 0 1 0 1 1 0 1 1 1 0 0 1 1 0 0 0 0 1 0 1 0 1 1 1 0 1 1 1 1 0 1 1 1 0 1 0 1 1 1 1 1 0 0 0 1 1 1 0 0 0 0 1 0 1 1 1 1 1 0 1 1 1 1 1 1 0 0 0 0 0 1 1 1 0 0 1 0 1 1 0 1 0 1 1 0 1 0 0 1 1 0 0 0 0 1 0 0 1 1 0 0 1 1 0 0 0 1 1 0 0 0 1 1 0 1 0 0 0 1 0 0 1 0 0 0 0 1 0 0 0 1 1 0 1 1 1 0 0 0 1 0 1 0 0 0 1 1 0 1 1 1 1 0 1 0 0 1 1 0 0 1 1 1 1 0 0 1 0 0 1 0 1 1 1 0 0 1 1 0 1 1 0 1 1 0 0 0 0 0 1 1 1 1 0 1 1 0 1 0 1 0 0 1 0 1 0 1 1 0 0 1 0 0 0 0 1 1 0 0 0 1 0 1 0 1 1 1 1 0 1 1 0 1 0 1 1 0 1 0 0 0 1 1 0 1 1 0 0 0 1 0 0 0 1 0 1 0 1 1 0 0 0 0 0 0 1 1 1 1 0 1 1 0 0 1 0 1 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 0 1 1 1 1 0 0 0 1 0 0 1 0 0 0 0 0 0 0 0 0 1 0 1 1 0 0 1 1 1 1 1 0 0 0 0 0 1 0 0 0 1 1 0 1 0 1 1 1 0 0 1 0 0 1 1 1 0 0 1 1 1 0 0 1 1 1 1 0 0 0 1 1 0 1 1 1 0 0 1 0 0 1 0 0 0 0 1 1 1 0 1 1 0 0 1 0 0 1 0 1 0 1 0 0 1 0 1 1 1 0 0 1 1 0 0 0 0 1 0 0 0 0 1 0 1 1 1 1 1 1 0 0 1 1 1 1 0 0 0 1 0 0 1 0 1 1 0 0 1 1 0 0 1 1 0 0 0 1 0 0 0 1 0 0 1 0 0 1 0 1 1 1 0 0 0 0 1 1 1 1 1 1 0 0 0 1 1 0 1 1 0 0 1 1 0 1 1 1 0 0 1 0 1 1 1 1 0 0 1 0 0 1 1 0 0 1 1 1 0 1 1 1 0 0 1 1 1 0 1 0 0 1 1 0 1 1 0 1 0 1 0 1 1 0 1 0 1 0 0 1 0 0 1 0 0 1 0 0 0 0 0 0 0 1 1 0 1 1 0 0 1 1 0 1 0 1 1 1 1 0 0 1 0 1 0 0 0 0 1 0 0 1 1 1 0 0 1 0 0 1 1 0 1 0 0 1 0 0 1 0 1 0 0 0 0 0 0 1 0 0 0 1 0 1 1 0 1 1 0 0 1 1 1 1 0 1 1 0 0 1 0 1 1 1 1 1 0 1 0 0 0 1 0 1 0 0 0 1 0 1 0 0 0 1 1 1 0 0 0 0 0 0 1 1 1 1 1 1 0 0 1 0 0 1 0 0 0 1 1 0 1 0 1 0 1 1 0 0 0 1 1 0 0 0 0 0 0 0 1 0 1 0 1 1 1 1 1 0 1 0 1 1 0 1 0 0 1 0 0 1 1 1 1 1 1 1 1 0 0 0 1 0 0 0 0 1 1 1 1 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 1 1 0 1 1 1 1 0 0 0 0 1 1 1 1 0 1 1 0 1 1 0 1 0 0 0 1 1 1 0 0 0 0 1 1 1 1 0 0 1 0 0 1 1 0 0 0 0 1 0 1 1 0 1 0 0 0 1 0 0 0 1 1 1 1 1 0 0 0 0 1 1 1 0 0 1 1 1 0 0 0 1 0 1 1 1 0 0 0 0 0 1 0 0 1 0 1 1 0 0 1 1 1 1 0 0 1 0 0 1 0 0 0 1 1 0 0 1 0 1 0 0 0 0 1 0 0 1 1 0 0 0 1 1 0 1 0 0 1 0 1 0 0 1 1 0 1 0 1 0 1 1 1 0 1 0 0 0 1 0 1 0 0 1 1 0 1 1 1 0

I. Data

Page 6: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

Type de données

The time (measurement datation) is the first parameter for search and identification of the data:

Time span or event Search cone

Data:1. Images (referenced in time), movies 2. Time series, 1D, 2D, 3D, Nx3D3. Combined parameters4. Simulation data

Standard: SPASE : Structured Datamodel

Page 7: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

Archives and databases at CDPP

Deep ArchiveCNES

CDPP portal

SIPADserver

CSDCESR

SiTOOLSserver

Mirror THEMISDatabase

CESR

THEMISserver

Local AMDADatabase

AMDAservice

Access to distantdatabases

CDAWebUSA

CASSINIMAPSKP

CESR

CASSINISKR

LESIA

VEX-MAGIWF

CSD: CDPP StandardisedDatabase

Page 8: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

II. Services

Page 9: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

Messenger

VEX MEX

Ulysses

STEREOA and B

Around the Earth: ACE, WINDTHEMIS, CLUSTER, GEOTAIL, …

shockCom

pressed solar w

ind

Energetic

particles

ejecta

August 15, 2007

Ex.: Prangé et al., Nature, 2004

Page 10: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre
Page 11: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

AMDAAutomated Multi-Dataset Analysis

http://cdpp-amda.cesr.frhttp://cdpp.cesr.fr/downloads/publications/amda_caa_workshop.pdf

Page 12: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

AMDA Automated Mutiple Dataset Analysis

Web based service

Transparent (automated) access to data the user plays with parameters, not with files

AMDA local database (CLUSTER, ACE, THEMIS, GEOTAIL, WIND, …, STEREO, VEX, MEX, …, IMP-8, ISEE, … geomagnetic indices)

External databases (CDAWeb, CASSINI: MAPSKP+SKR, VEX-MAG, THEMIS/CESR, …)

Produces and exploits time-tables and catalogues

Visualisation editor

Parameter editor

Download data

Conditional search

External data

Visual search

Time-Table manager

AMDA DOES NOT WORK FULLY WITH InternetExplorer and Safari

AMDA is public (registred or guess users, at http://cdpp-amda.cesr.fr)

!

Page 13: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

VO: AMDA SPASE compliant

LocalDatabase

AMDA

System

CDAWeb

SKR

MAPSKP

Any databases including a SPASE based interoperability layer can be used by AMDA

VEX-MAG

THEMIS

Page 14: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

III. Participation in Virtual Observatory and interoperability projects

Page 15: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

The CDPP is a founder member of and an active participant to the SPASE consortium

The CDPP follows the IVOA development

A mini-VO: TTE, Time-Table Exchange

HELIO

EuroPLANET

Page 16: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

SPASE (Space Physics Archive Search and Extract ) http://www.spase-group.org/

  Spase[Rq]

     Version[Rq]

     Catalog[* of A]

     Display Data[* of A]

     Numerical Data[* of A]

     Granule[* of A]

     Instrument[* of A]      Observatory[* of A]      Person[* of A]      Registry[* of A]      Repository[* of A]

     Service[* of A]      Extension[* of A]

A datamodel (a way –standardised and structured- for describing data)

A dictionary for solar and space physics data

Tools (generator, editor, validator of descriptors, harvestor, parser, …)

Page 17: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

AMDA-Automated search

-Visual search Time-Tables

CAAValidated high resolution

CLUSTER data

CL

QSAS

Standardisedsub-databases

Other?

CDAWeb

DARTS

CDPP/CESRTHEMIS database

SSLTHEMIS database

Other?

Time-Tables

A mini-VO based on Time-Table Exchange

Time-Tables

Data, parameters Data, parameters

User tools

Collaboration CDPP-CAA-CESR-UKCSC

Page 18: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

HELIOThe Heliophysics Integrated Observatory

Page 19: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

HELIO:The HELiophysics Integrated Observatory

FP7-Infrastructure (e-Infrastructure)

I3 proposal : Scientific Data Infrastructure

3 year project

Selected negociations

Page 20: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

Objectives

Providing an integrated system for relying the sun-Earth-planet system from the exploitation of solar, heliospheric, magnetospheric and ionospheric data.

Providing a coordinated access to these data through data mining and analysis tools.

Page 21: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

HELIOThe CDPP is mainly involved in:

Research (R1, R2, R3, R4)

a) Automated search toolsb) Tools for generating, managing et exploiting

the cataloguesc) Semantics, ontologiesd) Interfaces

Service (S2, S4, S5)Metadata services, workflows, Access interfaces

Page 22: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

IDIS: Integrated Distributed Information System Goal: building a VO of planetology

Page 23: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

Challenges of IDIS/plasma node:components of the problem

Study types:Case studiesStatistical/systematical studiesSimulationTheory

FieldsPlasmaComparative studiesHeliophysics studiesGlobal (inter-nodes) planetary studies

Type of ressources (data, services, tools, …):Plasmas, E-B fieldsNeutral (atmosphere, exosphere, other..)Dust, RingsSmall bodiesPlanetary surface, volcanism, …Solar observations…Models, simulation codesData analysis toolsData treatment tools …

Two levels:-Intra-node: only dealing with plasma ressources, BUT, interacting with other plasma Vos (HELIO, US-VOs)-Inter-nodes: exchanging ressources with nodes of different thematics

the Big Challenge…and a strong justification of a planetary VO

Page 24: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

EuroPLANET/FP6

Co-leader (avec IWF, Graz) of Plasma Node of Europlanet/IDIS

Use Cases Analysis, definition/specifications of the future VO of planetology (User Requirements)

Searchable registry demonstrator based on SPASE

AMDA/IDIS: Scientific exploitation demonstrator using VO concepts and technics

3DView Multi-Mission: a tool for spacecraft location and attitude in the solar system and around the planets to be interoperable

Page 25: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre

EuroPLANET/FP7■ JRA-4: “Tools for Transforming IDIS into a Planetary Virtual Observatory”

• The CDPP is leader of task-2 “Interoperable Data Access”[commitment] : L1-datamodel, i.e., up to the dataset (“Measurement type”) level[commitment] : Prototypes of interfaces to external VOs (HELIO, IVOA)[Prospective] : L2-datamodel, i.e., up to the granule-parameter level in the goal to make the system usable by generic tools

• The CDPP participates to the task-3 “Added Value Services for Users”

■ SA-IDIS:

• The CDPP is co-leader (with IWF) of the Plasma Node of IDIS

A colateral goal: diffusion of the VO culture inside IDIS and the planetology community

Task-2Interoperable Data Access

Task-3Added Value Services

Task-4New DataBases

Page 26: The CDPP Centre de Données de la Physique des Plasmas Plasma Physics Data Centre