The International Planetary Data Alliance (IPDA): Activities

in 2010-2012

Daniel Crichton, Alain Sarkissian, Yasumasa Kasba, Mara Teresa Capria, Reta Beebe, J. Steven Hughes, Pedro Osuna

COSPAR 2012Mysore, India

19 July 2012

2

Moving Towards International Interoperability

• In 2005, an initial plan was developed to explore interoperability between ESA Planetary Science Archive and NASA Planetary Data System

– ESA and NASA shared same data standards based on PDS v3

• In 2006, the IPDA was formed with an initial Steering Committee with representatives from several agencies

• In 2008, COSPAR officially recognized IPDA for setting archiving standards via a resolution in Commission B

• IPDA has just completed its 7th meeting

COSPAR 2012

COSPAR 2012 3

Mission of IPDA* • “Facilitate global access to, and exchange of, high

quality scientific data products managed across international boundaries”

• Support construction of compatible archives• Support sharing of tools and software services

• Define “data standards within the IPDA, including the data models and derived dictionaries, based on the NASA Planetary Data System (PDS) that is the de-facto standard for all planetary data at the time of the IPDA

founding” * Extracted from IPDA Charter, July 2007

Current IPDA Steering Committee

COSPAR 2012 4

Steering Committee Members : 2011-2012Chair (2011-2013) Dan Crichton (NASA/JPL, PDS)

Deputy Chair (2011-2013) Alain Sarkissian (IPSL)

Chair (2009-2011) Yasumasa Kasaba (Tohoku Univ., Japan)

Former Chair (2006-2007) Joe Zender (ESA: PSA)

Former Chair (2007-2009) Maria Teresa Capria (IASF/INAF, Italy)

NASA-PDS Reta Beebe (NMSU), Dan Crichton (NASA)ESA-PSA Dave Heather, Christophe ArvisetCanada (CSA) Mickael Germain, Vicky HipkiFrance (CNES) Richard Moreno, Thierry Levoir, Alain Sarkissian (IPSL)

Germany (DLR) Karin Eichentopf, Thomas RoatschIndia (ISRO) B. Gopala Krishna, R. SrinivasanItaly (ASI) Paolo Giommi, Maria Teresa Capria (INAF)Japan (JAXA) Iku Shinohara, Yukio Yamamoto UK Mark Leese (Open Univ.), Peter Allan (RAL)

China Chunlai Li, Wang Chi (CAS)with Ling Zongcheng (Shandong Univ.)

Russia Vladimir Nazarov, Alexander ZAKHAROV (RAS/RKA)

Constructing International Planetary Data ArchivesStandards

5COSPAR 2012

COSPAR 2012 6

IPDA Standards Architecture

• The IPDA Reference System Architecture is decomposed into three core pieces:

– Process Architecture• Describes a set of standard

processes for planetary science archive data systems

– Data Architecture• Describes a set of data

standards for planetary science archive data systems

– Technology Architecture

• Describes a set of standards for enabling interoperability between planetary science archive data systems

• IPDA has initiated projects in each of these areas

A Reference Architecture is a set of best practice specifications that can be used for guiding the implementation of a system

Focus in 2010-2012• Development and Coordination with PDS on the

next generation PDS (PDS4) to enable construction of compatible planetary archives

• Development of a Planetary Data Access Protocol to access planetary archives

• Development of international registries to enable registration and search of data, tools and services

• Standards related to geometry and navigation• Improvements in the operation and

administration IPDA and release of standardsCOSPAR 2012 7

PDS4: Next Generation PDS• PDS4 is an upgrade from PDS version 3 to version 4.

– Drive consistency across future archive products

• A transition from a 20-year-old collection of standards and tools to a modern system constructed using best practices for data system development to enable international planetary data archives.

• Fewer, simpler, and more rigorously defined formats for science data products.

• Use of XML, a well-supported international standard, for data product labeling, validation, and searching.

• A hierarchy of data dictionaries built to the ISO 11179 standard, designed to increase flexibility, enable complex searches, and make it easier to share data internationally.

COSPAR 2012 8

COSPAR 2012 97th IPDA Steering Committee Meeting, July 11-13, 2012, Bangalore, India

Projects 2011-2012• PDS4 Prototype Project - S. Martinez, ESA• Registry Development - S. Hardman, NASA• PDAP Development and Coordination - J.

Salgado, ESA; Y. Yamamoto, JAXA; N. Hirata, Univ of Aizu; Alain Sarkissian, IPSL/LATMOS; Michel Gangloff, CNES

• IPDA Query Language - S. Hughes, NASA• Website Development - E. Law, NASA• Geometry - C. Acton, NASA

COSPA 2012 10

PDS4: Moving towards an International Archive and Infrastructure

COSPAR 2012 11

• Identify the existing subset of standards used by PDS/PSA which are appropriate for internationalization; Collaboration with PDS improvements to its data standards in PDS4

• Develop a mechanism for management of the standards at an international level (e.g., coordinated through the IPDA Archive Data Standards Project)

• Align existing agency standards and processes with the internationalization

Data Object ModelStandards Structure (IPDA and Agency Level)

Agency Testing of PDS4*• PDS is making a big effort to refine the information model. Major

decisions made on the XML technologies (i.e. reusability, XML Schema 1.1 and the combination of XML Schema and Schematron) are considered a clear improvement to the PDS4 information model implementation.

• Versions 7-8 of the XML Schemas address many of the key issues identified by the IPDA PDS4 project last year (e.g. define further restrictions on attributes/classes/types).

• Some of the issues identified last year have been postponed by PDS for later releases (e.g. local data dictionaries, documentation) and therefore were not evaluated during these exercises.

Credit: Santa Martinez, ESA, IPDA PDS4 Project Lead 2011-2012

COSPAR 2012 12

Cross Agency Access, Registration and Search of Planetary Archives

COSPAR 2012 13

Registered Objects:•Websites•Data Sets•Investigations, Instruments, etc.•Tools and Services

Search results include mission support pages and other more specific search interfaces.

Search Service supports the PDS and PDAP protocols enabling development of other portals and applications on this infrastructure.

See Poster B09-0018-12

Example: PDS Search of PSA

COSPAR 2012 14

Data sets and other results returned include products from NASA and PSA.

PSA data sets currently link directly to a PSA web-based interface.

Remote Query Example

COSPAR 2012 15

• Navigate to the API endpoint:– http://pdsbeta.jpl.nasa.gov/tools/search-service/pds/search?term=“venus express”

&return-type=xml

• The following should appear in the browser: <response>

<lst name="responseHeader">

<int name="status">0</int>

<int name="QTime">1</int>

<lst name="params">

<str name="term">"venus express"</str>

<str name="return-type">xml</str>

</lst>

</lst>

<result name="response" numFound="114" start="0" maxScore="1.8728198">

<doc>

<float name="score">1.8728198</float>

<str name="title">VENUS EXPRESS SKY/VENUS SPICAV 2 SOIR EXT2 V3.0</str>

…

Parameters that were passed in the search criteria.

Number of results returned and the position in the result set.

The “term” parameter is the equivalent of text-based search.

IPDA Endorsements at 2012 Meeting

• Reviewed SPICE endorsement– July 2010 recommendation for agency adoption of

SPICE (no change)

– Recommendation to continue a geometry project to improve geometry specification (in future releases of PDS4)

• Established endorsement of PDS4 data standards– Testing over the past year by many agencies supports

movement forward

– Move from cross-agency testing to early adoption for future missions (e.g, Bepi Columbo)

– Supply results of testing back to PDS4 design teams

Projects 2012-2013• PDS4 Implementation - D. Heather, ESA• Registration and Search - S. Hardman NASA• ESA Registry Implementation - D. Heather, ESA• Tool Registration - T. Stein, Wash Univ• PDAP Core - J. Salgado, ESA• PDAP/PDS4 Integration - S. Hughes, NASA• Geometry - C. Acton, NASA

COSPAR 2012 17

Summary

• Excellent progress observed at the 7th IPDA Meeting

• Excellent collaboration between IPDA and PDS regardng PDS4– Testing of PDS4 Standards– Interoperability between ESA and NASA with PDAP– Establishment of an IPDA registry– Cross Agency Search

• The projects in 2013 continue to move IPDA towards a achieving the goal of building compatible planetary science archives and providing interoperability

18COSPAR 2012

Next IPDA Meeting

COSPAR 2012 19

Date July 2013

Structure Steering Committee

Location: Hosted by CNES in Paris, France

THANK YOU!

• Questions?

COSPAR 2012 20