IPY Data ManagementMark A. Parsonsco-chair IPY Data Policy and Management Subcommittee

eGY MeetingBoulder, Colorado, USA13 March 2006

World Data Center for Glaciology, BoulderFacilitating the international exchange of snow and ice data

MAP 2006.03.13 2

What is IPY?

The largest and broadest research program the planet has ever seen!As of January:

>30,000 investigators>60 countries>1000 expressions of intent>200 coordination proposals

Addressing physical, life, and social sciences

+200 more31 Jan.

Only 352 days away

eGY

IHYYear

of Planet Earth?

MAP 2006.03.13 4

What is IPY?

A fantastic data management challenge!

MAP 2006.03.13 5

2 IPY Data Meetings in Cambridge

• 2 March: Inaugural meeting of the IPY Data Policy and Management Subcommittee

• 3-4 March: An IPY data management planning workshop

Data SubcommitteeMark Parsons, USA; co-chairTaco de Bruin, Netherlands; co-

chairNathan Bindoff, Australia

(represented by Kim Finney)Joan Eamer, Norway/UNEPHannes Grobe, GermanyRay Harris, UK/GEOSSEllsworth LeDrew, CanadaXin Li, China (absent)Håkan Olsson, SwedenAlexander Sterin, Russia/WMO

(Evgeny Vyazilov)Vladimir Papitashvilli, USA/eGYBirger Poppel, Greenland

Eberhard Fahrbach – liaison to JCDave Carlson – Director IPY- IPO

Addressing issues of• IPY data definition• Data policy• Relations to observational

systems

MAP 2006.03.13 7

An IPY Data Management Workshop

• Over 40 participants from 13 countries• Major goal: determine functions, form,

and implementation for an IPY Data and Information Service

MAP 2006.03.13 8

Organization of IPY Data Management

IPY Joint Committee

Data Policy & Management Subcommittee• scientists• data managers• funding agencies

ProgrammeOffice Data

& InformationService

eGY

Projects Data Centers, Virtual Observatories, etc.

Users

MAP 2006.03.13 9

Alternate Views of the DIS

DIS?

DIS?

MAP 2006.03.13 10

Format of the meeting

• Presentations on existing approaches• Breakout groups to identify issues and

recommendations• Standards• Managed data access• Identifying archives• Data discovery• Data submission/publication• Semantics

MAP 2006.03.13 11

Why do data management?

Our primary purpose should be to serve the objectives of IPY, esp:• International exchange• Interdisciplinary science• Building a legacy

Who or what does eGY data management serve?

MAP 2006.03.13 12

Crosscutting themes or recommendations

• Outreach—working toward the culture change, “Preserve or Perish”• To providers, users, developers, public• On the value of data management, open access, and

data publication• On the use of standards (esp. ISO19115 and OGC)• Awareness of appropriate technologies• Clarification of terms, eg. “discovery” “open access”• Need to recognize different cultures require different

approaches• Encourage formal recognition for data publication

eGY can help develop a data management outreach strategy

MAP 2006.03.13 13

Crosscutting themes or recommendations

• Pre-collection survey• Planned (funded) data to be collected • Other data needed?• Planned data access mechanisms• Existing archives, portals, experts—identify gaps

(missing and nonparticipating data center)• Develop a registry (linked to the IPO/honeycomb)• Need to track throughout project—relate to outreach

• Linkage, access to, and preservation of operational data

MAP 2006.03.13 14

Crosscutting themes or recommendations

• Phased approach necessary for everything• Initially pragmatic and based on existing structures

and technologies• Aim high for the future, act as a catalyst• Consider developing some prototype approaches to

discovery, access (information commons), organization….

• Hybrid of distributed and centralized data• Need a high level architecture diagram.

MAP 2006.03.13 15

Crosscutting themes or recommendations

• Pursue corporate funding (as well as national)• OGCII is a possible partner• Need an overarching/coordinated data

“proposal”--task group?

MAP 2006.03.13 16

Some immediate outcomes (more later)

• IPY data policy (by 15 Apr.)• Letter from JC to national funding agencies

identifying specific DM requirements and requesting explicit DM funding.

• Recommendation to ICSU and WMO to designate an data coordinator.

• Efforts to link to the observational community• IPY Knowledge Organization Group• Presentation at EGU, 4 April• Townhall meeting at EGU. 5 April

Data Systems Today

© N. Carr 2006

What they need to become

© N. Carr 2006

Backup slides

MAP 2006.03.13 21

Discussed and refined the draft IPY data policy:

• Create a data policy to meet IPY objectives

• International collaboration

• Interdisciplinary science

• Building a legacy

• Free and open access

• Defined data types

• Metadata

• Publications

Data used by IPY

Data generated by IPY

Exceptions:• ethical• endangered species• commercial

Outcomes of data committee meeting