DataNet Federation: Data Conservancy

Research Data Access and Preservation Summit

April 9, 2010

Overview

• My apologies for not being present

• Good news is that some of my Data Conservancy colleagues are present

• This presentation is not a comprehensive or general description of the Data Conservancy but rather focused on panel questions

Early Days

• One very important point about how the Data Conservancy addresses challenges about data management infrastructure, current data practices, interoperability, etc…

• …is that we do not yet fully understand the full picture

• A core goals of DataNet is better understanding of such topics

Data Management Infrastructure

• The Data Conservancy will ingest data through multiple means (large-scale batch, transactional, real-time)

• Architecture emphasizes well-defined interfaces, modularity and interchangeability

• Reference implementations using well-established technologies with broad support (e.g., Fedora)

• Storage layer features that support access to data stored or preserved elsewhere (interfaces to third-party storage services)

Current Data Practices

• Ask Chris Borgman, Melissa Cragin and Mike Wright (and my other Data Conservancy colleagues I may not realize are in the audience)!

• Even in these early days, we are developing initial preservation policies based on existing foundations such as OAIS, “traditional” preservation, etc.

Challenges and Opportunities

• Technological “lock-in” or path dependence – critical need to realize that infrastructure will evolve over time

• Sustainability – technical, financial, content itself

• “Divide and Conquer” – no DataNet partner can address these challenges singlehandedly – this is an opportunity!

Vision

Acknowledgements

Office of Cyberinfrastructure DataNet Award #0830976

NLG grant award LG0606018206