Provenance & Context Workshop - Guiding Documents

Provenance & Context Workshop - Guiding Documents

QuickTime™ and a decompressor

are needed to see this picture.

Overview of Guiding Documents - R. DuerrESIP Federation Meeting, Santa Barbara, July 2009.



Outline:

• OAIS Reference Model

• USGCRP Guidance

• PREMIS Metadata Standard




The OAIS Reference Model

• A CCSDS and ISO standard detailing: The responsibilities of an archive A functional model describing how to preserve

information and make it available to users An information model describing what ancillary

information is needed to ensure that future users understand and can use the information preserved

A common set of terminology that can be used to describe the above




OAIS Archive Responsibilities

• Negotiate with information providers to receive and obtain sufficient rights to appropriate information to ensure long-term preservation

• Designate a community which should be able to understand the information preserved

• Ensure that the information is independently understandable to that community

• Document procedures and policies regarding data preservation and access

• Make the information available




OAIS Functional Model

OAIS Archive

Ingest Access

Archive

Data Mgmt

Administration

Producer

Preservation Planning

Consumer

MANAGEMENT




OAIS Information Model

ContentInformation

PreservationDescriptionInformation

DescriptiveInformation

About Package 1

Package 1

Packaging Information




OAIS Information Model - Content Info.

• Data Object - the information to be preserved

• Representational Information - allows a user to understand the data Structure (e.g., flat binary file, ASCII table,

net-CDF file, HDF, etc.) Content (e.g., a table of station IDs, dates,

latitude, longitude, incidence angle, brightness temperature)




OAIS Info. Model - Preservation Description

• Provenance - documents the history of the object

• Reference - documents object identifiers and their generation mechanisms

• Fixity - documents methods used to ensure there are no undocumented changes

• Context - the relationship of the object to its environment








are needed to see this picture.Presented by R. Duerr at the Summer Institute on Data Curation, June 2-5, 2008

Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign

Provenance and Contextual Information

• Instrument/sensor characteristics including pre-flight or pre-operational performance measurements (e.g., spectral response, noise characteristics, etc.)

• Instrument/sensor calibration data and method• Processing algorithms and their scientific basis,

including complete description of any sampling or mapping algorithm used in creation of the product (e.g., contained in peer-reviewed papers, in some cases supplemented by thematic information introducing the data set or derived product)

• Complete information on any ancillary data or other data sets used in generation or calibration of the data set or derived product

10



are needed to see this picture.Presented by R. Duerr at the Summer Institute on Data Curation, June 2-5, 2008

Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign

Provenance and Contextual Information (cont.):

• Processing history including versions of processing source code corresponding to versions of the data set or derived product held in the archive

• Quality assessment information• Validation record, including identification of validation data

sets• In the case of earth based data, station location and any

changes in location, instrumentation, controlling agency, surrounding land use and other factors which could influence the long-term record

• A bibliography of pertinent Technical Notes and articles, including refereed publications reporting on research using the data set

• Information received back from users of the data set or product

11




PREMIS - Where did it come from?

• PREMIS = PREservation Metadata: Implementation Strategies

• Developed by an OCLC and RLG sponsored international working group Representatives from libraries, museums,

archives, government, and the private sector.

• Based on the OAIS reference model




PREMIS - What’s its purpose?

• Provide a core preservation metadata set with broad applicability across the digital preservation community Supported by a data dictionary XML schema Examples are provided




PREMIS - What’s its status?

• Maintained by the Library of Congress• Editorial board with international

membership• User community consulted on changes

through the PREMIS Implementers Group

• Version 1 was released in June 2005• Version 2 was released in March 2008




Rights

Events

Agents

“a coherent set of contentthat is reasonablydescribed as a unit”

For example, a web site, data set or collection of data sets

“a coherent set of contentthat is reasonablydescribed as a unit”

For example, a web site, data set or collection of data sets

“a discrete unit of information in digital form”

For example, a data file

“a discrete unit of information in digital form”

For example, a data file“assertions of one or more

rights or permissionspertaining to an object

or an agent”e.g., copywrite notice, legalstatute, deposit agreement

“assertions of one or more rights or permissionspertaining to an object

or an agent”e.g., copywrite notice, legalstatute, deposit agreement

“an action that involves atleast one object or agentknown to the preservation

repository”e.g., created, archived,

migrated

“an action that involves atleast one object or agentknown to the preservation

repository”e.g., created, archived,

migrated

“a person, organization, orsoftware program associatedwith preservation events in

the life of an object”e.g., Dr. Spock donated it

“a person, organization, orsoftware program associatedwith preservation events in

the life of an object”e.g., Dr. Spock donated it

PREMIS - Entity-Relationship Diagram

IntellectualEntities

Objects




PREMIS - Types of Objects

• Representation - “the set of files needed for a complete and reasonable rendition of an Intellectual Entity”

• File • Bitstream - “contiguous or non-

contiguous data within a file that has meaningful common properties for preservation purposes”




PREMIS - Object Metadata

• objectIdentifier objectIdentifierType objectIdentifierValue

• preservationLevel• objectCategory*• objectCharacteristics

compositionLevel fixity

o messageDigestAlgorithmo messageDigesto messageDigestOriginator

size

formato formatDesignation

formatName formatVersion

o formatRegistry formatRegistryName formatRegistryKey formatRegistryRole

significantProperties* inhibitors

o inhibitorTypeo inhibitorTargeto inhibitorKey




PREMIS - Object Metadata (continued)

• creatingApplication creatingApplicationName creatingApplicationVersion dateCreatedByApplication CreatingApplicationExtension

• originalName• storage

contentLocationo contentLocationTypeo contentLocationValue

storageMedium

• signatureInformation signatureInformationEncoding signer signatureMethod signatureValue signatureValidationRules signatureProperties keyInformation

• signatureInformationExtension





• environment environmentCharacteristic environmentPurpose environmentNote dependency

o dependencyNameo dependencyIdentifier

dependencyIdentifierType dependencyIdentifierValue

softwareo swNameo swVersiono swTypeo swOtherInformationo swDependency

hardwareo hwNameo hwTypeo hwOtherInformation





• relationship relationshipType relationshipSubtype relatedObjectIdentification* relatedEventIdentification*

• linkingEventIdentifier*• linkingIntellectualEntityIdentifier*• linkingRightsStatementIdentifier*




PREMIS - Object Metadata Notes

• Not all fields are mandatory

• Not all fields apply to all types of objects

• Some fields are repeatable




PREMIS - Event Metadata

• eventIdentifier eventIdentifierType eventIdentifierValue

• eventType• eventDateTime• eventDetail• eventOutcomeInformation

eventOutcome eventOutcomeDetail

• linkingAgentIdentifier linkingAgentIdentifierType linkingAgentIdentifierValue linkingAgentRole

• linkingObjectIdentifier linkingObjectIdentifierType linkingObjectIdentifierValue linkingObjectIdentifierRole




PREMIS - Agent Metadata

• agentIdentifier agentIdentifierType agentIdentifierValue

• agentName• agentType




PREMIS - Rights Metadata

• rightsStatement rightsStatement

Identifiero rightsStatement

IdentifierTypeo rightsStatement

IdentifierValue rightsBasis copyrightInformation* licenseInformation* statuteInformation*

rightsGrantedo acto restrictiono termOfGrant

startDate endDate

o rightsGrantedNote

linkingObjectIdentifier linkingAgentIdentifier

• rightsExtension