39
Louisa Matthews Collections Development Manager 15/05/2019 http://archaeologydataservice.ac.uk 1 Digital Archiving and Commercial Archaeology http://archaeologydataservice.ac.uk

Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

Louisa MatthewsCollections Development Manager

15/05/2019 http://archaeologydataservice.ac.uk 1

Digital Archiving and Commercial Archaeology

http://archaeologydataservice.ac.uk

Page 2: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 2

• The ADS: Trusted Digital Repository• Why Archive?• How digital archiving can help solve some

practical problems• Tools and Implementation• Epilogue - HERALD

http://archaeologydataservice.ac.uk

Introduction

Page 3: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 3http://archaeologydataservice.ac.uk

The ADS: Who we are and what we do

• Founded 1996 • Department of Archaeology, University of York• Collections

o 1,100,000 metadata recordso 34,535+ unpublished fieldwork reportso 700+ rich archives

• Guides to Good Practice• DPC Decennial Award 2012

Page 4: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 4

The ADS supports research, learning and teaching with freely available, high quality and dependable digital resources. It does this by preserving digital data in the long term, and by promoting and disseminating a broad range of data in archaeology. The ADS promotes good practice in the use of digital data in archaeology, it provides technical advice to the research community, and supports the deployment of digital technologies.

http://archaeologydataservice.ac.uk

Our original philosophy

Page 5: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 5

“The rate of change in computing technologies is such that information can be rendered

inaccessible within a decade…”

- Joint Information Systems Committee: Why Digital Preservation?

http://archaeologydataservice.ac.uk

Why were we worried about digital archives?

Page 6: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 6

Format failure / obsolescence

15/05/201915/05/201915/05/2019

Hardware failure / obsolescence“…erm, does anyone have a floppy disk

drive…?”

Problems

Page 7: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 7

Lack of Documentation

“Have we got the box with the picture on?”

Access Failure

“Dear former employer / supervisor,I need my project from a few

years ago as my laptop met with an accident, can I have a copy please…?”

Problems

Page 8: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 8

How we enact the visionHow do you know you can trust the way we preserve our data?• We hold a Data Seal of Approval • We follow the Open Archival Information System (OAIS) reference model

Datasealofapproval.org

Page 9: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 9

Common to traditional archives :o A collections policyo Selection and retention, review and disposalo Sensitive data DPA/FoI requests o Human Tissue Act 2004o Licensing and copyrighto Terms and conditions of useo Charging policy

PLUS:Preservation Policy

http://archaeologydataservice.ac.uk

Our archive policies

ADS Preservation Policy ADS Repository Operations ADS Ingest Manual Copyright Infringement Policy Reference Model for an Open

Archival Information System

Page 10: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 10http://archaeologydataservice.ac.uk

If it’s good enough for NASA, it’s good enough for us!

Page 11: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 11http://archaeologydataservice.ac.uk

Guides to Good practice

Page 12: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 12

Dissemination

How do we disseminate our data?All of our holdings are freely available through a web interface

Page 13: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 13

• Open formats; open data

http://archaeologydataservice.ac.uk

Archive of files and downloads of data

Page 14: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 14http://archaeologydataservice.ac.uk

Searchable interfaces

Page 15: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 15http://archaeologydataservice.ac.uk

Digital Object IdentifiersTypes of persistent identifier e.g Handles, Archival Resource Keys (ARKs) and Persistent URLs (PURLs), all can be resolved to an Internet location. The scheme that is gaining most traction is the Digital Object Identifier (DOI).

http://dx.doi.org/ 10.5284 / 1000389resolver service prefix suffix

(assigning body) (resource)

Page 16: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 16http://archaeologydataservice.ac.uk

Collection level

Page 17: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 17

As well as being good practice?

• Big datasets (not Big Data)• Museum Archives• Analogue obsolescence• Data Discovery, Accessibility and Reuse

Currently developing relationships with:• Southampton City• Derbyshire CC• Devon + Plymouth• Worcestershire• Northamptonshire• Northumberland (images)• Leicestershire CC HE Team and Museum Service

http://archaeologydataservice.ac.uk

Can digital archiving help solve some practical problems?

Page 18: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 18http://archaeologydataservice.ac.uk

Laser Scanning and other 3D

http://archaeologydataservice.ac.uk/archives/view/amarna_leap_2011/index.cfm

Page 19: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 19http://archaeologydataservice.ac.uk

‘CD inna box’: Southampton Museums

Page 20: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 20

• Use of digital archiving for negative investigations – i.e. where there is no physical archive, is a digital paper substitute sufficient?

http://archaeologydataservice.ac.uk

‘Negative’ paperwork

Page 21: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 21

• Chemical Photography is becoming extremely precarious

• Traditional archive repositories are under pressure, in terms of space and resources

• Solutions are 1. Print everything out and trust that people have used the

right ink, paper, etc. and you can store it in the right conditions.

2. Use a sustainable digital archiving solution

http://archaeologydataservice.ac.uk

Analogue Obsolescence

Page 22: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 22http://archaeologydataservice.ac.uk

Northumberland Images

Page 23: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 23http://archaeologydataservice.ac.uk

Implementation

• Brief• WSI• Museum

Deposition• Regional

statement of good practice

What constitutes a ‘good’ digital archive?

Page 24: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 24http://archaeologydataservice.ac.uk

Tools

Page 25: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

Epilogue: HERALD, BIAB, HIAS

http://archaeologydataservice.ac.uk/blog/oasis/

Page 26: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 26

Collecting and Validating DataThe HERALD Project

http://archaeologydataservice.ac.uk

Page 27: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 27

• HERALD Stage 1 Report – March 2015• BIAB Stage 1 Report – September 2015• DES-OASIS Project Grant Application – Sept

2015 (from April 2016 if successful)• HERALD Stage 2 Project Design inc. BIAB –

November 2015• OASIS Redevelopment 2016 onwards

http://archaeologydataservice.ac.uk

Where are we now?

Page 28: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 28http://archaeologydataservice.ac.uk

How did we envision OASIS helping?

Fieldwork input Print out Backlog Local Archive

govt

Print outNational agency Backlog

Post

Post

Page 29: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 29

Report details

•Title•Author(s)•Date• Issuer or

publisher•Place of issue or

publication•Description•URL•Report number

Archive

•Archive recipient•Archive

identifier•Archive contents•Media available•Archive notes

People involved

•Project brief originator

•Project design originator

•Project director or manager

•Project supervisor

• Funder•Organisation

Location

• Site name•County•District•Parish•Grid reference•Postcode

Site details

•Project name•Description•Project dates•Event type•Monument and

artefact•Associated

Identifiers•Other event info

http://archaeologydataservice.ac.uk

What information does OASIS collect?

Page 30: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 30http://archaeologydataservice.ac.uk

Where does information go?

Research projects

Radiocarbon DatingRecording Form

DES Form

Grey literature library

Geophysical Survey database

Grey literature Grey literature Research

Web serviceWeb service

OAI-PMHWeb service

Page 31: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 31

OASIS is like a transit lounge…

(… and currently about this old too!)

Page 32: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 32

Unfortunately we have to deal with some problems too…

There’s a problem of flow in and out of the transit lounge

And in some places it isn’t used enough!

Page 33: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 33

What the survey tells us:

Ongoing communication, engagement and trainingOngoing communication, engagement and trainingOngoing communication, engagement and trainingOngoing communication, engagement and trainingFlexible workflowsOngoing communication, engagement and trainingOngoing communication, engagement and trainingOngoing communication, engagement and trainingDifferent levels of interaction

Archiving and dissemination of reports Inclusion of Museum curators

Record specialist data when appropriateRecord specialist data when appropriateRecord specialist data when appropriateMove focus from archaeology to historic environmentRecord specialist data when appropriateMove focus from archaeology to historic environmentRecord specialist data when appropriateMove focus from archaeology to historic environmentInclude simple to use import and export systems

Page 34: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 34

Different for almost everyone: • some want to start and

complete the record • some want units to do it • some want a mini record • some want a very rich record • some want access to richer

records but may not use them • some want the museums

involved….

Example: Work flow lines

…so no one size fits all!!

Page 35: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

Environmental

OASISPLUS

OASIS STANDARD

OASIS LITE

VAG

Pottery

Geophysics

Other modules:BIG ANCHORS

Records remain ‘OPEN’ with alerts when core fields are completed

Bibliographic record & Report uploaded by HERs or contractors

Constitutes a basic HER

record

Creates a rich metadata record for specialist / project specific

recording

Page 36: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 36

Will OASIS allow automated report upload?

Options:• 1. Continue status quo with proxy sign-off from Historic England• 2. Automated release (recommended option)

In option 2, the following are proposed:

• 1. Non-reviewing HERs - reports are released directly into BIAB (marked as un-reviewed)

• 2. HER which is reviewing records/reports - reports are released into BIAB once reviewed. If the reports are not reviewed within a period of time (i.e. one month) then they are released into BIAB (but marked as un-reviewed).

• If so, what should the period be? How should these reports be ‘flagged’?

http://archaeologydataservice.ac.uk

Work Package Questions Outstanding

Page 37: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 37

Currently 34538 reports in the library and over 18000 of these come from OASIS.

They are linked to by HERs and Units.

Every report has a DOI

http://archaeologydataservice.ac.uk

The Library of Unpublished Fieldwork Reports

Page 38: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

15/05/2019 http://archaeologydataservice.ac.uk 38

Staff time saved by no longer needing to: • check copyright / permission to disseminate on a case-by-case basis• copy / scan then email / post reports• help visitors find paper reportsAlso:• Report retrieval time via the HER is almost instantaneous for files held by the ADS• Future maintenance of this system will be minimal as each report has a DOI

How might HERALD help?

Page 39: Digital Archiving and Commercial Archaeology · Archive •Archive recipient •Archive identifier •Archive contents •Media available •Archive notes People involved •Project

Louisa MatthewsCollections Development Manager

15/05/2019 http://archaeologydataservice.ac.uk 39

Digital Archiving and Commercial Archaeology

http://archaeologydataservice.ac.uk