69
Open Data in Archaeology Prof Julian Richards Director, Archaeology Data Service University of York

Open Data in Archaeology, Julian D. Richards

Embed Size (px)

DESCRIPTION

Open Data in Archaeology, presentation by Julian D Richards given at the Opening the Past 2013 conference, Pisa, 13 June 2013 Introduction to Open Data in Archaeology, the benefits and challenges. The Archaeology Data Service is presented as a case study of the UK's national research data infrastructure alongside examples from other countries, such as EDNA in the Netherlands, SND in Sweden, IANUS in Germany, Open Context and tDAR in the United States, Sustainable Archaeology in Canada, and FAIMS in Australia. The development of international frameworks in Europe from ARENA to ARIADNE are described. http://www.ariadne-infrastructure.eu

Citation preview

Page 1: Open Data in Archaeology, Julian D. Richards

Open Data in Archaeology

Prof Julian Richards Director, Archaeology Data Service

University of York

Page 2: Open Data in Archaeology, Julian D. Richards

Open Data • Open data is the idea that certain data

should be freely available to everyone to use and republish as they wish, without restrictions from copyright, patents or other mechanisms of control (Wikipedia, 9 June 2013)

• Open data tradition and archaeology

Page 3: Open Data in Archaeology, Julian D. Richards

Outline • Open Data • National digital research data infrastructures

– The Archaeology Data Service case study – Developments in other countries

• Interoperability and transnational research infrastructures – ARIADNE

Page 4: Open Data in Archaeology, Julian D. Richards

Open Data • Related to Open Access movement for

publications • Data.gov & Data.gov.uk • "A piece of data is open if anyone is free to

use, reuse, and redistribute it — subject only, at most, to the requirement to attribute and/or share-alike

Page 5: Open Data in Archaeology, Julian D. Richards

Linked Open Data Cloud

Page 6: Open Data in Archaeology, Julian D. Richards

Linked Open Data in Archaeology

Page 7: Open Data in Archaeology, Julian D. Richards

Open Data in Science • The concept of open access to scientific data was

institutionally established in preparation for the International Geophysical Year of 1957-8. The International Council of Scientific Unions established several World Data Centers to minimize the risk of data loss and to maximize data accessibility, further recommending in 1955 that data be made available in machine-readable form.

• Therefore, Open-science-data movement long predates the Internet, but publishing or obtaining data has become much less expensive and time-consuming.

• 2004, the OECD (Organisation for Economic Co-operation and Development) Science Ministers - all publicly funded archive data should be made publicly available.

• 13 June 2013 – European parliament ratifies new rules on Open Data - includes cultural heritage data

Page 8: Open Data in Archaeology, Julian D. Richards

Open Data in Archaeology: Pros • “Past belongs to everyone”

– democratisation of knowledge

• Accelerated pace of new knowledge • Economic benefit of Open Data • Public benefit of Open Data

– Community engagement in heritage e.g. Finds.org.uk; Europeana;

– Justification of taxpayer investment

Page 9: Open Data in Archaeology, Julian D. Richards

Open Data in Archaeology: Challenges

• Privacy issues – site location; indigenous peoples; personal data

• Misuse of data • Funding of data management & data

infrastructures • Importance of provenance • Legitimate concerns of information providers

Page 10: Open Data in Archaeology, Julian D. Richards

Outline • Open Data • National digital research data infrastructures

– The Archaeology Data Service case study – Developments in other countries

• Interoperability and transnational research infrastructures – ARIADNE

Page 11: Open Data in Archaeology, Julian D. Richards

UK: Archaeology Data Service

• Founded 1996, University of York

• 17 staff • Collections

– 1,100,000 metadata records

– 20,000+ unpublished fieldwork reports

– 700+ rich archives • Guides to Good Practice • DPC Decennial Award

2012

Page 12: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Mandated Deposition

Page 13: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice ac uk

Relatore
Note di presentazione
ADS now preserves over 17,000 unpublished fieldwork reports, or grey literature, and over 500 rich digital data archives , ranging from one-off university-led research projects such as the excavations of the burials of the earliest Anglo-Saxon kings of England...
Page 14: Open Data in Archaeology, Julian D. Richards
Relatore
Note di presentazione
...to major infrastructure programmes, such as the archaeology of the Channel Tunnel rail link...
Page 15: Open Data in Archaeology, Julian D. Richards
Relatore
Note di presentazione
... or of Heathrow Terminal 5
Page 16: Open Data in Archaeology, Julian D. Richards
Relatore
Note di presentazione
They range in time from the earliest hominid tools...
Page 17: Open Data in Archaeology, Julian D. Richards
Relatore
Note di presentazione
... to the second world war and even cold war defensive systems.
Page 18: Open Data in Archaeology, Julian D. Richards

British Archaeological Awards 2008 Best Archaeological Innovation

Relatore
Note di presentazione
We have won two British Archaeological Awards for Best Archaeological Innovation: (i) in 2008 for the LEAP project, which allowed users to seemlessly explore the links between ADS archives and papers published in the ejournal Internet Archaeology.
Page 19: Open Data in Archaeology, Julian D. Richards
Page 20: Open Data in Archaeology, Julian D. Richards
Relatore
Note di presentazione
(ii) in 2012 for the Grey Literature Library.
Page 21: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice ac uk

Relatore
Note di presentazione
The implementation of DOIs
Page 22: Open Data in Archaeology, Julian D. Richards
Relatore
Note di presentazione
... and the geo-spatial mapping have radically enhanced the usability of what was already a unique resource.
Page 23: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

• Free at point of use

• No login/password required

• Copyright and Liability statements

• Access & Use Conditions

• Rights asserted frequently

• IPR challenge for first use

Open Access?

Page 24: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk http://archaeologydataservice ac uk

• Non-exclusive licence to distribute

• Use for ‘research, learning and teaching’ – and research includes commercial re-use

• Ownership remains with creators

• Digital Object Identifiers (DOIs)

IPR Regime

Page 25: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

The alternative proposed in 1996 was far worse – written permission from each user!

Page 26: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

Page 27: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Year on year usage 1997-2011

0

2000000

4000000

6000000

8000000

10000000

12000000

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011

Relatore
Note di presentazione
The value of the benefits delivered is demonstrated by the large number of users, from all sectors who have made use of ADS resources. The ADS website currently receives around 250,000 visits per year, comprising 13 million page requests and 150,000 unique downloads.
Page 28: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Grey Literature Library

Relatore
Note di presentazione
Downloads from the grey literature library have escalated dramatically following the introduction of the map search and DoIs.
Page 29: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Who is Using the ADS?

Relatore
Note di presentazione
Page 30: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Who is using the ADS?

Relatore
Note di presentazione
Page 31: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Primary re-use of data

Relatore
Note di presentazione
A 2011 RIN/JISC survey “Data centres: their use, value and impact” clearly demonstrated that the ADS has a hugely significant impact on the sector and has received a near universal favourable reaction from archaeologists. This is true to such an extent that a common theme in responses was that swathes of current archaeological research practice would simply not be possible without the ADS. This survey of the nature of re-use shows around 40% from academic research, 11% heritage management and 8% commercial research – also high levels of private research and general interest.
Page 32: Open Data in Archaeology, Julian D. Richards

http://archaeologydataservice.ac.uk

Access Vs. Content

Page 33: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk 33

Page 34: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

Develop and refine a range of methods to measure the costs, benefits, economic impacts and value of the ADS

The Impact of the ADS Project: a study and methods of enhancing sustainability

Relatore
Note di presentazione
A current JISC-funded study on the value of the ADS is being undertaken by Neil Beagrie and John Houghton, Professor of Economics at the University of Victoria.
Page 35: Open Data in Archaeology, Julian D. Richards

Investment Return over 30 years? Increase in returns on investment in data and related infrastructure arising from additional use facilitated by ADS

ADS Value/Impact Analysis

£1 investment provides up to £8.30 return

Relatore
Note di presentazione
The preliminary figures indicate an efficiency gain of £14-64 million pounds, and between a 2.5 and eight-fold return on investment, increasing through time. In summary, it’s not only important to preserve archaeological data - also a sustainable business case can be made.
Page 36: Open Data in Archaeology, Julian D. Richards

Outline • Open Data • National digital research data infrastructures

– The Archaeology Data Service case study – Developments in other countries

• Interoperability and transnational research infrastructures – ARIADNE

Page 37: Open Data in Archaeology, Julian D. Richards

National Digital Research Infrastructures

Page 38: Open Data in Archaeology, Julian D. Richards

Netherlands: eDNA

• 2004-6 pilot study – DANS & Leiden University

• 2007 eDNA • 2 members of staff, plus

DANS infrastructure • 2011 – 17,000 fieldwork

reports

Page 39: Open Data in Archaeology, Julian D. Richards

Sweden: SND

• Swedish National Data Service, University of Gothenburg

• 2012 first archaeological archives, in collaboration with Uppsala University – GIS files, Östergötland

• Swedish Rock Art archives

Page 40: Open Data in Archaeology, Julian D. Richards

Germany: IANUS

• 2012 – DAI scoping project

• Initial staff of two

Page 41: Open Data in Archaeology, Julian D. Richards

United States: Open Context

• Alexandria Archive Institute

• 2007+ • 2 staff members • Primarily data

publication tool • California Digital Library

provides long term preservation

Page 42: Open Data in Archaeology, Julian D. Richards

United States: tDAR

• 2009+ • Mellon start-up grant • Based Arizona State

University • Digital Antiquity

consortium • 4+ staff members

Page 43: Open Data in Archaeology, Julian D. Richards

Canada: Sustainable Archaeology

• 2010+ • Western & McMaster

universities • c.3 staff members • Funded by Canadian

Foundation for Innovation / Ontario Ministry of Research and Innovation

• Physical and digital infrastructure

Page 44: Open Data in Archaeology, Julian D. Richards

Australia: FAIMS

• Federated Archaeological Information Management System

• 2012+ • University of New South

Wales • Funded by Australian

government NECTAR programme

• Mobile apps • Using instance of tDAR as

repository infrastructure

Page 45: Open Data in Archaeology, Julian D. Richards

Outline • Open Data • National digital research data infrastructures

– The Archaeology Data Service case study – Developments in other countries

• Interoperability and transnational research infrastructures – ARIADNE

Page 46: Open Data in Archaeology, Julian D. Richards

Interoperability & Data Integration

Hansen, H.J., 1992 'European archaeological databases: problems and prospects', in J. Andresen et al. (eds) Computing the Past. Computer Applications and Quantitative Methods in Archaeology. Aarhus. 229-37.

Page 47: Open Data in Archaeology, Julian D. Richards

ARENA: Archaeological Records of Europe: Networked Access.

Page 48: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

Page 49: Open Data in Archaeology, Julian D. Richards

ARENA 2002-4

• Culture 2000 programme

• Six European partners • Portal and exemplar

archives • Z39.50 & OAI

technology

Page 50: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

Z39.50 & OAI Search

Set When Query

Set What Query

Where Query Optional Search Map

Page 51: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

Page 52: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk

Page 53: Open Data in Archaeology, Julian D. Richards

DARIAH: ARENA2 2009-10 Technical demonstrator Web services architecture

Page 54: Open Data in Archaeology, Julian D. Richards

What: When: Where search

Page 55: Open Data in Archaeology, Julian D. Richards

ADS: DANS: CIMEC

Page 56: Open Data in Archaeology, Julian D. Richards

Europeana: CARARE

Page 57: Open Data in Archaeology, Julian D. Richards

FASTIONLINE

• Established 2000 • AIAC/ LP Archaeology • Database of excavations

for classical archaeology • 12,000 excavation

reports

Page 58: Open Data in Archaeology, Julian D. Richards

arachne

• DAI central object database

• 300,000 images • Metadata mapped to

CIDOC-CRM

Page 59: Open Data in Archaeology, Julian D. Richards

PELAGIOS

Classical Archaeology : Open Linked Data

Page 60: Open Data in Archaeology, Julian D. Richards

ARIADNE

Page 61: Open Data in Archaeology, Julian D. Richards

What is ARIADNE • ARIADNE is a EU-funded project aimed at

integrating the European Research Infrastructures on archaeological datasets

• Its overall goal is to overcome the fragmentation of archaeological data repositories and to foster a culture of data sharing and re-using

• ARIADNE is managed by a partnership joining the excellence of European archaeology and technology, and is open to the collaboration of researchers, professionals and institutions from anywhere in Europe and abroad

Page 62: Open Data in Archaeology, Julian D. Richards

The ARIADNE partnership • 24 partners • 16 countries • Coordination

– PIN – UoY-ADS

Page 63: Open Data in Archaeology, Julian D. Richards

Why ARIADNE

Percentage of archaeological projects in dataset size groups

“Average” size of project datasets

The “data deluge”

Page 64: Open Data in Archaeology, Julian D. Richards

Why ARIADNE Willingness to share, use and re-use •400,000 downloads from the Archaeology Data Service (ADS) repository of ”grey” literature (unpublished archaeological reports) in 6 years (5,500/month) •45,000 downloads from ADS in three months in 2010 (15,000/month) •94% of respondents to a SAA survey state they would use electronic data more, if they were accessible •ARACHNE visits: 82,000 in 2010, 140,000 in 2011

• Open Access for Science initiative

Page 65: Open Data in Archaeology, Julian D. Richards

Why ARIADNE Need for integration • Research questions

go beyond academic or administrative borders

• Integrate datasets overlapping in scope

• Access unpublished information

ADS: 20.000 grey literature reports 1.100.000 records

Arachne: 500.000+ images 250.000 objects

GALLICA: several thousand reports

SIGECweb: 270.000 records

(archaeology) FASTI online:

12.000 reports

DANS: 20,000 grey literature

reports

Page 66: Open Data in Archaeology, Julian D. Richards

How to achieve integration Data sharing requires: •Suitability of someone else’s data •Interoperability of datasets •Trust in data collected by others •Guarantee of data “provenance” •Suitable licensing agreements •Suitable repositories

Page 67: Open Data in Archaeology, Julian D. Richards

Looking to the future • 50% of all journals now require data to be

deposited in an archive • Need a new metaphor for publication • Blurring of publication and other forms of

dissemination • Data management not for its own sake – no

preservation without re-use

Page 68: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk 68

http://archaeologydataservice.ac.uk/

Follow us on Twitter: @ADS_Update

Befriend us on Facebook: http://www.facebook.com/archaeology.data.service

[email protected]

Page 69: Open Data in Archaeology, Julian D. Richards

24/06/2013 http://archaeologydataservice.ac.uk 69

Professor Julian D Richards Director, Archaeology Data Service Department of Archaeology University of York The King's Manor York, YO1 7EP, UK Tel: +44 1904 323930 Fax: +44 1904 323902 Email: [email protected] http://www.york.ac.uk/archaeology/staff/academic-staff/julian-richards/ UoY disclaimer: http://www.york.ac.uk/docs/disclaimer/email.htm