127
david peterson @davidseth Bringing History Alive Telling stories with Linked Data and open source tools #awm11 Friday, 14 October 11

Bringing History Alive: Telling stories with Linked Data and open source tools

Embed Size (px)

DESCRIPTION

The Australian War Memorial is connecting and enriching online archives and collections toward building a platform for telling history. Through Drupal 7 and Linked Data, the Memorial intends to develop tools that designers, researchers and historians can use to help find new ways of building historical narratives.We will demonstrate some early prototypes and experiments, key uses of Linked Data, practical publishing tools and discuss how this work is unfolding inside one of Australia’s major collecting institutions.

Citation preview

Page 1: Bringing History Alive: Telling stories with Linked Data and open source tools

david peterson @davidseth

Bringing History AliveTelling stories with Linked Data and open source tools

#awm11

Friday, 14 October 11

Page 2: Bringing History Alive: Telling stories with Linked Data and open source tools

Thanks

• Adam Bell @bumphead

• Armin Haller @W3CAustralia

#awm11Friday, 14 October 11

Page 3: Bringing History Alive: Telling stories with Linked Data and open source tools

Period of Transition

#awm11Friday, 14 October 11

Page 4: Bringing History Alive: Telling stories with Linked Data and open source tools

• Web of Documents

Period of Transition

#awm11Friday, 14 October 11

Page 5: Bringing History Alive: Telling stories with Linked Data and open source tools

• Web of Documents

• Web of Things

Period of Transition

#awm11Friday, 14 October 11

Page 6: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 7: Bringing History Alive: Telling stories with Linked Data and open source tools

1. You are dealing with real things

#awm11Friday, 14 October 11

Page 8: Bringing History Alive: Telling stories with Linked Data and open source tools

1. You are dealing with real things

2. You only have part of the picture

#awm11Friday, 14 October 11

Page 9: Bringing History Alive: Telling stories with Linked Data and open source tools

1. You are dealing with real things

2. You only have part of the picture

3. Everything is connected

#awm11Friday, 14 October 11

Page 10: Bringing History Alive: Telling stories with Linked Data and open source tools

1. You are Dealing with Real Things

Friday, 14 October 11

Page 11: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 12: Bringing History Alive: Telling stories with Linked Data and open source tools

• People

#awm11Friday, 14 October 11

Page 13: Bringing History Alive: Telling stories with Linked Data and open source tools

• People

• Places

#awm11Friday, 14 October 11

Page 14: Bringing History Alive: Telling stories with Linked Data and open source tools

• People

• Places

• Events

#awm11Friday, 14 October 11

Page 15: Bringing History Alive: Telling stories with Linked Data and open source tools

• People

• Places

• Events

• Documents

#awm11Friday, 14 October 11

Page 16: Bringing History Alive: Telling stories with Linked Data and open source tools

Persistent URLs

#awm11Friday, 14 October 11

Page 17: Bringing History Alive: Telling stories with Linked Data and open source tools

• Everything needs its own address on the web

Persistent URLs

#awm11Friday, 14 October 11

Page 18: Bringing History Alive: Telling stories with Linked Data and open source tools

• Everything needs its own address on the web

• That address should not change

Persistent URLs

#awm11Friday, 14 October 11

Page 19: Bringing History Alive: Telling stories with Linked Data and open source tools

Shared Understanding

#awm11Friday, 14 October 11

Page 20: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

Shared Understanding

#awm11Friday, 14 October 11

Page 21: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

Shared Understanding

#awm11Friday, 14 October 11

Page 22: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

Shared Understanding

#awm11Friday, 14 October 11

Page 23: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

Shared Understanding

#awm11Friday, 14 October 11

Page 24: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

• Facebook Open Graph

Shared Understanding

#awm11Friday, 14 October 11

Page 25: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

• Facebook Open Graph

• FOAF

Shared Understanding

#awm11Friday, 14 October 11

Page 26: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

• Facebook Open Graph

• FOAF

• Geonames

Shared Understanding

#awm11Friday, 14 October 11

Page 27: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

• Schema.org

• Facebook Open Graph

• FOAF

• Geonames

• New York Times

Shared Understanding

#awm11Friday, 14 October 11

Page 28: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabularies

#awm11Friday, 14 October 11

Page 29: Bringing History Alive: Telling stories with Linked Data and open source tools

• Can’t Find what you Need?

Vocabularies

#awm11Friday, 14 October 11

Page 30: Bringing History Alive: Telling stories with Linked Data and open source tools

• Can’t Find what you Need?

• You know your space better then anyone

Vocabularies

#awm11Friday, 14 October 11

Page 31: Bringing History Alive: Telling stories with Linked Data and open source tools

• Can’t Find what you Need?

• You know your space better then anyone

• Create it!

Vocabularies

#awm11Friday, 14 October 11

Page 32: Bringing History Alive: Telling stories with Linked Data and open source tools

• Can’t Find what you Need?

• You know your space better then anyone

• Create it!

• Ontology [Owl]

Vocabularies

#awm11Friday, 14 October 11

Page 33: Bringing History Alive: Telling stories with Linked Data and open source tools

• Can’t Find what you Need?

• You know your space better then anyone

• Create it!

• Ontology [Owl]

• Thesaurus [SKOS]

Vocabularies

#awm11Friday, 14 October 11

Page 34: Bringing History Alive: Telling stories with Linked Data and open source tools

• Can’t Find what you Need?

• You know your space better then anyone

• Create it!

• Ontology [Owl]

• Thesaurus [SKOS]

• Simple Knowledge Organization System

Vocabularies

#awm11Friday, 14 October 11

Page 35: Bringing History Alive: Telling stories with Linked Data and open source tools

Vocabulary Tools

#awm11Friday, 14 October 11

Page 36: Bringing History Alive: Telling stories with Linked Data and open source tools

• Pool Party

Vocabulary Tools

#awm11Friday, 14 October 11

Page 37: Bringing History Alive: Telling stories with Linked Data and open source tools

• Pool Party

• Neologism [Drupal based]

Vocabulary Tools

#awm11Friday, 14 October 11

Page 38: Bringing History Alive: Telling stories with Linked Data and open source tools

• Pool Party

• Neologism [Drupal based]

• structOntology [Drupal based]

Vocabulary Tools

#awm11Friday, 14 October 11

Page 39: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11Friday, 14 October 11

Page 40: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

Friday, 14 October 11

Page 41: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

Friday, 14 October 11

Page 42: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

Friday, 14 October 11

Page 43: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

• Microdata

Friday, 14 October 11

Page 44: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

• Microdata

Friday, 14 October 11

Page 45: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

• Microdata

Friday, 14 October 11

Page 46: Bringing History Alive: Telling stories with Linked Data and open source tools

HTML Data

#wds11

• RDFa

• Microdata

• Microformats

Friday, 14 October 11

Page 47: Bringing History Alive: Telling stories with Linked Data and open source tools

Named Entity Extraction

#awm11Friday, 14 October 11

Page 48: Bringing History Alive: Telling stories with Linked Data and open source tools

Named Entity Extraction

What?

#awm11Friday, 14 October 11

Page 49: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

#awm11Friday, 14 October 11

Page 50: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

#awm11Friday, 14 October 11

Page 51: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

• OpenCalais (Drupal module)

#awm11Friday, 14 October 11

Page 52: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

• OpenCalais (Drupal module)

#awm11Friday, 14 October 11

Page 53: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

• OpenCalais (Drupal module)

• Yahoo Term Extraction (Drupal module)

#awm11Friday, 14 October 11

Page 54: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

• OpenCalais (Drupal module)

• Yahoo Term Extraction (Drupal module)

• Apache Stanbol

#awm11Friday, 14 October 11

Page 55: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

#awm11Friday, 14 October 11

Page 56: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

#awm11Friday, 14 October 11

Page 57: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

• Spin up your own instance

#awm11Friday, 14 October 11

Page 58: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

• Spin up your own instance$ svn co http://svn.apache.org/repos/asf/incubator/stanbol/trunk stanbol

#awm11Friday, 14 October 11

Page 59: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

• Spin up your own instance$ svn co http://svn.apache.org/repos/asf/incubator/stanbol/trunk stanbol

$ mvn clean install

#awm11Friday, 14 October 11

Page 60: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

• Spin up your own instance

• RESTful interface

#awm11Friday, 14 October 11

Page 61: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

• Spin up your own instance

• RESTful interface

• Analyze textual content, enhance with with named entities (person, place, organization)

#awm11Friday, 14 October 11

Page 62: Bringing History Alive: Telling stories with Linked Data and open source tools

Automatically Tag your Stuff

Apache Stanbol

• Spin up your own instance

• RESTful interface

• Analyze textual content, enhance with with named entities (person, place, organization)

• Use your own vocabularies

#awm11Friday, 14 October 11

Page 63: Bringing History Alive: Telling stories with Linked Data and open source tools

2. You only have Part of the Picture

Friday, 14 October 11

Page 64: Bringing History Alive: Telling stories with Linked Data and open source tools

Open World / Closed World

#awm11Friday, 14 October 11

Page 65: Bringing History Alive: Telling stories with Linked Data and open source tools

• Don’t use strict, unchangeble definitions of your data

• JSON works well

• NoSQL or GraphDB

Allow for the Unknown

#awm11Friday, 14 October 11

Page 66: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 67: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 68: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 69: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 70: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 71: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 72: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 73: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 74: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 75: Bringing History Alive: Telling stories with Linked Data and open source tools

#awm11Friday, 14 October 11

Page 76: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 77: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 78: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 79: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 80: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 81: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 82: Bringing History Alive: Telling stories with Linked Data and open source tools

R.E.M.

#awm11Friday, 14 October 11

Page 83: Bringing History Alive: Telling stories with Linked Data and open source tools

Drupal Content Types

• Easily model any sort of object

• Content Types

• Fields

• Drupal 7 plays well with the Web

#awm11Friday, 14 October 11

Page 84: Bringing History Alive: Telling stories with Linked Data and open source tools

3. Everything is ConnectedFriday, 14 October 11

Page 85: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 86: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 87: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 88: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 89: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 90: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 91: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 92: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 93: Bringing History Alive: Telling stories with Linked Data and open source tools

6° of Kevin Bacon

#awm11Friday, 14 October 11

Page 94: Bringing History Alive: Telling stories with Linked Data and open source tools

Giant Global Graph

#awm11Friday, 14 October 11

Page 95: Bringing History Alive: Telling stories with Linked Data and open source tools

Giant Global Graph

"It's not the documents, it is the things they are about which are important". Obvious, really.

Tim Berners-Lee

#awm11Friday, 14 October 11

Page 96: Bringing History Alive: Telling stories with Linked Data and open source tools

Facebook Open Graph Beta...

(the beginning of the semweb?)

#awm11Friday, 14 October 11

Page 97: Bringing History Alive: Telling stories with Linked Data and open source tools

Facebook Open Graph Beta...

#awm11Friday, 14 October 11

Page 98: Bringing History Alive: Telling stories with Linked Data and open source tools

Facebook Open Graph Beta...

#awm11Friday, 14 October 11

Page 99: Bringing History Alive: Telling stories with Linked Data and open source tools

RDF

Alexander Kelley wounded WW I

#awm11Friday, 14 October 11

Page 100: Bringing History Alive: Telling stories with Linked Data and open source tools

RDF

Subject

Alexander Kelley wounded WW I

#awm11Friday, 14 October 11

Page 101: Bringing History Alive: Telling stories with Linked Data and open source tools

RDF

Subject Predicate

Alexander Kelley wounded WW I

#awm11Friday, 14 October 11

Page 102: Bringing History Alive: Telling stories with Linked Data and open source tools

RDF

Subject Predicate Object

Alexander Kelley wounded WW I

#awm11Friday, 14 October 11

Page 103: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data

“Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”#awm11Friday, 14 October 11

Page 104: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data

“Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”#awm11Friday, 14 October 11

Page 105: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Program

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 106: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Programby the Man - TimBL

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 107: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Program

★ make your stuff available on the web (whatever format)

by the Man - TimBL

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 108: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Program

★ ★

make your stuff available on the web (whatever format)

make it available as structured data (excel instead image)

by the Man - TimBL

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 109: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Program

★ ★

★ ★ ★

make your stuff available on the web (whatever format)

make it available as structured data (excel instead image)

non-proprietary format (csv instead of excel)

by the Man - TimBL

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 110: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Program

★ ★

★ ★ ★

★ ★ ★ ★

make your stuff available on the web (whatever format)

make it available as structured data (excel instead image)

non-proprietary format (csv instead of excel)

use URLs to identify things, so that people can point at your stuff

by the Man - TimBL

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 111: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data 5 Step Program

★ ★

★ ★ ★

★ ★ ★ ★

make your stuff available on the web (whatever format)

make it available as structured data (excel instead image)

non-proprietary format (csv instead of excel)

use URLs to identify things, so that people can point at your stuff

link your data to other people’s data to provide context★ ★ ★ ★ ★

by the Man - TimBL

http://bit.ly/bURiXV

#awm11Friday, 14 October 11

Page 112: Bringing History Alive: Telling stories with Linked Data and open source tools

Linked Data

• DBpedia

• LODLAM

• JSON-LD

#awm11Friday, 14 October 11

Page 113: Bringing History Alive: Telling stories with Linked Data and open source tools

Bonus Round

#awm11Friday, 14 October 11

Page 114: Bringing History Alive: Telling stories with Linked Data and open source tools

Bonus Round

1. You are dealing with real things

#awm11Friday, 14 October 11

Page 115: Bringing History Alive: Telling stories with Linked Data and open source tools

Bonus Round

1. You are dealing with real things

2. You only have part of the picture

#awm11Friday, 14 October 11

Page 116: Bringing History Alive: Telling stories with Linked Data and open source tools

Bonus Round

1. You are dealing with real things

2. You only have part of the picture

3. Your objects live in the graph

#awm11Friday, 14 October 11

Page 117: Bringing History Alive: Telling stories with Linked Data and open source tools

Bonus Round

1. You are dealing with real things

2. You only have part of the picture

3. Your objects live in the graph

1 + 2 + 3 = API

#awm11Friday, 14 October 11

Page 118: Bringing History Alive: Telling stories with Linked Data and open source tools

Your Site Becomes an API

• Make it easy for your content to be reused

• Queried

• Free it from the confines of your site

#awm11Friday, 14 October 11

Page 119: Bringing History Alive: Telling stories with Linked Data and open source tools

Drupal WYSIWYG Editor

• Makes it easy for users to embed images from catalog

• Uses embedded RDFa

#awm11Friday, 14 October 11

Page 120: Bringing History Alive: Telling stories with Linked Data and open source tools

[demo] Drupal WYSIWYG Editor

#awm11Friday, 14 October 11

Page 121: Bringing History Alive: Telling stories with Linked Data and open source tools

[demo] Drupal WYSIWYG Editor

#awm11Friday, 14 October 11

Page 122: Bringing History Alive: Telling stories with Linked Data and open source tools

[demo] Drupal WYSIWYG Editor

#awm11Friday, 14 October 11

Page 123: Bringing History Alive: Telling stories with Linked Data and open source tools

[demo] Drupal WYSIWYG Editor

#awm11Friday, 14 October 11

Page 124: Bringing History Alive: Telling stories with Linked Data and open source tools

WYSIWYG Editor

• Creates JSON data from RDFa

#awm11Friday, 14 October 11

Page 125: Bringing History Alive: Telling stories with Linked Data and open source tools

WYSIWYG Editor

• Creates JSON data from RDFa

#awm11Friday, 14 October 11

Page 126: Bringing History Alive: Telling stories with Linked Data and open source tools

Demos

• Recollection

• Simile Timeline

#awm11Friday, 14 October 11

Page 127: Bringing History Alive: Telling stories with Linked Data and open source tools

Questions?

#awm11Friday, 14 October 11