EUScreen XL 2014 Conference: DIVE In Digital Hermeneutics

Lora Aroyo VU University Amsterdam

lora-‐aroyo.org @laroyo

In Digital Hermeneu3cs: The Event-‐based Browsing Of Linked Historical Media

Informa(on: Museums & Archives as Inventories of the World

André Malraux, The Imaginary Museum of World Sculpture, 1953

http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

Interpreta(on: Museums & Archives as a Place to Engage with the World

Digital Hermeneu(cs

•  a theory of interpreta<on of informa<on •  bringing people and technology together to explore:

–  how to model and represent informa=on –  how to provide engaging interac=on –  how to support interpreta=on

“Digital Hermeneu<cs: Agora and the online understanding of cultural heritage” In proceedings of Web Science

Conference, (ACM: New York, 2011)


“The Gallery of Cornelis van der Geest” (Willem van Haecht)

explore topics, e.g hun3ng, dogs


Quen3n Metsys The Madonna and Child

explore ar3sts, e.g. their pain3ngs, biographies, links

explore events, e.g types, par3cipants, links


explore perspecives, e.g opinions, interpreta3ons

… also Digital Humanities researchers


… often don’t find what they were searching for

HOW DO WE BRIDGE THE GAP?


Simple Event Model (SEM) OpenAnnota=on (OA) & SKOS

DIVE:MEDIA OBJECT

SEM:EVENT

SEM:PLACE

SEM:TIME

SEM:ACTOR

SKOS:CONCEPT

OA:ANNOTATION

•  Links to EUROPEANA (mul=lingual) •  Links to DBPedia, other vocabularies

Erp, M. van; Oomen, J.; Segers, R.; Akker, C. van de; Aroyo, L.; Jacobs, G.; Legêne, S; Meij, L. van der;O ssenbruggen, J.R. van; Schreiber, G. Automa=c Heritage Metadata Enrichment with Historic Events Museums and the Web 2011 h[p://www.museumsandtheweb.com/mw2011/papers/automa=c_heritage_metadata_enrichment_with_hi


engaging users

through event

narratives

Crowdsourcing Events, En33es & Perspec3ves


Entities & Events Extraction with CrowdTruth.org

ENTITY EXTRACTION

EVENTS CROWDSOURCING AND LINKING TO CONCEPTS THROUGH CROWDTRUTH.ORG

SEGMENTATION & KEYFRAMES

LINKING EVENTS AND CONCEPTS TO KEYFRAMES

A novel approach to gather diversity of perspec=ves & opinions from the crowd, expand expert vocabularies with these and gather new type of gold standard for machines

L. Aroyo, C. Welty: Crowd Truth: Harnessing disagreement in crowdsourcing a rela=on extrac=on gold standard. ACM WebSci 2013.

CrowdTruth.org


Video Event Extrac=on Following the grandeur of Baroque, Rococo art is often dismissed as frivolous and unserious, but Waldemar Januszczak disagrees. […] The first episode is about travel in the 18th century and how it impacted greatly on some of the finest art ever made. The world was getting smaller and took on new influences shown in the glorious Bavarian pilgrimage architecture, Canaletto's romantic Venice and the blossoming of exotic designs and tastes all over Europe.

Rococo: Travel, pleasure, madness

A boarding school where boys from the Dutch East Indies receive a voca=onal educa=on has been set up by the ministry of Social Affairs near Batavia. Trumpeter sounds the reveille; -‐ the boys get out of bed; -‐ the muster is held in front of the building; a`erwards the boys stand in line with a food bowl; they get rice pudding and eat this around long tables in the open air; -‐ the boys get instruc=ons and prac=ce a.o. drawing shapes, forging, metalworking, filing and woodworking;

News from Indonesia: youth care

h]p://vista-‐tv.eu h]p://dive.beeldengeluid.nl

Video Analysis & Crowdsourcing


IBM Faculty Award 2013 & 2014: CrowdTruth

CrowdTruth.org

1st Prize: EuroITV2010 Compe33on Grand Challenge: Waisda? Video Tagging Game

OPENIMAGES.EU •  3000 videos •  NL Ins=tute for Sound & Vision •  mostly news broadcasts

DELPHER.NL •  1.5 Million Scans of •  Radio bulle=ns •  (hand annotated) •  1937 – 1984

dive.beeldengeluid.nl

3rd Price at the Seman=c Web Challenge 2014

Digital Submarine UI Infinity of Explora3on

Events Linking Objects

Crowd Bringing in the Human Perspec3ves

Linked (Open) Data

DIVE Team: Victor de Boer, Oana Inel, Lora Aroyo, Johan Oomen, Elco Van Staveren, Werner Helmich & Dennis De Beurs

dive.beeldengeluid.nl CrowdTruth.org

http://lora-aroyo.org http://slideshare.net/laroyo @laroyo

Credits & Acknowledgements


CrowdTruth Team •  Chris Welty •  Robert-‐Jan Sips •  Wing-‐Yan Man •  Lin-‐En Wu •  Anca Dumitrache •  Oana Inel •  Jelle v.d. Ploeg •  Ta=ana Cristea •  Khalid Khamkham •  Harrië[e Smook •  Benjamin Timmermans •  Rens van Honschooten •  Susanna van de Ven •  Merel van Empel •  Arne Rutjes • 

Agora Team •  Chiel van den Akker •  Marieke van Erp •  Lourens v.d. Meij •  Susan Legene •  Geertje Jackobs •  Guus Schreiber

PrestoPrime Team •  Riste Gligorov •  Marteen Brinkerink •  Lo[e Belice Baltussen •  Johan Oomen •  Michiel Hildebrand •  Jacco van Ossenbruggen

On the Web •  http://waida.nl •  http://prestoprime.org •  http://agora.cs.vu.nl •  http://sealincmedia.wordpress.com •  http://notube.tv •  http://vista-tv.eu •  http://dive.beeldengeluid.nl •  http://wm.cs.vu.nl

On Twi]er @waisda @agora-‐project @sealincmedia @prestocenter @notubeproject @vistatv #CrowdTruth

Technology

EUScreen XL 2014 Conference: DIVE In Digital Hermeneutics