MUSIC AND LINKED OPEN DATA Results and Lessons Learned from the DOREMUS Project

IAML - LEIPZIG (2018-07-24)

Cécile Cecconiccecconi@cite-musique.fr

2

Improve music description to foster music exchange and reuse

Travel to the heart of the musical archives of major French institutions

Connect sources, multiply usage, enrich user experience

3

What We Had….

Musical Works62 550 | XML

Scores9 154 | XML

Concerts1 800 (Itema3) | XML

7 700 (performances Rédomi)

Playlists of web radio(one year of broadcasting)

Musical Works5 800 | UNIMARC

Scores30 319 | UNIMARC

Foreseen concerts 4 122 | XML

Recordings of concerts3 500 | UNIMARC

Musical Works135 940 | INTERMARC

Scores89 184 | INTERMARC

CD INTERMARC

4

5

What We Wanted...

6

- Music specific extension of FRBRoo

- Works and events at the heart of the model

- Relies on Linked Data principles (everything is an URI, RDF model)

FRBR

museum informationbibliographic records

The DOREMUS Model

Modelling a Musical Work

7

Modeling a Performance

Event

F28 Expression Creation

Expression

F25 Performance Plan

Work

F20 Performance Work

is realised in

created

created arealisation of

incorporates

Event

F31 Performance

consist of

performed

{Concerts Nocturne. I, Clairs de lune.2004-05-02. Philharmonie de Paris}

Composition of Sonata quasi una fantasia by Beethoven

Concert Nocturne. I, Clairs de lunein the Philharmonie de Paris2004-05-02

Event

M28 Individual Performance

Event

M42 Performed Expression

Creation

Expression

M43 Performed Expression

Work

M44 Performed Work

created

created arealisation of

is realised in

is performed expression of

has member

Event

E7 Activity

Actor

E21 Person

consist of

8

Modelling a CD

Event

M29 Editing

Expression

M46 Set of Tracks

created

edited

Expression

M24 Track

Expression

M24 Track

has component

has component

is partial of full recording of

Manifestation

F4 Manifestation Singleton

created

{Performance de Sonata quasi una fantasia}

Event

F31 Performance

Expression

M43 Performed Expression

consist of

Work

M44 Performed Work

Event

F29 Recording Event

Expression

F26 Recording

Work

F21 Recording Work

is realised in

created

created arealisation of

was recorded through

Expression

F24 Publication Expression

is incorporated in

Event

F30 Publication Event

Work

F19 Publication Work

Event

E7 Activity

Actor

F11 Corporate body

created

created arealisation of

consist ofcarried out by

is realised in

performed expression is incorporated in

should be carried by

Expression

F22 Self-Contained

Expression

is performed expression of Event

E7 Activity

Actor

E21 Person

EventF28

Expression Creation

Event

M42 Performed Expression

Creation

Manifestation

F3 Manifestation Product Type

9

The Ontology Documentation

Final version

Soon available in French and English :

- 80 classes- 180 properties

(last draft at :

http://data.doremus.org/ontology/ )

One dataset of music linked data

Reusable : MusicBrainz, Google, Spotify…

Works : 148 177

Foreseen performances : 3 553

Performances : 19 536

Artists; composers & performers : 141 076

Converting and linking the data

UNIMARC

INTERMARC

conversion (marc2rdf, etc.)

Rules set by the experts

11

Controlled Vocabularies

https://github.com/DOREMUS-ANR/marc2rdf/

XML

12

Controlled vocabularies produced by DOREMUS

Keys (30)“C major” “G minor”...

Modes (22)“dorien” “lidien” ...

Catalogues (151)“KV” “BWV” “Hob”...

Derivation Types (16)“pot-pourri” “arrangement”

Functions (~ 100)“composer” “conductor” “sound

engineer” ...

--> : Multilingual - Interoperable

And : Performer status, Performer responsabilities, Vocal

techniques, ...

Genres (~ 900)“Funk”, “Gospel”...

INTERLINKED

Medium of performance MIMO / Voices IAML (~ 2500)

“piano”, “violin”... INTERLINKED

13

http://data.doremus.org/vocabulary/iaml/genre/cha

“cha-cha-cha”

http://data.doremus.org/vocabulary/diabolo/genre/cha_cha_cha

“cha cha cha”

http://yamplusplus.lirmm.fr/

=String matching +

graph traversalInterface for validating

the matching

Vocabulary alignement

14

MIMO

IAML419 CONCEPTS

rameau876 CONCEPTS

Hornbostel & Sachs

diabolo2117

CONCEPTS

itema3314

CONCEPTS

redomi179

CONCEPTS

IAMLsimplifié

LCSH

16

BNF PHILHARMONIE

http://data.doremus.org/expression/d72301f0-0aba-3ba6-93e5-c4efbee9c6ea

“Quasi una fantasia”COMPOSER BeethovenORDER NUM 14OPUS 27, n 2GENRE sonataCASTING pianoKEY C sharp major1st PUB ?PREMIERE ?

http://data.doremus.org/expression/37932fbc-fef3-3edb-9fae-1eec9b4be01d

“Sonata quasi una fantasia”COMPOSER BeethovenORDER NUM 14OPUS 27, n 2GENRE sonata, romantic musicCASTING piano (1)KEY C sharp major1st PUB 1802, ViennaPREMIERE ?

Musical Works : the difficulty of Linking Highly Heterogeneous Data

Legato

DATA CLEANING INSTANCE PROFILING

INSTANCE INDEXING AND

MATCHING

POST-PROCESSING

https://github.com/DOREMUS-ANR/legato

Examples of questions● Works for violin, clarinet and piano (only) - Results

● Concerts recorded in the Philharmonie de Paris where the orchestra is conducted by the concertmaster- Results

● Melodies for medium voice, composed between 1870 and 1913 - Results

● Chamber music works for - at the most - violin, clarinet and piano, but no sonatas for violin and piano or clarinet and piano- Résults

Overture

Examples :

Pavane, Gabriel Fauré

Pastoral, Beethoven

RecommandationQUATUOR YSAŸE

Concerto pour piano n°3, Rachmaninov

21

How to compute the similarity between 2 features?

vocabulary:iaml/mop/wob vocabulary:iaml/mop/wcl

Example: MoPThe clarinet is more similar to the oboe or to the cello?

vocabulary:iaml/mop/svc

22

vocabulary:iaml/mop/wob vocabulary:iaml/mop/wcl

vocabulary:iaml/mop/w vocabulary:iaml/mop/s

vocabulary:iaml/mop/svc

Example: MoP

How to compute the similarity between 2 features?

23

Example: MoP

vocabulary:iaml/mop/wob vocabulary:iaml/mop/wcl

vocabulary:iaml/mop/svc

Casting Detail Casting Detail

Casting Detail

Casting862 times

Casting1213 times

How to compute the similarity between 2 features?

DOREMUS Chatbot

https://chatbot.doremus.org/

Thank you !https://github.com/DOREMUS-ANR/ & http://data.doremus.org

25

Last results on September 25, 2018 registration