20
From CegeSoma spreadsheets to Linked Data: a Wikibase journey Anne Chardonnens @annechardo Linking the Past, KBR, 22.11.2019

From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

From CegeSoma spreadsheets to Linked Data:a Wikibase journey

Anne Chardonnens

@annechardo

Linking the Past, KBR, 22.11.2019

Page 2: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

Andrée de JonghAndrée De JonghAndrée DeJonghDe Jongh, Andrée Eugénie AdrienneCountess Andree ‘Dedee’ de JonghDédéeCyclone DDPetit CycloneThe Postman

Page 3: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 4: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

1 PERSON = 1 UNIQUE IDENTIFIER

Page 5: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 6: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 7: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 8: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 9: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

http

://lo

d-cl

oud.

net/

(201

7-08

-22)

}

Page 10: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 11: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

Two processes run in parallel…0. The data

Working on a sample Working on the whole dataset

Page 12: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

1. Cleaning and deduplicating the data

Manual process based on deductionsOpenRefine &

The Python Record Linkage toolkit

Page 13: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

2. Reconciling names with external resources

Custom research OpenRefine reconciliation services (Wikidata, Viaf, ULAN etc.)

.

Page 14: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

3. Modeling the data

Data modeling based on a representative sample From strings to things (URIs)

Page 15: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 16: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

4. Running a Wikibase

Locally AGR server

Page 17: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

5. Importing data

MediaWiki Graphical User Interface Several solutions for (Semi-)automatic data ingestion

Wikibase-edit

QuickStatements

Wikidata Integrator

Pywikibot

Heard Library Python script

Page 18: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats

6. Querying data

Simple search box SPARQL Query Service

Page 19: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats
Page 20: From CegeSoma spreadsheets to Linked Data: a Wikibase …adochs.be/wp-content/uploads/2019/12/20191122_Anne_Wikibase.pdfArquennes Pit" rages Mons El sene Brugge St-Amands GebOat Woonplaats