ITWG, February 7, 2020

Jonathan WardEditor, Getty Vocabulary Program

OpenRefine Tool for Data Reconciliation

ITWG, February 7, 2020

➔ Open Source: http://openrefine.orgAvailable in multiple languages; runs in a browser.

➔ New GVP service for data reconciliation & cleaning

◆ Tutorial here:http://www.getty.edu/research/tools/vocabularies/obtain/openrefine.html

◆ Uses GREL language (General Refine Expression Language)https://github.com/OpenRefine/OpenRefine/wiki/GREL-Functions

2

OpenRefine

ITWG, February 7, 2020 3

OpenRefine – “Create Project”

ITWG, February 7, 2020 4

OpenRefine – “Create Project”

ITWG, February 7, 2020 5

New Project – everything saved

ITWG, February 7, 2020 6

Simple cleanup of date columns- Apply a global fix

OpenRefine: Applying a global fixSimple cleanup of “date” column

ITWG, February 7, 2020 7

Simple cleanup of date columns- Apply a global fixSimple cleanup of “date” column

ITWG, February 7, 2020 8

Simple cleanup of date columns- Apply a global fixSimple cleanup of “date” column

Transform using GREL expression

ITWG, February 7, 2020 9

Simple cleanup of date columns- Apply a global fixSimple cleanup of “date” column

Transform using GREL expression

ITWG, February 7, 2020 10

Simple cleanup of date columns- Apply a global fixSimple cleanup of “date” column

ITWG, February 7, 2020 11

Simple cleanup of date columns- Apply a global fix

ITWG, February 7, 2020 12

Reconciliation: ULAN artist names

ITWG, February 7, 2020 13

Reconciliation: ULAN artist names

ITWG, February 7, 2020 14

Reconciliation: ULAN artist names

ITWG, February 7, 2020 15

Reconciliation: ULAN artist names

ITWG, February 7, 2020 16

Reconciliation: ULAN artist names

ITWG, February 7, 2020 17

Reconciliation: ULAN artist names

ITWG, February 7, 2020 18

Reconciliation: ULAN artist names

Thank you.Jonathan Ward

Editor, Getty Vocabulary Program