18
Metadata Cleanup with Linked Data and OpenRefine Greer Martin Metadata Technologies Librarian Loyola University Chicago

Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Metadata Cleanup with Linked Data and OpenRefine

Greer MartinMetadata Technologies Librarian

Loyola University Chicago

Page 2: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 3: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 4: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 5: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Other Data Sources for Reconciliation

• FAST (Faceted Application of Subject Terminology)• VIVO Scientific Collaboration Platform• VIAF• Sharedshelf Built Work Registry• OpenCorporates• dbpedia• GeoNames

Page 6: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

OpenRefine

• Powerful data cleanup tool• Formerly known as Google Refine• Java tool• GUI in browser• Functionality: Export/import data, facets, clusters, clean, GREL,

reconciliation

Page 7: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

• 1,500 collections, mostly university records

• Use Re:Discovery Proficio for archival records management system

• Inconsistent use of authorities and controlled vocabularies

University Archives & Special Collections, Paul V. Galvin Library, Illinois Institute of Technology

ArchivesSpace Migration

Page 8: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 9: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 10: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

https://github.com/cmh2166/lc-reconcile

https://lc-reconcile.herokuapp.com/

Page 11: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 12: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Post-reconciliation

Page 13: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

AddingURIs

Page 14: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Reconcile-csv• OpenRefine

reconciliation service that matches one dataset against another

• Found at: http://okfnlabs.org/reconcile-csv/

• Good for adding local metadata

Page 15: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,
Page 16: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Conclusion

• Structured data = cleanup and migration is possible!

• OpenRefine for cleaning, reconciliation, JSON export

Page 17: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Resources

• Free Your Metadata: http://freeyourmetadata.org/• OpenRefine Wiki: https://github.com/OpenRefine/OpenRefine• Video tutorials: http://openrefine.org

Page 18: Metadata Cleanup with Linked Data and OpenRefine...• Formerly known as Google Refine • Java tool • GUI in browser • Functionality: Export/import data, facets, clusters, clean,

Thank you!Greer Martin

[email protected]